Haptic Game & Interface
A haptic device bridges the gap between reality and virtual environments. Haptic feedback has applications in various fields, including gaming, surgical operations, and education. With the growing popularity of e-sports and virtual/augmented reality, there is increasing demand for integrating haptics into user experiences. In this project, we developed a pantograph device to enhance the Fruit Ninja gaming experience by incorporating force feedback and precise positioning using motors and MR sensors. Our project transforms Fruit Ninja from a purely virtual game on a tablet or phone into a physical interaction through the manual manipulation of the pantograph handle.
For more information on this project, please find the write-up through this link here.
Pantograph CAD
The pantograph simplifies to a 4-bar linkage, allowing the tip (handle) to move within a 2-DOF workspace. Two MR sensors at its base track the handle's movement and send its coordinates to an Arduino, which communicates with the game programmed in Processing. Processing served as the platform for designing the user interface and graphics, offering a clear and immersive visualization of the virtual environment. In this environment, the handles position is represented as a trailing blue dot. When its coordinates intersect with a fruit's, motors at the base of the pantograph activate to provide appropriate force feedback, simulating a realistic slicing sensation. To the left is a picture of our pantograph setup, including the handle, sensors, motors, and Arduino, alongside a short clip of the system in action.