Goal

Make it possible to play shooter or other aim heavy games from the comfort of your couch and using controller for other inputs

Plan:

1. Create eye gaze locator
2. Create video stream decoder
3. Create calibrator
4. Create stream from gaze tracker to input
5. Integrate the new input stream into existing shooter game

Feature based attempt

Used software

• C++ (g++-8)
• Boost.GIL 1.71
• CMake
• Conan

Test set (part 1)

Test set (part 2)

Image credits:

• Photo by Ana Francisconi from Pexels https://www.pexels.com/photo/man-wearing-teal-and-pink-floral-collared-top-1906997/
• https://www.pexels.com/photo/beautiful-beautiful-girl-bright-cute-301958/
• https://www.pexels.com/photo/adult-beard-boy-casual-220453/
• https://www.pexels.com/photo/woman-in-purple-sweater-covering-her-face-905913/

Results

Conclusion

Accurate
Slow
Infeasible

Thank you for your attention