3D Eye gaze estimation
3D Eye gaze estimation
Icons made by https://www.flaticon.com/authors/freepik Freepik, taken from https://www.flaticon.com/
Goal
Make it possible to play shooter or other aim heavy games from the comfort of your couch and using controller for other inputs
Plan:
- Create eye gaze locator
- Create video stream decoder
- Create calibrator
- Create stream from gaze tracker to input
- Integrate the new input stream into existing shooter game
Feature based attempt
Feature detectors:
- Harris
- Hessian
Feature detectors:
- Harris
- Hessian
Basically work on the same principle
Used software
- C++ (g++-8)
- Boost.GIL 1.71
- CMake
- Conan
Test set (part 1)
Test set (part 2)
Image credits:
- Photo by Ana Francisconi from Pexels https://www.pexels.com/photo/man-wearing-teal-and-pink-floral-collared-top-1906997/
- https://www.pexels.com/photo/beautiful-beautiful-girl-bright-cute-301958/
- https://www.pexels.com/photo/adult-beard-boy-casual-220453/
- https://www.pexels.com/photo/woman-in-purple-sweater-covering-her-face-905913/
Results
Conclusion
Accurate
Slow
Infeasible
Thank you for your attention
3D Eye gaze estimation