3D Eye gaze estimation

3D Eye gaze estimation

Icons made by  https://www.flaticon.com/authors/freepik Freepik, taken from https://www.flaticon.com/

Goal

Make it possible to play shooter or other aim heavy games from the comfort of your couch and using controller for other inputs

Plan:

  1. Create eye gaze locator
  2. Create video stream decoder
  3. Create calibrator
  4. Create stream from gaze tracker to input
  5. Integrate the new input stream into existing shooter game

Feature based attempt

Feature detectors:

  • Harris
  • Hessian

Feature detectors:

  • Harris
  • Hessian

Basically work on the same principle

Used software

  • C++ (g++-8)
  • Boost.GIL 1.71
  • CMake
  • Conan

Test set (part 1)

Test set (part 2)

Image credits:

  • Photo by Ana Francisconi from Pexels https://www.pexels.com/photo/man-wearing-teal-and-pink-floral-collared-top-1906997/
  • https://www.pexels.com/photo/beautiful-beautiful-girl-bright-cute-301958/
  • https://www.pexels.com/photo/adult-beard-boy-casual-220453/
  • https://www.pexels.com/photo/woman-in-purple-sweater-covering-her-face-905913/

Results

Conclusion

Accurate
Slow
Infeasible

Thank you for your attention

Made with Slides.com