Nodebots: Detecting Gestures with Node.js & Kinect
Worked with NodeBots for 1+ year
Wanted to explore the possibilities of Node.js
Because controlling a robot with a Kinect is pretty cool
Needed a way to use events to tell the robot to perform an action
Gestures seemed the best way to achieve that
What currently exists
Basic Nodebot stack
A way to connect the Kinect to node.js
Very basic event for almost everything
What I needed
Support for a "skeleton"
Support for gestures
Is the initial condition met ?
Is the condition still met ?
Is the final condition met ?
What do I need for gestures?
A Skeleton with an event when it changes
Know the position of the COM
Have a base unit
Gesture detection using a base class
Tracks the skeleton for an initial condition
Checks every 100 ms to see if the condition is still met
If the final condition is met trigger an event
Other classes are used to define the actual gestures
Code time !
Next few steps
Return a skeleton with easier coordinates
Create a npm package
Add more gestures