KINECT 101
Lucas N Ellis
Lead Software Engineer
opGames Inc.
optml.io
Kinect 2 for Windows Disclaimer
This is based on preliminary software and/or hardware, and is subject to change.
ABOUT
Founder opGames Inc.
Beakiez Bubble Pop
opEngine Animation System
(HLSL / FBX)
opC++ Compiler Infrastructure
opGAMES INC. NEWS
Beakiez on Steam Greenlight
Sign up for Beakiez News
KINECT 101
- How does it work?
- For Game Control?
- For 3D Scanning?
- For Motion Capture?
POPULAR KINECT GAMES
- Dance games (Dance Central)
- Sports games (bowling, tennis)
- Fitness games (Nike+ Fitness)
NUI.
Natural User Interface
openNI
Other Interesting Natural Interfaces
- Rocksmith
NUI GAmes CAN IMPROVE LIFE.
(TEDx Talk Oklahoma City)
(TEDx OKC)
- Improved Movement.
- Body / Eye Coordination.
- Personal Trainer. Yoga.
- Fit Video Gamers.
- Get a Kinect and do all the Fitness Games. Done.
We all know a guy who :
- 80/20 Paleo, Nike+ Kinect Game HIIT = -30 lbs
HOW DOES KINECT WORK?
HOW DOES KINECT 1 WORK?
-
Infrared Scatter Pattern / Structured Light
- Horizontal difference gives depth (expected vs actual)
- Gets R G B + Depth from Camera + IR pattern
- 640 x 480 depth resolution, effectively half that
HOW DOES KINECT 2 WORK?
- Time of Flight Infrared
- 524 x 420 depth resolution
-
Almost every IR depth pixel is valid!
- "Infrared Radar"
Game Developer Article on Kinect 1 & 2
ABOUT KINECT SDK
DON'T FREE THE JOINTS BOOMER
But Kinect SDK gives you <x,y,z> for each joint for free
KINECT BASICS DEMO
Kinect 1 Skeleton
Kinect 1 Depth
VS
Kinect 2 Depth
KINECT CONTROL IN GAMES
DEVELOPING WITH KINECT
Kinect 1
No Access for Indies
But, can use with Windows, Unity.
Good for Installations
Kinect 2
Xbox Programs for Indies
Kinect for Windows v2
KINECT CONTROL IN GAMES
Robot Motion Tracking Demo
@ Science Museum Oklahoma
- Unity
-
ZigFu ZDK Plugin
- .NET Serial Interface
- Arduino Unos
MOTION CAPTURE ROBOT DEMO
KINECT 3d SCANNING
POINT CLOUDS
Basic Primitive for all 3D Scanning
Software
-
Cloud Compare
-
MeshLab
KINECT 3d SCANNING
Point Clouds
|
Aligned Point Clouds
|
Mesh Reconstruction
|
Mesh
KINECT FUSION DEMO
- Scan Scene with Kinect Fusion, export
- Import Scene into Unity ( .obj )
Can also render vertex colors
with a custom shader
( .ply -> .dae -> unity )
FUSION RESULTS
KINECT MOTION CAPTURE
KINECT MOTION CAPTURE
Software Available
-
iPi Soft Motion Capture ( 300 - 600 USD )
- Brekel Motion Capture ( 100 USD )
MOTION CAPTURE DEMO
- iPi Soft Recorder
- iPi Soft Motion Capture Studio
- Import Animation into Unity
- Split into Clips in Unity
- Basic Animation Controller
MOTION CAPTURE RESULTS
Questions?
Thank you OKGD
Thank you Goldfire Studios
Contact Information
lucas@op-games.com
lucas@optml.io