KINECT 101



Lucas Ellis
Lead Programmer
opGames Inc.

www.op-games.com


Kinect for Windows v2 Disclaimer
This is based on preliminary software and/or hardware, and is subject to change.

ABOUT


Founder opGames Inc.

Beakiez Bubble Pop
www.beakiez.com

Beak Animation System 
(HLSL / FBX)

opC++ Compiler
www.opcpp.com

opGAMES NEWS



Upcoming
Beakiez on Steam Greenlight
New Site Launch


Sign up for Beakiez News
www.facebook.com/beakiez


KINECT 101



  • How does it work?
  • For Game Control?
  • For 3D Scanning?
  • For Motion Capture?

POPULAR KINECT GAMES




  • Dance games (Dance Central)
  • Sports games (bowling, tennis)
  • Fitness games (Nike+ Fitness)


NUI ?


Natural User Interface

OpenNI

Other Interesting Natural Interfaces:
  • Rocksmith

CAN NUI GAmes IMPROVE LIFE?


(mini TED talk)

  • Improved Movement?
  • Body / Eye Coordination
  • Personal Trainer? ¬†Yoga?
  • Fit = Video Gamer?

Personal Story
  • 80/20 Paleo, Nike+ Kinect Game = -30 lbs




HOW DOES KINECT WORK?

HOW DOES KINECT 1 WORK?




  • Infrared Scatter Pattern / Structured Light
  • Horizontal difference gives depth (expected vs actual)
  • Gets R G B + Depth from Camera + IR pattern
  • 640 x 480 depth resolution, effectively half that


HOW DOES KINECT 2 WORK?



  • Time of Flight Infrared
  • 524 x 420 depth resolution
  • Almost every IR depth pixel is valid!
  • "Infrared Radar"



Gamasutra Article on Kinect 1 & 2




ABOUT KINECT SDK

FREE JOINTS

Kinect SDK gives you <x,y,z> for each joint



KINECT BASICS DEMO


Kinect 1 Skeleton

Kinect 1 Depth

VS

Kinect 2 Depth




KINECT CONTROL IN GAMES

DEVELOPING WITH KINECT


Kinect 1

No XNA Access for Indies
But, can use with Windows, Unity.
Good for Installations

Kinect 2

ID@Xbox Program for Indies
Kinect for Windows v2

KINECT CONTROL IN GAMES


Robot Motion Tracking Demo
@ Science Museum Oklahoma 2013

  • Unity
  • ZigFu ZDK Plugin
  • .NET 2.0 Serial Interface
  • Arduino Unos

MOTION CAPTURE ROBOT DEMO






KINECT 3d SCANNING

POINT CLOUDS


Basic Primitive for all 3D Scanning

Software
  • Cloud Compare
  • MeshLab

KINECT 3d SCANNING



Point Clouds
|
Aligned Point Clouds
|
Mesh Reconstruction
|
Mesh

KINECT FUSION DEMO




  1. Scan Scene with Kinect Fusion, export
  2. Import Scene into Unity ( .obj )


Can also render vertex colors
with a custom shader
( .ply -> .dae -> unity )

FUSION RESULTS




KINECT MOTION CAPTURE

KINECT MOTION CAPTURE


Software Available

  • iPi Soft Motion Capture ( 300 - 600 USD )
  • Brekel Motion Capture ( 100 USD )


Portions of Halo 4 Captured with these tools
FXGuide Article


    MOTION CAPTURE DEMO



    1. iPi Soft Recorder
    2. iPi Soft Motion Capture Studio
    3. Import Animation into Unity
    4. Split into Clips in Unity
    5. Basic Animation Controller

    MOTION CAPTURE RESULTS

    Questions?


    Thanks to OKGD
    www.okgd.org

    Thanks to Goldfire Studios
    www.goldfirestudios.com


    Contact Information
    plus.google.com/+LucasEllis
    lucas@op-games.com