Kinect A good starting point is: http://shiffman.net/p5/kinect/ SimpleOpenNI is the way to go for skeleton and gesture tracking.