1. kinect-mssdk-openni-bridge Supplemental Diagrams Tomoto Shimizu Washio tomoto@gmail.com Twitter: @tomoto335e (en) / @tomoto335 (ja) Rev 1: 9/15/2012

2. SensorKinect Driver and K4W Driver cannot coexist Problem Image Node User Node OpenNI App Depth Node KinectSDK App Image UserID+ Skeleton Depth SensorKinect Driver Avin2’s SensorKinect NITE OpenNI FW K4W Driver Image Stream Depth Stream Skeleton Stream Image Depth Skeleton User ID Kinect SDK

3. Bridge alters SensorKinect by providing OpenNI-complient nodes that wrap Kinect SDK, so that OpenNI/KinectSDK apps can coexist Bridge Solution Image Node User Node OpenNI App Depth Node KinectSDK App Image UserID+ Skeleton Depth Bridge NITE OpenNI FW K4W Driver Image Stream Depth Stream Skeleton Stream Image Depth Skeleton User ID Kinect SDK User Node UserID+ Skeleton Kinect Studio.xed

4. Bridge Solution (cont.) App can apply NITE’s algorithms (e.g. User node) upon Bridge’s Depth node App can choose either User node of NITE’s or bridge’s ◦ User “query” on node creation ◦ Bridge’s User node works by itself but requires no depth node ◦ App can even use both at the same time if needed Compatible with recording/playback with Kinect Studio ◦ Because it is totally transparent under Kinect SDK

5. Recorder node can apply on bridges Depth and Image node ◦ So XED -> ONI conversion is possible ONI Recording Image Node User Node OpenNI App Depth Node UserID+ Skeleton Bridge NITE OpenNI FW K4W Driver Skeleton User ID Kinect SDK User Node UserID+ Skeleton Kinect Studio.xed Recorder Node Image Stream Depth Stream Skeleton Stream.oni Image Depth Image

6. Bridge does not do anything with ONI playback ◦ Kinect SDK’s skeleton tracking cannot be applied on ONI ONI Playback User Node OpenNI App Bridge NITE OpenNI FW User Node S S.oni Mocks Depth Node Image Node Depth Node Image Node D D I I K4W Driver Skeleton User ID Depth Image Kinect SDK Image Depth UserID+ Skeleton

7. Misc Audio node is supported ◦ Wrapping DMO Device node is supported ◦ App can choose one of multiple connected Kinect Sensors ◦ Kind of hack, not perfect at all Design policy ◦ Stay upon Kinect SDK as possible rather than working around it