2. What you need: In order to use these programs you need a program that sends out OSC messages in TUIO format. There are a few options in programs that send out OSC TUIO messages: CCV Reactivision TUIO simulator if you would like to test these programs quickly (without a multitouch screen).

3. How To Make a Multitouch Surface There are several ways to make a multitouch surface. There are capacitive, resistive, acoustic, and other non-traditional techniques. Our focus will be on optical techniques since they are the easiest and most cost effective for the average person to create. The most popular optical techniques are: Frustrated Total Internal Reflection (ie. Perceptive Pixels) Rear Diffused Illumination (ie. Microsoft Surface) Front Diffused Illumination (ie. MTmini, MTbiggie)MTminiMTbiggie Diffused Surface Illumination Laser Light Plane LED Light Plane Optical Multitouch Techniques Each technique utilizes 3 main components: 1.Infrared Camera (or other optical sensor) 2.Infrared light 3.Visual Feedback (projector or LCD)

5. An infrared camera is pointed at the touch surface and detects when fingers/objects touch the surface. Infrared light is used to distinguish between a visual image on the touch surface and the objects/fingers being tracked. Since most systems have a visual feedback system where an image from a projector or LCD is projected or placed below the touch surface (the MTmini does not), it is important that the camera does not see this image when tracking objects/fingers on the display. In order to separate the objects being tracked from the visual display, a camera can be modified to only see the infrared spectrum of light (by removing the infrared filter and replacing it with a visible light or bandpass filter); this cuts out the visual image from being seen by the camera and allows the camera to only see infrared light that illuminates the objects/fingers on the touch surface. The projector is connected to a computer in order to display the software on the touch surface. The camera is connected to a computer and a tracking application uses the camera image to track and create touch coordinates.

6. Source image – Displays the raw video image from either camera or video file. Use Camera Toggle – Sets the input source to camera and grabs frames from selected camera. Use Video Toggle – Sets the input source to video and grabs frames from video file. Previous Camera Button – Gets the previous camera device attached to computer if more than one is attached. Next Camera Button – Gets the next camera device attached to computer if more than one is attached. Tracked Image – Displays the final image after image filtering that is used for blob detection and tracking. (CCV) – Installation and Configuration

7. Software Main Finger Tracking Application – Software Setup Guide Software Setup Guide – Installation and Configuration Installation and Configuration – Calibration Calibration – Flash Application Setup Flash Application Setup Mouse Driver – for controlling your mouse cursor – Windows Mouse Driver Windows Mouse Driver – Mac, Linux, Windows Mouse Driver from TUIO.org Mac, Linux, Windows Mouse Driver Demos and Applications – Various multitouch applications – My Demo Applications My Demo Applications – More software, applications, demos on http://www.sparkon.nethttp://www.sparkon.net – MTmini video demo applications - via ccv.nuigroup.com downloads page MTmini video demo applications Resources Multitouch Terminology Multitouch Book (free PDF) My Personal Multitouch Surface Build NUIGroup (the best place for immediate help on hardware and software) NUIGroup (the best place for immediate help on hardware and software)

8. Software and Demo Downloads Main Finger Tracking Application – needed to track fingers on the MTmini Community Core Vision (CCV) – Windows, Mac, Linux tracking application. Community Core Vision (CCV) – Windows, Mac, Linux tracking application. Mouse Driver – for controlling your mouse cursor Windows Mouse Driver Windows 7 multitouch driver (Multitouch Vista) Mac, Linux, Windows Mouse Driver from TUIO.org Mac, Linux, Windows Mouse Driver Demos and Applications – Various applications that can be used with the MTmini Demo pack applications (fire, physics, ripples, multikey, and more) - via ccv.nuigroup.com downloads page Demo pack applications (fire, physics, ripples, multikey, and more) My Demo Applications Angry Birds (seen in the video) uses one of the mouse drivers above Angry Birds More software, applications, demos on http://www.sparkon.nethttp://www.sparkon.net

9. Inverse – Track black blobs instead white blobs. Threshold Slider – Adjusts the level of acceptable tracked pixels. The higher the option is, the bigger the blobs have to be converted in tracked blobs. Movement filtering – Adjust the level of acceptable distance (in pixels) before a movement of a blob is detected. The higher the option is, the more you have to actually move your finger for CCV to register a blob movement. Min Blob Size – Adjust the level of acceptable minimum blob size. The higher the option is, the bigger a blob has to be to be assigned an ID. Max Blob Size – Adjust the level of acceptable maximum blob size. The higher the option is, the bigger a blob can be before losing its ID. Remove Background Button – Captures the current source image frame and uses it as the static background image to be subtracted from the current active frame. Press this button to recapture a static background image

10. Dynamic Subtract Toggle – Dynamically adjusts the background image. Turn this on if the environmental lighting changes often or false blobs keep appearing due to environmental changes. The slider will determine how fast the background will be learned. Smooth Slider – Smoothes the image and filters out noise (random specs) from the image. Highpass Blur Slider – Removes the blurry parts of the image and leaves the sharper brighter parts. Highpass Noise – Filters out the noise (random specs) from the image after applying Highpass Blur. Amplify Slider – Brightens weak pixels. If blobs are weak, this can be used to make them stronger. On/Off Toggle – Used on each filters, this is used to turn each filter on or off.

11. Camera Settings Button – Opens a camera settings box. This will open more specific controls of the camera, especially when using a PS3 Eye camera. Flip Vertical Toggle – Flips the source image vertically. Flip Horizontal Toggle – Flips the source image horizontally. GPU Mode Toggle – Turns on hardware acceleration and uses the GPU. This is best used on newer graphics cards only. Note: GPU mode is still in early development and may not work on all machines. Send UDP Toggle – Turns on the sending of TUIO messages. Flash XML – Turns on the sending of Flash XML messages (no need for flosc anymore).

12. Binary TCP – Turns on the sending of RAW messages (x,y coordinates). Enter Calibration – Loads the calibration screen. Save Settings – Saves all the current settings into the XML settings file.