Multitouch Game Table Senior Design Fall 2006 What we did right and what we did wrong… Aditya Mittal James Wallace Albert You Paul Ferrara

Recap of What we are doing We are building a touch screen game table We are building a touch screen game table Last semester we developed 3 small prototypes of a touch screen Last semester we developed 3 small prototypes of a touch screen The touch screens were created by using infrared LED’s shining into an acrylic sheet and detecting them with a webcam covered with camera film to act as an infrared camera The touch screens were created by using infrared LED’s shining into an acrylic sheet and detecting them with a webcam covered with camera film to act as an infrared camera

Prototype 1 The wooden frame was not sturdy, this led to poor internal reflection of the infrared wavelengths in the acrylic The wooden frame was not sturdy, this led to poor internal reflection of the infrared wavelengths in the acrylic Immediately we proceeded to the construction of prototype 2 Immediately we proceeded to the construction of prototype 2

Prototype 2 The soldering job on the LED’s was poor and the spacing between them was bad The soldering job on the LED’s was poor and the spacing between them was bad There were simply not enough LED’s installed into the frame leading to poor contrast and lots of random IR detections artifacts in places where no touches were made There were simply not enough LED’s installed into the frame leading to poor contrast and lots of random IR detections artifacts in places where no touches were made

Prototype 3 The best of the 3 prototypes with a sturdy wooden frame, the LED’s spaced out evenly and enough of them to give good contrast and detect finger(s) The best of the 3 prototypes with a sturdy wooden frame, the LED’s spaced out evenly and enough of them to give good contrast and detect finger(s) The problem with this prototype was that it still included additional noisy infrared detections along the side of the frame, coming from the LED’s sticking too far in and not being covered by the wooden frame The problem with this prototype was that it still included additional noisy infrared detections along the side of the frame, coming from the LED’s sticking too far in and not being covered by the wooden frame It was however good enough to help us lead into the production of a full size touchscreen It was however good enough to help us lead into the production of a full size touchscreen

The Driver A basic driver was formulated for testing the prototype touch screen A basic driver was formulated for testing the prototype touch screen This driver used direct show filtering to detect basic motions of the areas of the screen being touched and display them as rectangles on the screen This driver used direct show filtering to detect basic motions of the areas of the screen being touched and display them as rectangles on the screen No processing based upon these detected areas was done yet No processing based upon these detected areas was done yet

The Driver (cont.) The current driver is very inefficient and uses up unnecessary CPU power The current driver is very inefficient and uses up unnecessary CPU power The current driver did not include erosion filtering which reduces the noisy image generated by the webcam which results in artifacts where there is no motion made The current driver did not include erosion filtering which reduces the noisy image generated by the webcam which results in artifacts where there is no motion made

Final Comments We are currently optimizing the driver We are currently optimizing the driver Working on hand gesture algorithms Working on hand gesture algorithms Mirrors and Lens reflection calculations for proper rear view projection from the projector Mirrors and Lens reflection calculations for proper rear view projection from the projector We need to line up the back of the acrylic with tracing paper for projecting onto the surface so the projector image does not shine into the eye We need to line up the back of the acrylic with tracing paper for projecting onto the surface so the projector image does not shine into the eye

Thank you Multitouch Gameboard Team Multitouch Gameboard Team