1. Surface Computing Andy Lim, Derek O’Neill, Luke M

2. What is Surface Computing?  A specialized computing GUI  “Coffee Table”

3. Surface Computing in the Works  Microsoft Surface  Codename “Milan”  Use Cases  Photo sharing  Maps  Menus  Entertainment  Much more!

4. It is NOT just a Touch-Screen  Object Oriented  Multi-Touch Technology  Device Interaction

5. How does the Surface work? 1.Screen 2.Near IR light source 3.Near IR camera 4.Projector 5.PC 5

6. FTIR: The DIY version What if you don’t want it cost $10,000  Fourier Transform Infrared Spectroscopy  Embed IR LEDs in the plexiglass  Things touching the surface of the screen scatter IR light towards the camera below

7. What do we do with the picture?  No preprocessing done by camera  Raw data analyzed on PC and run through an edge- detection algorithm.  Number of simultaneous inputs is only limited by surface area and computing power

8. The Brains of the Surface  Core 2 Duo  2GB DDR2 RAM  250GB SATA Hard drive  ATI X1650 Video Card  Windows Vista  Optimized for 52 simultaneous inputs  4 people with all 10 fingers plus 12 objects

9. What’s on the Surface  Radio Signals  Visual Marking

10. Using the Cameras  Recognizing Shapes  Very Imprecise  Algorithms for edge detection are expensive  Developer must specify shapes in every program  Mitigated if surface tells users what to put where, and then expects them to be there later

11. Using the Cameras  Tagging  Series of reflective dots identify object and orientation  Fairly cheap to process patterns  Universal for the entire OS, no need to rewrite IDing code  Requires tags be physically added to objects to interact with surface  Uniquely tags objects with same shape

12. Radio Signals  RFID  Use RFID tags to transmit information about what’s on the surface  Lots of things already have RFIDs built in (credit cards, room keys)  Surface needs to know what the data being received means  RFIDs use backscattering, so the position of the object on the surface can’t be determined

13. Radio Signals  Bluetooth  Bidirectional: Surface and Device interact with each other  Relatively secure  Can use Encryptable  Devices Identify themselves  Universal among mobile devices  Limited to 7 devices connected  No way to figure out position on the surface

14. What’s on the Surface  Radio Signals  Visual Marking  Edge detection on Items is great for finding positions of anything, but not great for identifying them  Tagging requires an up front physical action, but results in an effective way to identify objects and where they sit  RFID is a cheap, common way to transmit small streams of data, but its unidirectional  Bluetooth allows bidirectional access, but it’s significantly more expensive  Neither allow for items to be positioned on the screen

15. What’s on the Surface Figuring out how to identify objects, grab their data, and correctly track the on the surface is a very difficult challenge in surface computing.  Make the user tell you what something is when they place it  Create a place for the user to put something and track it from there  Tag objects, identify them at runtime and then follow the tag rather than the object  Microsoft is currently working on technology to match RFID tags with physical objects based on when the tag is read and what’s placed on the surface

16. Resources  RFID Design  http://www.das-labor.org/trac/export/3038/rfid-hacking/doc/RFID-Coil- Design.pdf http://www.das-labor.org/trac/export/3038/rfid-hacking/doc/RFID-Coil- Design.pdf  http://consultingblogs.emc.com/richardwand/archive/2008/11/27/waiting-for- microsoft-surface-to-seamlessly-recognise-and-communicate-with-devices.aspx http://consultingblogs.emc.com/richardwand/archive/2008/11/27/waiting-for- microsoft-surface-to-seamlessly-recognise-and-communicate-with-devices.aspx  Tagging  http://msdn.microsoft.com/en-us/library/ee804823%28v=Surface.10%29.aspx http://msdn.microsoft.com/en-us/library/ee804823%28v=Surface.10%29.aspx  http://msdn.microsoft.com/en-us/library/ee804885%28v=Surface.10%29.aspx http://msdn.microsoft.com/en-us/library/ee804885%28v=Surface.10%29.aspx  http://msdn.microsoft.com/en-us/library/ee786833%28v=Surface.10%29.aspx http://msdn.microsoft.com/en-us/library/ee786833%28v=Surface.10%29.aspx  http://msdn.microsoft.com/en-us/library/ee804748%28v=Surface.10%29.aspx http://msdn.microsoft.com/en-us/library/ee804748%28v=Surface.10%29.aspx  Bluetooth  http://www.bluetooth.com/English/Technology/Pages/default.aspx http://www.bluetooth.com/English/Technology/Pages/default.aspx  http://www.sysopt.com/features/network/article.php/3532506 http://www.sysopt.com/features/network/article.php/3532506  Research  http://research.microsoft.com/en-us/um/people/merrie/surface_research.html http://research.microsoft.com/en-us/um/people/merrie/surface_research.html  Home of the Surface  http://www.microsoft.com/surface/en/us/default.aspx http://www.microsoft.com/surface/en/us/default.aspx