The Build-It Story Prof. dr. Matthias Rauterberg Faculty Industrial Design TU/e Eindhoven University of Technology

© M. Rauterberg, TU/e The Digital Desk from Pierre Wellner in 1991 Pierre Wellner The DigitalDesk is built around an ordinary physical desk and can be used as such, but it has extra capabilities. A video camera is mounted above the desk, pointing down at the work surface. This camera's output is fed through a system that can detect where the user is pointing (using an LED-tipped pen) and it can recognise the documents that are placed on it. The more advanced version also has a computer-driven projector mounted above the desk enabling electronic objects to be projected onto real paper documents -- removing the burden of having to switch attention between screen and paper and allowing additional user-interaction techniques. [invented and built by Pierre Wellner, Xerox EuroPARC] Video clip

© M. Rauterberg, TU/e Perception Space –The physical space where the user’s attention is. Action Space –The physical space where the user acts in. Design Principle: –perception space and action space must coincide! What is design relevant knowledge?

© M. Rauterberg, TU/e Airline Applications This remarkable ultra-lightweight computer, worn as a belt, delivers maximum information to users with a minimum of work. Designed for individuals who demand mobility, this computer offers voice control and heads up display for complete, hands-free operation. Users can enter or retrieve information while going about their jobs, instead of constantly returning to the shop area to check a stationary computer, or stopping work to punch keys.

© M. Rauterberg, TU/e Head-up Displays in Cars More information and less distraction Information on the state of the road, on the speed of the vehicle in front (supplied by the intelligent cruise control), on obstacles lying around the next bend in the road identified by the remote detection system, or direction arrows sent by the driver guidance system... drivers will be receiving more and more information from "intelligent" vehicle systems.

© M. Rauterberg, TU/e Natural User Interfaces (NUI) No technical equipment inside the body space of the user! 2. design requirement Perception space and action space must coincide! 1. design requirement

© M. Rauterberg, TU/e NUI: The First Round Design principle Field test Digital Playing Desk

© M. Rauterberg, TU/e Command Interface (CI) Video clip

© M. Rauterberg, TU/e Mouse Interface (MI) Video clip

© M. Rauterberg, TU/e Touch-screen Interface (TI) Video clip

© M. Rauterberg, TU/e Digital Playing Desk (DPD) Video clip

© M. Rauterberg, TU/e User Studies with the DPD Video clip

© M. Rauterberg, TU/e Empirical Results: Playing time per game

© M. Rauterberg, TU/e computer win remis user win Cell Line Chart for "winning chance" Grouping Variable(s): Interface type Error Bars: ± 1 Standard Deviation(s) CIMITIDPD P<.001P<.080P<.020 P<.802 P<.001 P<.007 Empirical Results : winning chance per dialog technique

© M. Rauterberg, TU/e GUI versus NUI interaction models model controlview INPUTOUTPUT physical digital model control Non graspable representation graspable representation INPUT / OUTPUT

© M. Rauterberg, TU/e NUI: The Second Round Experiments Build-It systems Design principle

© M. Rauterberg, TU/e The Build-It System from M. Bichsel, M. Fjeld & M. Rauterberg 1997 Video clip

© M. Rauterberg, TU/e 18th Century: tool production The Build-It Tools

© M. Rauterberg, TU/e Past and Future Developments Patent pending Spin-off company TELLWARE founded in October 1997 First brick-based planning systems on the market since 1998 Winner of the Swiss Technology Award 1998 CeBIT ‘98