An automated input peripheral multiplexor for computing systems Jon Bright Dan Quintas Matt Spencer Steven Shropshire ECE 4007 Section L03 Project Advisor - David Anderson April 27, 2010

 What – Automatically switches keyboard, mouse between computers  Why – Eliminates redundancy; alleviates clutter; improves ergonomics/productivity

 How – Processes digital video stream to determine user’s orientation  Who – Consumers with multiple computers; industries with complex workspaces  Cost – Smart Switch prototype: $81,885

Proposed GoalActual Outcome Switch two computersMet Platform independentMet Demonstrate on two peopleMet Operable for range of lighting conditionsMet Allows head movementMet Real time; Maximum delay of 600msNot Met

Swann Infra-Red Camera TMS320DM6437 Video Processing Board Belkin KVM Switch Input: keyboard, mouse Output: computers Instruction signal Video Feed

Video In Optional Video Out Power K/M Out K/M In DSP Board KVM Switch

Front : PS/2 Keyboard and Mouse In Back : PS/2 Keyboard and Mouse Out to PCs

 Digital image processing algorithm  Video processing board  Processes video in real time  Determine computer head faces  Output active computer

Camera generates video feed KVM Switch routes keyboard, mouse Algorithm determines active computer User faces the monitor Active computer Input from keyboard and mouse Inactive computer

Needs 1. Detect face 2. Determine direction 3. Work in real time

 Proposed by Paul Viola and Michael Jones  Compare adjacent rectangles to learn patterns  FFD uses a graphical representation

Wait for Frame Get Frame, Run FFD Algorithm Do nothing Right/Left Count++ Switch Yes Do Nothing Center Count > N? Error

 N based on duration of algorithm ◦ 70ms a frame  Probability of error ◦ 1 st error 1/10 ◦ 2 nd error 1/15  For N = 5, probability of incorrect switch insignificant.

 1. Detect face? YES!  2. Determine direction? YES!  3.Works in real time? YES! ◦ 70ms per frame ◦ 8.5 frames in 600ms ◦ N = 5

 Actual algorithm -13ms out of 70ms  Room for ◦ Robustness ◦ Up/down ◦ 3 screen positions  Double the size -> 83ms, 7 frames in 600ms

 Switch two computers – KVM Switch  Platform Independent – No Software Installation  Demonstrate on two people – Steven and Dan  Range of lighting conditions – Van Leer classrooms  Head Movement – Algorithm  Real Time – Not met due to KVM Latency

 Underestimated KVM latency  Roughly 1-second delay  USB vs. PS/2 interface  Build KM Switch  All other components real time

 High – Low Instruction Signal  Output Options ◦ Serial Port ◦ JTAG ◦ Audio Out ◦ Expansion Connector  Selected Expansion Connector Option

 Left computer unresponsive to mouse  Possible loose wire connections  KVM failure

HOURS / EngineerCOST EQUIPMENT DSP Board $495 KVM Switch $100 Camera $250 Power Supply $20 Cabling $20 LABOR Algorithm Design 250$30,000 Algorithm Implementation 150$18,000 KVM Firmware Design 200$24,000 Package Assembly 75$9,000 TOTAL EQUIPMENT $885 TOTAL LABOR (x 4 Engineers) 675$81,000 ADVERTISING AND MARKETING $30,000 SMART SWITCH TOTAL $111,885

 Faster KVM/KM Switch  Improve algorithm  System configurability  Smaller form factor  Upgrade to USB interfaces