Focus plus context screens Patrick Baudisch

Hardware –At least one hi-res display –At least one larger low-res display Software –scaling of the display content is preserved –resolution varies

Focus plus context screens What it is How it works –How to build one –Application scenarios (video) –The software Evaluation –What we learned from practitioners (field study) –How much faster, how much more accurate (lab experiment) Conclusions

How to build it?

Setup

Seamless integration of displays a b

Context No reflections on focus screen Focus

Application scenarios

How does it work?

The scaling software Display image on two display units of different resolution –Similar to two-headed display –but display units are overlapping –and one of them has to be scaled down (Related work “Flux capacitor” [Dr. Emmett Brown, 1985])

Linux/VNC app focus context input server clip scale viewer

Image viewer context Photo shop scale ACDsee.gif mouse fork input focus

Evaluation

Field study Who are the potential users? Do they lack display space? What do they currently use? What tasks should we simulate?

Field study Subject’s taskDocument/view Static documents Web designerPage: 800 pixel Mechanical engineerPolybot segment: 5cm Graphic designerPoster: 1m Architect in remodelingBuilding: 50m Photogrammetry (2)Highway 2 miles Geographic info. systemCounty: 80km Chip designers (2)Wafer: 12cm Dynamic Air traffic ctrl. tool builderZone: 50km Ego shooter gamerSurrounding: 360º Submarine ROV op.Surrounding: 360º Strategy gamers (2)Map: 30k pixel Smallest object Text: 10 pixel Pin: 1mm Text: 1cm Wall: 10cm Curb: 6 inches Trees: 5m Conductive path: 3  m Airplane: 50m Distant opponent: 1º Small fish: 1cm/0.5º Missile: 3 pixel Smallest detailRatio Table detail: 1 pixel800 Clearance: 0.03mm2,000 Align: 0.5mm2,000 Accuracy: 1cm5,000 Accuracy: 1 inch100,000 Land boundaries: 0.5m160,000 Grid: 0.5  m 240,000 Plane distance in 25m steps2,000 Aiming: 0.1º3,000 Use arms: 1mm/0.05º8,000 Aiming: 1 pixel30,000           ? 

focus plus context screen Visualization Same # of pixels fisheye 5 5 overview plus detail 4 4 Display technology homogeneous resolution 4 4 wall-size, hi-res display 4 4 What participants used Available to ½ of participants

Lab experiment how much faster? how much more accurate? how much more satisfying?

Experiment 1: “static documents” 3 interfaces: –focus plus context screen –overview + detail –homogeneous 2 tasks 12 subjects from Xerox PARC Within subjects, counter-balanced Same number of pixels

Task 1: Closest hotel 8 maps per interface F+C screen and O+D use same magnification factor

Task 2: Verify connections Verify a different set of 24 connections on the board

Results Map taskBoard task z+p (N=12) (236.6)568.3 (187.1) f+c (N=12) (176.4)378.8 (71.2) o+d (N=12) (199.9)593.5 (232.0) Average task completion times in seconds (standard dev.) 21% faster 36% faster manually zooming takes time visually switching between views is ok but reorientation takes time visually more ambiguous

Experiment 2: Driving simulation 120 sec sequence 100 fields of nails; 30 rocks; tradeoff

Results o+df+c Run-over nails20.9 (10.3)9.5 (4.1) Rocks hit6.6 (3.1)1.9 (1.9) Mean number of collisions subjects caused in the car task (and standard deviation). Error rate only 1/3 of two- monitor setup Subjects preferred the f+c interface

What we learned We thought: Chip designers need it We learned: Real strength is dynamic content –Have unexpected context information –Two monitoring tasks at the same time

If I had to commercialize today… Build all-analog immersive video link –Immersive telepresence, –Remote operated vehicles, drones –Immersive VR –Remote medicine

Publications on f+c screens [Baudisch, Good, & Stewart, 2001, UIST] [Baudisch, Good, Bellotti, & Schraedley, 2002, CHI] [Baudisch & Good, 2002, CHI extended abstracts] [Baudisch & Good, 2002, CHI video proceedings] [Baudisch & Good, 2002, SIGGRAPH Emerging Tech.] [Bhattacharjee, March 14, 2002, New York Times]

Future work: ContextWall

Thanks to: Michael Brueckner & Nathaniel Good Paul Stewart, Victoria Bellotti, Pam Schraedley Mark Stefik, Dale McDonald, Rich Gold, RED Sacramento Department of Transportation, Monterey Bay Aquarium, NASA Our subjects Many people at PARC

END

Extra slides

Research in user interfaces  dynamic information filtering (Ph.D. thesis)  paintable interfaces……………………………………  TV program recommender system TV Scout……….  user-configurable advertising banners  drag-and-pop………………………………………….  focus plus context screens…………………………..  peripheral awareness on handhelds  automatic text reduction  3D alignment tool ‘the CAGE’………………………..  virtual TV studio and virtual actors  “four pointer” antialiasing method (Masters)

Research in user interfaces  dynamic information filtering (Ph.D. thesis)  paintable interfaces……………………………………  TV program recommender system TV Scout……….  user-configurable advertising banners  drag-and-pop………………………………………….  focus plus context screens………………………..  peripheral awareness on handhelds  automatic text reduction  3D alignment tool ‘the CAGE’………………………..  virtual TV studio and virtual actors  “four pointer” antialiasing method (Masters)

Further reading on f+c screens [1]P. Baudisch, N. Good, and P. Stewart. Focus Plus Context Screens: Combining Display Technology with Visualization Techniques. In Proceedings of UIST ‘01, Orlando, FL, November 2001, pp [2]P. Baudisch, N. Good, V. Bellotti, and P. Schraedley. Keeping Things in Context: A Comparative Evaluation of Focus Plus Context Screens, Overviews, and Zooming. To appear in Proceedings of CHI 2002, Minneapolis, MN, April [3]P. Baudisch and N. Good. Focus Plus Context Screens: Displays for Users Working with Large Visual Documents. In CHI 2002 Extended Abstracts (Demo paper), Minneapolis, MN, April [4]P. Baudisch. Focus Plus Context Screens. In CHI 2002 Video Summaries, Minneapolis, MN, April [5]P. Baudisch and N. Good. Focus Plus Context Screens: Visual Context and Immersion on the Desktop. To appear at SIGGRAPH 2002 (Demo paper), San Antonio, TX, July [6]Y. Bhattacharjee. In a Seamless Image, the Great and Small. In The New York Times, Thursday, March 14, [7] Baudisch, Good, & Stewart, 2001, 4 patents pending