1. Visualization Technology Basic Masaki Hayashi Nov.12, 2013 Visualization of 3D CG

2. Lecture assigning I will focus on the technical aspect of visualization. What, how and why is visualization?  Steven Bachelder 3D CG basic and a tool usage  Jonatan Österberg Technical issue of visualization  Masaki Hayashi

3. Today’s lecture Overview of visualization method Key issue of 3DCG visualization Available technologies of visualization Some show cases (I will introduce the principles behind the technologies as much as possible)

4. Principle behind the technology It is important to know the technical issue even if you are not a technical person. TOOL Input Output So that you can use the tool efficiently. Not to be cheated by a technician. eg. Photoshop

5. Visualization Very wide meaning Creative visualization Flow visualization Geovisualization Illustration Information graphics visual representations of information Information visualization Interactive visualization Music visualization Scientific visualization Software visualization Visualization (computer graphics)

6. Visualization with 3DCG To make a model  Using CG tool (by Jonatan) To digitize a real thing  Digitization technique (by me)

7. 1 Acquisition Storage & Network & Computer User interface 2 Representation 3 Dissemination Digitization, modeling Display, Web Three phases of visualization

8. Acquisition Filming  Photograph Laser scanning  Measurement by laser beam Photogrammetry  Reconstruct geometry from multiple pictures

9. Filming Digital camera Resolution, White balance, Focal length, RAW data, Lighting Image scanner Resolution, Color depth Panoramic image

10. Laser scanning Range: Small object, statue, ruin to city landscape + Aerial Output: 3D point cloud x, y, z, + (i, r, g, b) Multiple measurements: Compensation of the shadow IMView ILRIS Intelligent Laser Ranging and Imaging Systems 3m – 1000m (Optech) Peru (landscape), Hampson museum (artifact) Minolta-Konica Vivid 9i Example: ScanView (CMU)

11. Photogrammetry Digital camera Multiple filming and software reconstruction Range: Same as scanner Output: 3D point cloud + color x, y, z, r, g, b Compensation of shadow Example: PhotoScan (Agisoft) Acute3D

12. Representation Device: PC Monitor Screen projection Head-mounted display Images: 2D picture 2D panoramic image 3D CG

13. Virtual Museum Real space Immersive VR Big display AR Web service Floor map navigation Panorama walkthrough Art work viewing 3DCG walkthrough

14. Immersive display HMD (Head Mounted Display) Classic Latest

15. Immersive display CAVE (Cave Automatic Virtual Environment) Comes with head tracking, stereoscopy, wand, multiple loudspeakers

16. Immersive display ImmersaDesk Comes with head tracking, stereoscopy, wand, stereo sound

17. Big display 4K / 8K 4K LCD Monitor (Astrodesign) 60-inch 8K PDP Monitor (Panasonic) 145-inch 8K projector (NHK)

18. Big display Multi-display Curved screen with 3 projectors (22m x 6m) (Toppan)

19. Big display Cleveland Museum (12m x 1.5m) 23 times HDTV with touch panel Multi-display

20. AR ( Augmented Reality ) AR information service Google glass Real image + CG

21. AR ( Augmented Reality ) A board with marker Real image + CG CG is composited in real-time

22. Panoramic display Google Art Project PERISCOPE ( DNP ) Panoramic movie

23. Web service 360-degree image, floor plan navigation, information display Louvre Virtual Tours http://musee.louvre.fr/visite-louvre/index.html?defaultView=rdc.s46.p01&lang=ENG

24. Web service Panorama view, view point transition, information display Smithsonian National Museum of Natural History http://www.mnh.si.edu/vtp/1-desktop/

25. Web service Google Art Project Panorama view + view point transition (same technique used in Street View) http://www.google.com/culturalinstitute/collection/van-gogh-museum?projectId=art-project&source=maps.sv

26. Web service Google Art Project Detail observation mode + related information

27. Web service 3DCG walkthrough GRAPHTWERK http://3dstellwerk.com/en/ ( UNITY based 3D walkthrough )

28. Web service http://www.3dancientwonders.com/index.php 3D Ancient Wonders (Shockwave Player, UNITY ) 3DCG walkthrough

29. Web service http://hampson.cast.uark.edu/ The Virtual Hampson Museum( VRML, PDF, OBJ data ) 3DCG object handing

30. Dissemination There is not so many technical issue Rather cultural issue Devices for users:  PC, Tablet, Smartphone, etc. Ways of reaching:  Web, Internet, Mobile, etc. User interactions:  Keyboard, Touch screen, Voice control, Haptic device, etc.

31. Dissemination Some keywords Links Tagging Rating (likes) Keyword searching Personalization Community SNS Example of social tagging (from Steve Project)

32. Dissemination http://www.getty.edu/mygetty/ The J. paul Getty Museum “My Getty” Bookmarks Examples of virtual museum http://www.culture.gouv.fr/document ation/joconde/fr/ Joconde Portal collections of museums in France 500,000 objects Artefacts Canada 3,000,000 objects http://www.pro.rcip- chin.gc.ca/artefact/index-eng.jsp http://tagger.steve.museum/ Steve Project “Steve tagger” social tagging