1. The Challenge of 3 Dimensional Data - Storage, Preservation, Description, and Access Dr. Jeremy Rowe Head, Media Development, Information Technology Partnership for Research in Stereo Modeling Arizona State University Joint Conference on Digital Libraries, Portland, Oregon, July 15, 2002

2. Partnership for Research In Stereo Modeling (PRISM) Established in Spring 1996 at Arizona State University to promote interdisciplinary research in 3D Data Acquisition, Visualization & Modeling, and Form Realization. PRISM includes researchers with a shared interest in visualizing 3D and higher dimensional data. Disciplines include: Anthropology Archaeology Biology Computer Science Educational Technology Fine Arts Industrial Engineering Mechanical Engineering

3. Data Acquisition Cyberware Laser Scanner Also: -Portable Laser Scanners -Confocal Microscope -CAT Scanner -Other Method of 3D Point Cloud Capture

4. Laser Scanning to Create Point Cloud Single Scan Multiple Scans Combine to Create Point Cloud Representing the Original Object

5. Point CloudTriangular Mesh Surface Surface Generation from Point Cloud Assemble Point Cloud from Multiple Scans (Geomagic)

6. 3D Imaging - Moving Beyond Viewable Images Extending research capabilities beyond Image-Only 3D display such as QuickTime VR, Rhino, & Maya. Funding - National Science Foundation Digital Library/Knowledge and Distributed Intelligence Goals to work with Domain Researchers to Develop Processes to: Create A Quantifiable, Measurable Model Identify and Extract Data Create Catalog Information Populated Database

7. Surface Modeling Fitting a Modeled, Measurable Surface

8. Spatial Measures of Similarity Graphically illustrate symmetry And changes in curvature Goal - to provide objective measures of objects and component features Profile Curves Also: Local Curvature Inflection Points Area Volume Proximity Orientation Etc.

9. Range of Projects DNA in Fertilized Mouse Egg  Through the Cell Biology Pilot project, we applied computer algorithms that enabled us to obtain more information from confocal microscope images.

10. Range of Projects Native American Ceramic Vessels  Digital collections to analyze shape, morphology, manufacturing techniques, improve measurement accuracy, permit objective comparison of objects, document before repatriation.

11. Bone Surfaces and Forensics  Digital collections to analyze shape, structure, morphology, improve measurement accuracy, permit objective comparison of objects, and to identify unique individuals. Range of Projects

12. Region Identification Morphology/Symmetry Object Identification Feature Extraction

13. Project Process Summary Development of vocabulary Development of XML schema and DTDs Capture/digitization Modeling and data extraction Volume modeling research Modeling software development Data extraction Data storage Text and tabular data Binary geometric/spatial data Point cloud data Polygonal mesh Surface/volume models Links to other databases Query and interaction

14. Vocabulary

15. 3D Class Inheritance Class:Object ::Vessel ::Jar Plus... Axis base plane Diameter circumference Attributes… Shape representation model # features ::Surface model Plus... volume surface area Plus... Shoulder height aperture diameter Each subclass definition inherits generic attributes from its parent class and qualifies them or adds new ones

16. Addition of 3D Data to Relational Databases Conventional Relational Database Tables Tables added to accommodate 3D Metadata

17. RDBMS (Oracle, SQL Server, etc) Attribute Tables 3D Indexes Existing Data Access Protocols (ODBC, JDBC,XML) 3D Query Processor Custom 3D Data objects (Surfaces, Volumes) Database organization User Interface applications (Java, Visual Basic, C++) Text search Spatial Search

18. Query and Interaction Creating a Digital Library On Submit Query Binary and Text search criteria sent from interface 1 st CGI Generate the contour type and parameterize the text query 2 nd CGI Curve matching Database 1 st Record set Pot ids of same contour 1 st JSP Query sent to Databases 2 nd JSP Query database 2 nd Record set XML document XSL/HTML display Initial query interface Query result with thumbnails Detail display of individual pot X-Path/ display the selected pot

20. Examples of Current 3D Data Applications Environmental data GIS Air Quality Water Quality Built Environment Building Design (CAD/Architecture modeling) Building Documentation Ground Penetrating Radar Manufactured Objects Design/Production/Quality Control Catalog/Sale Medical CAT scans Ultrasound

21. Data Components Raw Data Textual 2D Image/surface 3D Spatial N-Dimensional Time Sensor data Derived Data Modeled Data Technical Data File Formats Applications Researcher Annotations (to permit reconstruction) “Bookmark” Information Documenting Searches/Interaction

22. Metadata Traditional textual info (Dublin Core, COPARES, etc.) Non-static information (audio, video, etc.) 2D data (from new and existing sources) 3D data (point cloud and modeled) Multi-dimensional data (i.e. vector, sensor, time, etc.)

23. Class based XML Schema *

24. *

25. *

27. Other Issues Increasingly complex multi-dimensional data Development of standards File/storage formats Metadata/Cataloging/Description Researcher notations/version documentation “Bookmarking”/replicability of search results XML/SOAP search to replace/augment SQL search Migration Electronic records management of “Born Digital” data

28. 3DK Project Team Priti AggarwalMyungsoo Bae Michael BaileyD. Page Baluch David CapcoDaniel Collins Gerald FarinPatricia Green Mark HendersonJiu Xiang Hu Adam HuangGraham Jones Raghu KrovvidiDezhi Liu Mary MarzskePeter McCartney Pornchai Mongkolnam Greg Nielson S. PanchanathanSandeep Pulla B. RamakrishnaAnshuman Razdan Jeremy RoweUtsav Schurmans Arleyn SimonMatt Tocheri David Van Alfen May Zsu

29. Contact Information Partnership for Research in Stereo Modeling (PRISM) at Arizona State University http://3dk.asu.edu Dr. Jeremy Rowe jeremy.rowe@asu.edu