Digital Antiquity Data Integration with tDAR The Digital Archaeological Record: The potentials of archaeozoological data integration through tDAR Katherine.

Slides:



Advertisements
Similar presentations
ESDS Qualidata Libby Bishop, ESDS Qualidata Economic and Social Data Service UK Data Archive ESDS Awareness Day Friday 5 December 2003Royal Statistical.
Advertisements

TUTORIAL Version beta 3.0b Start Table of Contents Getting Started…………………………. Getting Started Search…………………………………… …. Search Creating New Resources…………….
Access 2007 ® Use Databases How can Microsoft Access 2007 help you structure your database?
The Process of Data Ingestion in ÆKOS Andrew Graham and Matt Schneider TERN Ecoinformatics Data Analysts Logos used with consent. Content of this presentation.
An introduction to collections and collection-level description Collection-Level Description & NOF-digitise projects NOF-digitise programme seminar, London,
Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.
Archaeoinformatics.org Andrew W. Mellon Foundation Archaeology All-Projects Meeting New York - March 5-6, 2008, Arizona State University The Pennsylvania.
Digital Antiquity Envisioning the Digital Archaeological Record Keith Kintigh School of Human Evolution & Social Change Arizona State University CAA 2009.
VegBank.org: a Permanent, Open-Access Archive for Vegetation Plot Data. Michael T. Lee 1, Michael D. Jennings 2, Robert K. Peet 1. Interacting with the.
Discove r Humanities and Social Science Electronic Thesaurus - HASSET Faceted search HASSET is the subject thesaurus that the UK Data Service uses to index.
Object Re-Use and Exchange Mellon Retreat, Nassau Inn, Princeton, NJ, March Herbert Van de Sompel, Carl Lagoze The OAI Object Re-Use & Exchange.
ICS 421 Spring 2010 Data Warehousing (1) Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 3/18/20101Lipyeow.
Building a Digital Library with Fedora International Conference on Developing Digital Institutional Repositories Hong Kong December 9, 2004.
The MetaDater Model and the formation of a GRID for the support of social research John Kallas Greek Social Data Bank National Center for Social Research.
1 Data & Database Development. 2 Data File Bit Byte Field Record File Database Entity Attribute Key field Key file management concepts include:
Living in a Digital World Discovering Computers 2010.
Working Together Revisited: Diverse Skills for Sustainability Robert P. Spindler Arizona State University December 5 th, 2006.
FGDC, Meet the DDI Adding Geospatial Metadata to a Numeric Data Catalog Julie Linden Yale University.
Data Management: Documentation & Metadata Types of Documentation.
Metadata: Its Functions in Knowledge Representation for Digital Collections 1 Summary.
The Data Attribution Abdul Saboor PhD Research Student Model Base Development and Software Quality Assurance Research Group Freie.
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
Module 4: Systems Development Chapter 13: Investigation and Analysis.
Managing the Record of Research At the Smithsonian Using SIdora SAA Research Forum August 12, 2014.
Objectives Overview Define the term, database, and explain how a database interacts with data and information Define the term, data integrity, and describe.
Introduction to OBIS-USA Biological Data, Applications, & Relationships March 14, 2011.
Chapter 6: Foundations of Business Intelligence - Databases and Information Management Dr. Andrew P. Ciganek, Ph.D.
Chapter 9 Designing Databases Modern Systems Analysis and Design Sixth Edition Jeffrey A. Hoffer Joey F. George Joseph S. Valacich.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Using IPUMS.org Katie Genadek Minnesota Population Center University of Minnesota The IPUMS projects are funded by the National Science.
2005 SPRING CSMUIntroduction to Information Management1 Organizing Data John Sum Institute of Technology Management National Chung Hsing University.
CC&E Best Data Management Practices, April 19, 2015 Please take the Workshop Survey 1.
Using SAS® Information Map Studio
Module 6. Data Management Plans  Definitions ◦ Quality assurance ◦ Quality control ◦ Data contamination ◦ Error Types ◦ Error Handling  QA/QC best practices.
File format registries - a global infrastructure for local persistence Andreas Aschenbrenner, ERPANET.
Introduction to Databases Trisha Cummings. What is a database? A database is a tool for collecting and organizing information. Databases can store information.
DATABASES Southern Region CEO Wednesday 13 th October 2010.
TAG: Transatlantic Archaeology Gateway Faunal Remains Workshop York 10 March 2010.
Michael Charno 2,000 years in the making, 2 weeks to record, 2 days to archive, too difficult to reference? How DataCite is unlocking the potential of.
Introduction ESDS Qualidata John Southall ESDS Creating and delivering re-usable qualitative data 24 June 2004.
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 7 Storing Organizational Information - Databases.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.
Building Data and Document-Driven Decision Support Systems How do managers access and use large databases of historical and external facts?
Digital Antiquity Sustaining Database Semantics Sustaining Database Semantics Keith W. Kintigh School of Human Evolution and Social Change Arizona State.
Fanny Widadie, S.P, M.Agr 1 Database Management Systems.
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
MANAGING DATA RESOURCES ~ pertemuan 7 ~ Oleh: Ir. Abdul Hayat, MTI.
Access 2007 ® Use Databases How can Microsoft Access 2007 help you structure your database?
Data resource management
IDigBio is funded by a grant from the National Science Foundation’s Advancing Digitization of Biodiversity Collections Program (Cooperative Agreement EF ).
Research Data Management At the Smithsonian Using Sidora CNI December 10, 2013.
DTC Quantitative Methods Summary of some SPSS commands Weeks 1 & 2, January 2012.
Jon Bateman Transatlantic Archaeology Gateway The Transatlantic Archaeology Gateway: fishing data from the pond Jon Bateman and.
Module 4: Systems Development Chapter 13: Investigation and Analysis.
Riccardi: DIALOGUE Workshop August 1, 2005 Supported by NSF BDI 1 Representing and Using Phylogenetic Characters in Morphbank Greg Riccardi, David Gaitros,
ASET 1 Amity School of Engineering & Technology B. Tech. (CSE/IT), III Semester Database Management Systems Jitendra Rajpurohit.
Welcome: To the fifth learning sequence “ Data Models “ Recap : In the previous learning sequence, we discussed The Database concepts. Present learning:
Collection-Based Persistent Archives Arcot Rajasekar, Richard Marciano, Reagan Moore San Diego Supercomputer Center Presented by: Preetham A Gowda.
1 Management Information Systems M Agung Ali Fikri, SE. MM.
Data Stewardship Lifecycle A framework for data service professionals Protectors of data.
R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.
Todd Quinn – Business & Economics Librarian
Information Systems Today: Managing in the Digital World
MANAGING DATA RESOURCES
_ Update Seth Blumenthal, MBA Director, Data & Innovation PCPI
Metadata Construction in Collaborative Research Networks
Metadata The metadata contains
ece 627 intelligent web: ontology and beyond
Introduction to reference metadata and quality reporting
Presentation transcript:

Digital Antiquity Data Integration with tDAR The Digital Archaeological Record: The potentials of archaeozoological data integration through tDAR Katherine Spielmann and Keith Kintigh Arizona State University ICAZ 2010

Digital Antiquity Data Integration with tDAR the Digital Archaeological Record,. Web-based ingest interface: user/contributors upload data and detailed metadata Provides long-term preservation of data & metadata Web-based discovery and access for data and documents produced by archaeological projects. Provide data integration across inconsistent databases

Digital Antiquity Data Integration with tDAR A Bit of History Driven by need for synthetic research Genesis of the project (1999) was a long-term collaboration of ASU archaeologists Frustrated by the difficulty of Obtaining data Integrating data that were collected using different coding schemes by different investigators Teamed up with computer scientists and got funding

Digital Antiquity Data Integration with tDAR Data Ingest

Digital Antiquity Data Integration with tDAR Adding a Project

Digital Antiquity Data Integration with tDAR Enter Resource Metadata

Digital Antiquity Data Integration with tDAR Additional Metadata Collection Procedures: Sampling of site Sampling of bone assemblage Screen size Context (room, trash, hearth, pit) Quality of faunal collection Weathering % identifiable

Digital Antiquity Data Integration with tDAR Upload Dataset

Digital Antiquity Data Integration with tDAR Enter Column Metadata and Attach Coding Sheet

Digital Antiquity Data Integration with tDAR Coding Sheet Metadata

Digital Antiquity Data Integration with tDAR Preserve the original data in original format in a sustainable format (that can be migrated) on sustainable media no transformations of original file’s content users can always download the data as recorded Preserve database semantics through collection and dissemination of metadata Ensure users’ attribution of credit to creators

Digital Antiquity Data Integration with tDAR Creating General Faunal Ontologies

Digital Antiquity Data Integration with tDAR Ontologies Ontology is a map of the semantic relationships among a set of concepts. In tDAR, ontologies are ordinarily hierarchical (tree-like) and represent an arbitrary number of levels of class-subclass relationships

Digital Antiquity Data Integration with tDAR Burning Intensity First Level Second Level UnburnedBurned Probably Burned CalcinedCharredSinged Indeter- minate Not Recorded

Digital Antiquity Data Integration with tDAR Butchering First Level Second Level Probably Butchered Butchered Indeter- minate Cut MarksSaw Marks Chop Marks Not Butchered Not Recorded

Digital Antiquity Data Integration with tDAR Ontologies in tDAR

Digital Antiquity Data Integration with tDAR Ontology Mapping For a variable to be integrated across databases: The values for that variable in each database are mapped to appropriate nodes in the ontology tree Mapping preferably done by the original analyst

Digital Antiquity Data Integration with tDAR Ontology Mapping - Example Database 1 Database has taxon value 107 Its coding sheet says taxon 107 = “hare” Database 2 Database has taxon value 237 Coding sheet says 237 = “black-tailed jackrabbit” described as “Lepus californicus”

Digital Antiquity Data Integration with tDAR

Associate Coding Key With Ontology

Digital Antiquity Data Integration with tDAR Map Coding Key to Ontology Upper Little Colorado Prehistory Project Pueblo Blanco

Digital Antiquity Data Integration with tDAR Perform Data Integration: Pilot Analysis

Digital Antiquity Data Integration with tDAR Zuni Salinas

Digital Antiquity Data Integration with tDAR tDAR Integration User queries tDAR to identify databases Mark databases to go in user workspace Select tables to integrate

Digital Antiquity Data Integration with tDAR Workspace with Bookmarked Databases

Digital Antiquity Data Integration with tDAR Select Tables to Integrate

Digital Antiquity Data Integration with tDAR Select Data Table Columns to Integrate

Digital Antiquity Data Integration with tDAR Specify Aggregation and Filtering

Digital Antiquity Data Integration with tDAR Output Output Database observations from both datasets integration uses common ontology values filtering eliminates cases aggregation for consistency and analytical simplicity Database is downloaded and analyzed by user.

Digital Antiquity Data Integration with tDAR Integration Output - Species Only

Digital Antiquity Data Integration with tDAR Integration Output – Species & Element

Digital Antiquity Data Integration with tDAR Output Spreadsheet – 2 Sheets

Digital Antiquity Data Integration with tDAR Output Spreadsheet - Combined

Digital Antiquity Data Integration with tDAR Data Table – From SPSS Species code * DatasetTable Crosstabulation DatasetTable Total PBUCLPP Species codeArtiodactylCount % within DatasetTable40.9%29.2%31.6% Bos/bisonCount260 % within DatasetTable.5%.0%.1% CanidCount % within DatasetTable.6%.3%.4% TurkeyCount % within DatasetTable3.0%3.5%3.4% LagomorphCount % within DatasetTable55.0%67.0%64.5% TotalCount % within DatasetTable100.0%

Digital Antiquity Data Integration with tDAR Resource Depression/Overhunting How recognize? Changing prey abundances % NISP of large and small taxa index ratios of large versus small taxa Is small game anthropogenic Burning

Digital Antiquity Data Integration with tDAR Change in prey demographics Age of prey Fusion Change in element frequencies of large game (transport) FUI Increased processing of large game Condition (% complete) Weight

Digital Antiquity Data Integration with tDAR Acknowledgments Andrew W. Mellon Foundation National Science Foundation National Endowment for the Humanities UK Joint Information Systems Committee Archaeology Data Service, University of York Digital Antiquity Board of Directors Sander van der Leeuw, Arizona State University (ASU) [chair] Carol Ackerson, Girl Scouts Arizona Cactus-Pine Council Jeffrey Altschul, SRI Foundation Kim Bullerdick, Owner, BI, L.L.C. John Howard, University College, Dublin Keith Kintigh, ASU Tim Kohler, Washington State University Fred Limp, University of Arkansas Harry Papp, L. Roy Papp & Associates Julian Richards, University of York Dean Snow, The Pennsylvania State University

Digital Antiquity Data Integration with tDAR Questions?