Leveraging the DDI Model for Linked Statistical Data in the Social, Behavioural, and Economic Sciences DC 2012 05.09.2012 Thomas Bosch GESIS – Leibniz.

Slides:



Advertisements
Similar presentations
Status on the Mapping of Metadata Standards
Advertisements

DDI – Metadata for social science data Wolfgang Zenk-Möltgen GESIS – Leibniz Institute for the Social Sciences DataCite.
A multi-level metadata approach for a Public Sector Information data infrastructure Nikos Houssos 1,2, Brigitte Jörg 1,3, Brian Matthews 4 1 euroCRIS 2.
William C. Block & Stefan Kramer Cornell Institute for Social and Economic Research (CISER) Report on Dagstuhl Workshop on Managing Metadata for Longitudinal.
An Leabharlann UCD Órna Roche UCD James Joyce Library Metadata Documenting your data
Inside View of DDI Version 3.0: Structural Reform Group Report Presented to IASSIST 25 May 2005 Edinburgh Scotland UK.
Is Your Data Facility ISO Compliant? Progress Towards Harmonizing the DDI and ISO/IEC Dan Gillman Information Scientist US Bureau of Labor Statistics.
DDI URN Enabling identification and reuse of DDI metadata IDSC of IZA/GESIS/RatSWD Workshop: Persistent Identifiers for the Social Sciences Joachim Wackerow.
The MetaDater Model and the formation of a GRID for the support of social research John Kallas Greek Social Data Bank National Center for Social Research.
Codebook Centric to Life-Cycle Centric In the beginning….
Reducing Metadata Objects Dan Gillman November 14, 2014.
DDI Does it have a life beyond IASSIST? IASSIST/IFDO 2005 Edinburgh Edinburgh February 11, 2004 Ernie Boyko NESSTAR Americas Ottawa May, 2005.
 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.
Q: What objects documented by DDI should be citable? All versionable objects, some may not be used Q: What elements are needed in DDI and CDISC to support.
The education variables in the European Social Survey: Advantages in using the DDI for documentation Hilde Orten and Hege Midtsæter Norwegian Social Science.
National libraries and identity in the Semantic Web Gordon Dunsire BNE, Madrid, 14 Dec 2011.
Modernizing the Data Documentation Initiative (DDI-4) Dan Gillman, Bureau of Labor Statistics Arofan Gregory, Open Data Foundation WICS, 5-7 May 2015.
Digital Encoding What’s behind E-text Resources?.
Representing and utilizing DDI in relational databases A new DDI best practices working paper Ingo Barkow, Senior researcher, Leibniz Institute for Educational.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
ISO as the metadata standard for Statistics South Africa
Data Documentation Initiative (DDI): Goals and Benefits Mary Vardigan Director, DDI Alliance.
ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)
Controlled Vocabularies for DDI 4 How to represent CVs?
The OAI-ORE based data model of Europeana and the Digital Public Library of America: implications for educational publishing Dov Winer MAKASH – Advancing.
DDI: Capturing metadata throughout the research process for preservation and discovery Wendy Thomas NADDI 2012 University of Kansas.
3 rd Annual European DDI Users Group Meeting, 5-6 December 2011 The Ongoing Work for a Technical Vocabulary of DDI and SDMX Terms Marco Pellegrino Eurostat.
PHDD – An RDF Vocabulary for the Physical Data Description Work in Progress Joachim Wackerow and Thomas Bosch (both GESIS – Leibniz Institute for the Social.
DDI-RDF Discovery Vocabulary A Metadata Vocabulary for Documenting Research and Survey Data Linked Data on the Web (LDOW 2013) Thomas Bosch.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
Is Your Data Facility ISO Compliant? Progress Towards Harmonizing the DDI and ISO/IEC Dan Gillman Information Scientist US Bureau of Labor Statistics.
Chuck Humphrey Data Library Co-ordinator University of Alberta May 16, Capitalising on Metadata Tool development plans IASSIST 2007.
DDI-RDF Leveraging the DDI Model for the Linked Data Web.
Finding, Linking and Organizing Resources with Linked Data & Natural Language Processing Paul Buitelaar Unit for Natural Language Processing Digital Enterprise.
Study Discovery in Support of the Data Without Boundaries Initiative, the NIH Data Documentation Index and Infonomics Jay Greenfield Booz Allen Hamilton.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Documentation and Cataloguing in Data.
Background Cornell Institute for Social and Economic Research (CISER): Data and Computing Support for Social and Economic Researchers at Cornell University.
MISSY - Metadata for Official Statistics - a new service for EU microdata - European Data Access Forum Luxembourg, March 2015 Jeanette Bohr GESIS – Leibniz.
Lifecycle Metadata for Digital Objects November 1, 2004 Descriptive Metadata: “Modeling the World”
Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.
Secure Epidemiology Research Platform (SERPent) Kick Start Meeting - April 15 th, 2010 Pascal Heus
DDI and the Lifecycle of Longitudinal Surveys Larry Hoyle, IPSR, Univ. of Kansas Joachim Wackerow, GESIS - Leibniz Institute for the Social Sciences.
DDI Discovery: An Overview of Current RDF Vocabularies Arofan Gregory Metadata Technologies NA Joachim Wackerow GESIS.
Strategies for subject navigation of linked Web sites using RDF topic maps Carol Jean Godby Devon Smith OCLC Online Computer Library Center Knowledge Technologies.
Looking into the future… Providing Social Science Data Services Jim Jacobs.
EDM Europeana Data Model Guus Schreiber with input from Carlo Meghini, Antoine Isaac, Stefan Gradmann, Maxx Dekkers et al. from Europeana V1.
University of Alberta, Canada Australian Bureau of Statistics (ABS) Australian Data Archive (ADA) University of California, Berkeley --
EXtended Knowledge Organization System (XKOS) Prepared by Franck Cotton, Institut National de la Statistique et des Études Économiques Daniel W. Gillman,
Marion Wittenberg – DANS Merja Karjalainen – SND.
Metadata Driven Survey Research Jeremy Iverson. Open Standards.
Writing a HOWTO Guide for DDI An approach for getting started.
>> Metadata What is it, and what could it be? EU Twinning Project Activity E.2 26 May 2013.
MICHAEL and the European Digital Library: promoting teaching, learning and research The MICHAEL Project is funded under the European Commission eTEN Programme.
The Registration Agency, DDI and Linked Open Data
Publishing DDI-Related Topics Advantages and Challenges of Creating Publications Joachim Wackerow EDDI16 - 8th Annual European DDI User Conference Cologne,
DDI and GSIM – Impacts, Context, and Future Possibilities
DDI - A Metadata Standard for the Community
DDI Extensions for Qualitative Data NADDI 2013
Lifecycle Metadata for Digital Objects
Unit for Natural Language Processing
Alternatives for Representing Coding of Qualitative Data in DDI
How can DDI make the most of RDF?
DDI-RDF Discovery Vocabulary _ Use Cases and Vocabularies
A Question Database for the German Longitudinal Election Study
Updates on the XSLT stylesheets for DDI
Social Research Methodology and Supplementary Documentation John Kallas University of the Aegean, Department of Sociology.
The Next Generation of the Microdata Information System MISSY: An Integrated Solution for the Documentation of European Microdata European DDI User Conference,
Semantic Statistics DDI Lifecycle: Moving Forward Outcome of the Recent Workshops in Dagstuhl Joachim Wackerow.
Introducing the Data Documentation Initiative
DDI and GSIM – Impacts, Context, and Future Possibilities
Presentation transcript:

Leveraging the DDI Model for Linked Statistical Data in the Social, Behavioural, and Economic Sciences DC Thomas Bosch GESIS – Leibniz Institute for the Social Sciences, Germany Richard Cyganiak Digital Enterprise Research Institute, Ireland Joachim Wackerow GESIS – Leibniz Institute for the Social Sciences, Germany Benjamin Zapilko GESIS – Leibniz Institute for the Social Sciences, Germany

2 Agenda

DDI (Data Documentation Initiative) Established international standard for the documentation and management of data from the social, behavioral, and economic sciences Data model for statistical data Supports the entire research data lifecycle Focus on microdata Structured high quality metadata enable secondary analysis without the need to contact the primary researcher Enables the re-use of metadata of existing studies for designing new studies Currently specified in XML Schema 3 What is DDI?

DDI subset of the most important DDI elements Use cases Experts in the statistics domain formulated use cases which are seen as most significant to solve frequent problems Most important use case: discover microdata connected with multiple studies Leverage existing DDI-XML docs to DDI-RDF automatically Direct mapping Generic mapping (Bosch and Mathiak, 2011) 4 How was the DDI Ontology developed?

Currently no such ontology available To increase visibility of data holdings using mainstream Web technologies To open DDI to the Linked Data community To process DDI-RDF by RDF tools To link DDI-RDF to other RDF data To better identify opportunities for merging datasets To enable inferencing To research microdata within the LOD cloud 5 Why DDI as Linked Data?

Dublin Core Metadata Element Set, Version 1.1 DCMI Metadata Terms SKOS SDMX  RDF Data Cube Vocabulary ISO/IEC ISO What other metadata standards vocabularies are used?

Which studies are connected with a specific coverage consisting of the 3 dimensions: time, country, and subject? What questions with a specific question text are contained in the study questionnaire? What questions are connected with a concept with a specific label? What questions are combined with a variable with an associated coverage consisting of the 3 dimensions time, country, and subject? What concepts are linked to particular variables or questions? What representation does a specific variable have? What codes and what categories are part of this representation? What variable label does a variable with a particular variable name have? What‘s the maximum value of a certain variable? What are the absolute and relative frequencies of a specific code? What data files contain the entire dataset? 7 Discovery Use Case

8

9 study | coverage

10

11 instrument | question | concept

12

13

values | value labels 14

15

16

17 variable | descriptive statistics

18

19

20 logical dataset | dataset | data file

21

22

conceptual model 23

24

Acknowledgements Archana Bidargaddi (NSD - Norwegian Social Science Data Services, Norway) Franck Cotton (INSEE - Institut National de la Statistique et des Études Économiques, France) Richard Cyganiak (DERI - Digital Enterprise Research Institute, Ireland) Daniel Gilman (BLS - Bureau of Labor Statistics, USA) Marcel Hebing (SOEP - German Socio-Economic Panel Study, Germany) Larry Hoyle (University of Kansas, USA) Jannik Jensen (DDA - Danish Data Archive, Denmark) Stefan Kramer (CISER - Cornell Institute for Social and Economic Research, USA) Amber Leahey (Scholars Portal Project - University of Toronto, Canada) Abdul Rahim (Metadata Technologies Inc., USA) John Shepherdson (UK Data Archive, UK) Dan Smith (Algenta Technologies Inc., USA) Humphrey Southall (Department of Geography, UK Portsmouth University, UK) Wendy Thomas (MPC - Minnesota Population Center, USA) Johanna Vompras (University Bielefeld Library, Germany) 25

Thank you for you attention! 26