© 2014 by the Regents of the University of Michigan Metadata from Blaise and DDI 3.0/3.2 Gina Cheung Beth-Ellen Pennell North American DDI Conference April.

Slides:



Advertisements
Similar presentations
ICPSR-SRO Shared Data Model Project Mary Vardigan Director, DDI Alliance.
Advertisements

MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.
DDI for the Uninitiated ACCOLEDS /DLI Training: December 2003 Ernie Boyko Statistics Canada Chuck Humphrey University of Alberta.
DLI Training Nesstar Workshop
Data Documentation Initiative (DDI) Workshop Carol Perry Ernie Boyko April 2005 Kingston Ontario.
Metadata Management at GESIS-ZA Reiner Mauer GESIS – Data Archive and Data Analysis CESSDA-Expert Seminar Odense, September 11th 2008.
Metadata at ICPSR Sanda Ionescu, ICPSR.
Gerrit de Bolster September 24, 2013 Generating Blaise from DDI.
NHD Update Process Improvement Project U.S. Department of the Interior U.S. Geological Survey Kevin McNinch, Dave Hughes, Paul Kimsey.
Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.
© 2014 by the Regents of the University of Michigan Social Survey Data Collection Challenges and Trends Gina Cheung Beth-Ellen Pennell North American DDI.
Click to edit Master title style Click to edit Master subtitle style DDI Across the Life Cycle: One Data Model, Many Products IASSIST Meeting Tampere,
HOW MANY HAVE USED QUALTRICS? WHO WHAT WHEN WHERE WHY.
Developments in Data Discovery at ICPSR George Alter Director, ICPSR University of Michigan.
2006 Using and Developing Survey Metadata Debra Reed-Gillette - Michael Volynski, Ph.D. -
RTI International is a trade name of Research Triangle Institute The Joy of Developing a Web-based Survey System! Stuart Allen, Brandon Peele,
California Digital Library Applications in the Real World: The Counting California Experience with the DDI Patricia Cruse Ilona Einowski Juri Stratford.
Meta Dater Metadata Management and Production System for surveys in Empirical Socio-economic Research A Project funded by EU under the 5 th Framework Programme.
Fitting a survey life cycle in the DDI Irene Wong Chuck Humphrey IASSIST Edinburgh May 2005.
Demonstration of a Blaise Instrument Documentation System “BlaiseDoc” Gina-Qian Cheung May 25, 2005 Institution for Social Research University of Michigan.
Survey Metadata Documentation Sue Ellen Hansen, Gina-Qian Cheung, Kirsten Alcser, Grant Benson, Ashley Bowers, Karl Dinkelmann, Youhong Liu, Beth-Ellen.
Trials and Tribulations of creating DDI Codebooks at the University of Guelph A.Michelle Edwards and Carol Perry, Data Resource Centre, University of Guelph.
Documentation Tools in the Survey Lifecycle. Outline What is NSFG Webdoc? Instrument documentation != Survey documentation Data Cleaning/Processing in.
 Name and organization  Have you worked with DDI before? (2 or 3)  If not, are you familiar with XML?  What kind of CAI systems do you use?  Goals.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
Data Documentation Initiative (DDI): Goals and Benefits Mary Vardigan Director, DDI Alliance.
Research data workflow Practice in Slovenian Social Science Data Archives SERSCIDA WP4 – WORKSHOP Ljubljana September 2013.
Data Management Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition.
Data Collection, Harmonisation and Storage (An international perspective) Jon Johnson (CLS, Senior Database Manager) Sub-brand to go here CLS is an ESRC.
DDI Lifecycle: Moving Forward Outcome of the Recent Workshop in Dagstuhl Joachim Wackerow.
IMS Proof of Concept for Data Capture using Metadata Bryan Fitzpatrick Rapanea Consulting Limited June 2014.
Applying DDI to a Longitudinal Study of Aging. Overview of Presentation  Content of MIDUS  Importance of DDI as Data Management  Process of Creating.
DLI Training April 2004 Kingston Ontario. DDI What, Why, How?
Institute for Social Research University of Michigan
Data documentation and metadata for data archiving and sharing Managing research data well workshop London, 30 June 2009 Manchester, 1 July 2009.
DDI-RDF Leveraging the DDI Model for the Linked Data Web.
BLAISE to DDI Vipavc Irena, ADP, Slovenia CESSDA - Seminar, September, 2004.
Metadata management: DDI and Nesstar at the Czech Social Science Data Archive Jindrich Krejci & Yana Leontiyeva Data without Boundaries, Ljubljana 24 &
Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.
Colectica Feature Overview. Current Focus: Data Collection.
OWL Representing Information Using the Web Ontology Language.
12/5/2015 Open Source Technology Toolkit Workshop 1 MediaWiki Pavan Kishore V EnhanceEdu.
DDI AND EXPERIENCES AT ICPSR Prepared for Expert Seminar Finnish Social Science Data Archive Tampere, Finland September 1-2, 2000.
Ontario Data Documentation, Extraction Service and Infrastructure.
COLECTICA FOR EXCEL: USING DDI LIFECYCLE WITH SPREADSHEETS NADDI 2013.
The Data Documentation Initiative (DDI) Fostering Community Engagement and Adoption Breakout 9 RDA Sixth Plenary, Paris Mary Vardigan, ICPSR, University.
DDI Moving Forward: Sprint 1 Schloss Dagstuhl October 28-November 1, 2013.
FORSbase SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
University of Colorado at Denver and Health Sciences Center Department of Preventive Medicine and Biometrics Contact:
Metadata standards Using DDI to Inform, Organize, and Drive Survey Data Production.
Introduction to Survey Documentation and Analysis (SDA)
An Overview of Data-PASS Shared Catalog
Michigan Questionnaire Documentation System (MQDS)
George Alter, ICPSR (PI)
What’s New in Colectica 5.3 Part 1
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 11/14/2018.
ICPSR Census Metadata Repository
DDI for the Uninitiated

What’s New in Colectica 5.3 Part 2
Enhancing ICPSR metadata with DDI-Lifecycle
CLOSER Discovery Alison Park, UCL Institute of Education
IASSIST 2014 – Toronto, Ontario
Colectica 5 A New Generation of Open Metadata Tools
Question Banks, Reusability, and DDI 3.2 (Use Parameters)
Survey Documentation and Analysis (SDA)
Prepared by Peter Boško, Luxembourg June 2012
Managing Private and Public Views of DDI Metadata Repositories
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 5/21/2019.
Presentation transcript:

© 2014 by the Regents of the University of Michigan Metadata from Blaise and DDI 3.0/3.2 Gina Cheung Beth-Ellen Pennell North American DDI Conference April 1-2, 2014

© 2014 by the Regents of the University of Michigan Agenda Blaise Metadata (MQDS) DDI 3.0/3.1 – DDI 3.2 Next Step

© 2014 by the Regents of the University of Michigan What is MQDS? The Michigan Questionnaire Documentation System (MQDS) was designed to extract comprehensive metadata from Blaise survey instruments and render it as an eXtended Markup Language (XML) document using the Data Documentation Initiative (DDI) standard. From 2013 NADDI presentation

© 2014 by the Regents of the University of Michigan MQDS Development Timeline Version BlaiseDoc Version Net Programming Version Database driving and DDI 3.0 compatible Version Able to handle large data model and DDI 3.1 compatible Version ? Able to work with Blaise 5 new structures and DDI 3.2 compatible From 2013 NADDI presentation

© 2014 by the Regents of the University of Michigan MQDS usage Free to all Blaise community users Questionnaire design Questionnaire documentation Quick data transformation (BDB format to SAS, SPASS or SQL DB format) Creating interviewers’ training materials Codebook with universe info and “go-to” logic

© 2014 by the Regents of the University of Michigan MQDS Limitations Complex Blaise questionnaire roster structure Blaise alien router Paradata documentation Not a tool for Survey life circle documentation yet…. From 2013 NADDI presentation

© 2014 by the Regents of the University of Michigan DDI History DD2: – Documents variables in a dataset – Question text from a survey is associated with a single variable – No detailed description of the question or response options – No question flow, only simple forward and backward links DDI 3.0/3.1 – Describes instrument flow – Textual description of conditions for if/then, loops, and dynamic text From 2013 EDDI Colectica’s presentation

© 2014 by the Regents of the University of Michigan Blaise Metadata Show Case Collaborative Psychiatric Epidemiology Surveys (CPES): to collect data re: distributions, correlates and risk factors of mental disorders as well as explore ethnic disparities, support systems, discrimination, and assimilation – Interviewing extended from – All probability samples of non-institutionalized adults living in coterminous US – Version of World Health Organization’s Composite International Diagnostic Interview (CIDI) programmed in Blaise CPES Harmonization Project: – Harmonize and merge CPES datasets – Prepare enhanced tools (interactive codebook) and data for on-line analysis – Develop Web site – Disseminate for public use

© 2014 by the Regents of the University of Michigan 9 Challenges Documented 3 instruments with multiple datamodels – Needed to create pseudo instrument for CPES merged dataset – Edited instrument datamodels to improve documentation Created eXtended Markup Language (XML) files with question metadata for 9 XML files – CPES – Individual studies – NLAAS five languages

© 2014 by the Regents of the University of Michigan Complete Process

© 2014 by the Regents of the University of Michigan 11 Interactive Codebook

© 2014 by the Regents of the University of Michigan 12 CPES V04454 Frequencies

© 2014 by the Regents of the University of Michigan ICPSR Developed Web site Used XML files and the crosswalk to create interactive codebook Provided – keyword search capability – downloadable datasets and codebooks – online analysis tools – links to study documentation, publications, and related sites Web site maintenance and user support

© 2014 by the Regents of the University of Michigan

New to DDI 3.2 The main new things around questions and surveys in DDI 3.2 are: – Fragments, Groups, Represented variables – Modeling data flows through an Instrument with InParameters, OutParameters, and Bindings – QuestionGrids – QuestionBlocks – Scale questions – Ranked questions – Point distribution questions

© 2014 by the Regents of the University of Michigan Fragments DDI 3.2 int.example Male 1 Male DDI <c:ConceptualComponent isMaintainable="true" id="CC_1">... <d:DataCollection isMaintainable="true" id="DC1" version="1.0.0" versionDate=" "> <l:Category isVersionable="true" id="cat_17_C82" missing="false"> Male...

© 2014 by the Regents of the University of Michigan Groups DDI 3.1 GITFIELD section GITFIELD V1 V461 V23 DDI 3.2 UoM VG1 1 varGroup1 UoM V1 1 Variable UoM V461 1 Variable UoM V23 1 Variable

© 2014 by the Regents of the University of Michigan Represented Variables int.example lvar1 1 marStat2000 Marital status of respondent in 2000 int.example repVar1 1 RepresentedVariable

© 2014 by the Regents of the University of Michigan Data flow: InParameters, OutParameters, and Bindings int.example ifThen1 1 int.example inParam2 1 genderOfRespondent int.example codeListGender 1 CodeList MetaEnglish genderOfRespondent == Female int.example seq2 1 Sequence

© 2014 by the Regents of the University of Michigan Question representations QuestionGrids QuestionBlocks Scale questions Ranked questions Point distribution questions

© 2014 by the Regents of the University of Michigan QuestionGrids

© 2014 by the Regents of the University of Michigan QuestionGrids Name What is your name? GIT.HHL.HHL[1].Name Name Q29 GIT.HHL.HHL[1] array U20 V28 V29 V31

© 2014 by the Regents of the University of Michigan QuestionGrids int.example grid1 1 <d:Roster baseCodeValue="1" codeIterationValue="1" minimumRequired="1" maximumAllowed="25" > Name... ddi:Fragment> int.example question1 1 q1 int.example outParam1 1 firstName What is your name? <

© 2014 by the Regents of the University of Michigan Scale questions Keep Up w/ Infl On a scale of 0 to 100, what do you think are the chances that your income will keep up with inflation for the next five years?... KeepUp Scale Intro KeepUp Q

© 2014 by the Regents of the University of Michigan Scale questions int.example Q1 1 KeepUp On a scale of 0 to 100, what do you think are the chances that your income will keep up with inflation for the next five years? Keep Up w/ Infl

© 2014 by the Regents of the University of Michigan Ranked questions int.example grid1 1 <d:Roster baseCodeValue="1" codeIterationValue="1" minimumRequired="0" maximumAllowed="100" > Name 1 <r:MaximumValue included="true">5 100

© 2014 by the Regents of the University of Michigan DDI 3.2 is much more powerful to Document the full survey lifecycle in a standard manner

© 2014 by the Regents of the University of Michigan Next Step DDI3.2 MQDS 5? Blaise 5? Colectica 5? Thank YOU!