1 Dataset Builder Tool Canadian Research Data Centre Network Statistics Canada NADDI 2014.

Slides:



Advertisements
Similar presentations
ICPSR-SRO Shared Data Model Project Mary Vardigan Director, DDI Alliance.
Advertisements

International Household Survey Network Metadata Toolkit Trevor Croft MICS3 Data Archiving, Dissemination and Further Analysis Workshop Geneva - November.
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.
EQUINOX DATA DELIVERY SYSTEM May 31, 2011 –Elizabeth Hill Equinox.uwo.ca.
Chuck Humphrey University of Alberta RDC CFI Projects Building the next generation of metadata tools.
DLI Training Nesstar Workshop
DDI in Ontario Putting the Pieces Together A. Michelle Edwards, Ph.D. Data Resource Centre, University of Guelph May 16, 2007 Presented at: IASSIST 2007.
An overview of selected DLI projects Marie-Claire Lauzon, Statistics Canada DLI Atlantic Training Acadia University April 24, 2008.
Nesstar, ESDS International and ESDS Qualidata online demonstrations ASLIB visit to the UK Data Archive Wednesday 24 November 2004 Louise Corti, Associate.
INTER-UNIVERSITY CONSORTIUM FOR POLITICAL AND SOCIAL RESEARCH Social Science Data and Resources for Researchers Converting Legacy Documentation to DDI:
Fitting a survey life cycle in the DDI Irene Wong Chuck Humphrey IASSIST Edinburgh May 2005.
NESSTAR - the data archive perspective by Margaret Ward UK Data Archive.
The Metadata Toolbox: A User’s Perspective on DDI J.M. Eisenhauer Smith, Data Analyst/Archivist Center for Demography of Health and Aging University of.
1 Adaptive Management Portal April
Chuck Humphrey University of Alberta The Canadian Research Data Centre Network’s DDI Tools Development Project IASSIST 2009.
Trials and Tribulations of creating DDI Codebooks at the University of Guelph A.Michelle Edwards and Carol Perry, Data Resource Centre, University of Guelph.
Unlocking Public Opinion Poll Data in Canada May 27, 2009 IASSIST 2009 Michelle Edwards, PhD, University of Guelph Jane Fry, Carleton University.
Codebook Centric to Life-Cycle Centric In the beginning….
Research and IR Cohabitating Chuck Humphrey University of Alberta IASSIST 2006.
DDI Does it have a life beyond IASSIST? IASSIST/IFDO 2005 Edinburgh Edinburgh February 11, 2004 Ernie Boyko NESSTAR Americas Ottawa May, 2005.
ISR Training February 12, 2010 Data Retrieval from Statistics Canada Surveys.
Development of the next DDI Tools Catalog Stefan Kramer Research Data Management Librarian Cornell Institute for Social and Economic Research (CISER) 2nd.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
Proposal for Enhancement of the CAUL Statistics
DDI at the Swedish National Data Service
Chuck Humphrey Data Library Co-ordinator University of Alberta May 16, Capitalising on Metadata Tool development plans IASSIST 2007.
Nesstar: A Web-based Data Extraction and Analysis System Richard Pinnell & Sandra Keys, University of Waterloo Libraries.
NORTH CAROLINA ARCHITECTS & BUILDERS: A BIOGRAPHICAL DICTIONARY Catherine W. Bishir Joseph Ryan Markus Wust June 16, 2009.
DLI Training April 2004 Kingston Ontario. DDI What, Why, How?
Metadata Portal Project: Using DDI to Enhance Data Access and Dissemination Mary Vardigan Assistant Director, ICPSR Director, DDI Alliance.
Institute for Social Research University of Michigan
A Journey in Data Discovery Wendy Watkins TSES October, 2007.
Data Management: Documentation & Metadata Sherry Lake, Senior Data Consultant Bill Corey, Data Consultant Jeremy Bartczak, Intellectual Access & Metadata.
Health Data Sources Sunny Kaniyathu 03 February 2011.
BLAISE to DDI Vipavc Irena, ADP, Slovenia CESSDA - Seminar, September, 2004.
Introduction to Metadata, the DDI and the Metadata Editor Presentation to the SERPent project team by Margaret Ward 3 March 2010.
Metadata Architecture at StatCan MSIS 2008 Luxembourg, April 7-9, 2008 Karen Doherty Director General Informatics Branch Statistics Canada.
Documenting and disseminating census and survey data sets Ilpo Survo, United Nations ESCAP, Bangkok, for UNECE.
Citation Standards for Statistics and Data or Where are we today? Gaëtan Drolet Data Liberation Initiative Communications and Library Services Division.
Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.
Background Researchers and funders continue to be concerned about the lack of archiving of scientific data. Such data can be useful to researchers, educators,
Secure Epidemiology Research Platform (SERPent) Kick Start Meeting - April 15 th, 2010 Pascal Heus
DDI AND EXPERIENCES AT ICPSR Prepared for Expert Seminar Finnish Social Science Data Archive Tampere, Finland September 1-2, 2000.
How to Cite Statistics Canada Products Gaëtan Drolet Data Liberation Initiative Communications and Library Services Division DLI Ontario/CAPDU 2005 April.
Ontario Data Documentation, Extraction Service and Infrastructure.
The Data Documentation Initiative: more discussion Chuck Humphrey University of Alberta Atlantic DLI Workshop 2005, Acadia University.
COLECTICA FOR EXCEL: USING DDI LIFECYCLE WITH SPREADSHEETS NADDI 2013.
The Data Liberation Initiative Training University of Regina December 2, 1999 _______________________ Statistics Canada / Statistique Canada.
The Data Documentation Initiative (DDI) Fostering Community Engagement and Adoption Breakout 9 RDA Sixth Plenary, Paris Mary Vardigan, ICPSR, University.
CANDDI Bo Wandschneider CAPDU/DLI April 13, 2005 Queen’s University.
Role of the IMDB in the CBA and IM Strategy Presented to Information Management Committee Standards Division June
General concepts: DDI Irena Vipavc Brvar, ADP SEEDS Kick-off meeting, Lausanne, May 2015.
DDI Moving Forward: Sprint 1 Schloss Dagstuhl October 28-November 1, 2013.
FORSbase SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
Soc 332.6: Principles of research design Finding statistics.
METIS 2011 Workshop Session III – National Implementation of the GSBPM Alice Born and Tim Dunstan Thursday October 6, 2011 Implementation of the GSBPM.
Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.
The Research Data Centre Program October 14, 2015 DLI- EAC Donna Dosman.
Navigating Your Way Through the EFT, Nesstar and Beyond 20/20 (WDS)
International Household Survey Network
DLI Website.
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 11/14/2018.
ICPSR Census Metadata Repository
Keeping Up With Questasy
A DDI3.2 Style for Data and Metadata Extracted from SAS
DDI in Ontario Putting the Pieces Together

Capitalising on Metadata
Data Liberation Initiative (DLI)
Presentation transcript:

1 Dataset Builder Tool Canadian Research Data Centre Network Statistics Canada NADDI 2014

Outline  Background of project  Converted metadata  Process of project  Tools developed  Licensing agreement  Future metadata plans  Benefits of Dataset Builder Tool  Demonstration of tool 2

Background  In 2008 CRDCN received CFI funding  Project completed April, 2013  Objectives Retrospective conversion of the metadata for the StatCan surveys in the RDC’s to the DDI-Lifecycle standard Develop an editor tool to produce DDI-Lifecycle metadata Develop a search, discover and build tool for researchers

Converted Metadata  Coded 100,000+ variables  200,000+ variables in both English and French  Coded into DDI-Codebook: 243 cycles of data 39 surveys  Upgraded into DDI-Lifecycle: 223 cycles of data 38 surveys

Tools Developed  Tools used in coding/editing process DDI registry/catalog DDI base Editing suite and enhanced editor Import/export tools Quality assurance utility IMDB – DDI-L conversion tool  Dataset Builder Tool

Licensing Agreement  Copyright © 2013 Metadata Technology North America Inc. |  Open source license: GNU Lesser General Public License

Future Metadata Plans  Statistics Canada is: Short term  Coding 60 new cycles of data  Placing the DDI – Codebook metadata in Nesstar on DLI site in a separate collection Longer term  Developing a metadata strategy in which DDI may be named as one of the standards  Developing a common tool which exports metadata (codebook) into xml  CRDCN plans to:  Eventually host the dataset builder on the CRDCN website

Benefits of Dataset Builder Tool  Provides a single tool for researchers to search and discover survey metadata  Survey metadata can be used to create better research proposals  Ability to subset data and create the associated codebook/data dictionary documentation  Makes research process more efficient by saving time and effort

Contact Information  Metadata Technology North America |  Pamela Moren, Statistics Canada  Donna Dosman, Statistics Canada

Demo of Dataset Builder

Dataset Builder: Homepage

Dataset Builder: Variable Basket

Dataset Builder: Creating New Dataset

Dataset Builder: Generating Scripts

Dataset Builder: Generating Codebooks