Implementing DDI in a Survey Organisation

Slides:



Advertisements
Similar presentations
Leaders in Fieldwork & Data Processing Leaders in Fieldwork & Data Processing.
Advertisements

ICPSR-SRO Shared Data Model Project Mary Vardigan Director, DDI Alliance.
Multiple Indicator Cluster Surveys Data Entry and Processing.
DDI for the Uninitiated ACCOLEDS /DLI Training: December 2003 Ernie Boyko Statistics Canada Chuck Humphrey University of Alberta.
Quantitative Data Preparation Louise Corti ESDS/ UKDA Social Science Data Archives for Social Historians: creating, depositing and using qualitative data.
Quantitative Data Preparation Alasdair Crockett, Data Services Manager UK Data Archive.
Nesstar, ESDS International and ESDS Qualidata online demonstrations ASLIB visit to the UK Data Archive Wednesday 24 November 2004 Louise Corti, Associate.
Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.
RTI International is a trade name of Research Triangle Institute The Joy of Developing a Web-based Survey System! Stuart Allen, Brandon Peele,
World Bank, Africa Region, Africa Household Survey Databank - The World Bank - Africa.
Data Collection, Harmonisation and Storage (An international perspective) Jon Johnson (CLS, Senior Database Manager) Sub-brand to go here CLS is an ESRC.
Data documentation and metadata for data archiving and sharing Managing research data well workshop London, 30 June 2009 Manchester, 1 July 2009.
ELSA ELSA datasets and documentation available from the archive or by special arrangement Kate Cox National Centre for Social.
Date: in 12 pts Education and Culture … in other words Mobility Tool 2013/2014: transition to E4A.
Organising social science data – computer science perspectives Simon Jones Computing Science and Mathematics University of Stirling, Stirling, Scotland,
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
Writing a HOWTO Guide for DDI An approach for getting started.
University of Colorado at Denver and Health Sciences Center Department of Preventive Medicine and Biometrics Contact:
Metadata standards Using DDI to Inform, Organize, and Drive Survey Data Production.
DU REDCap Introduction
REDCap General Overview
Data quality & VALIDATION
WHO The World Health Survey Data Entry
STANDARDISED INTERVIEWER TRAINING, ACCREDITATION AND QUALITY PROCEDURES ON THE MILLENNIUM COHORT STUDY AGE 14 SURVEY Nickie Rose, Anne Conolly and Rachel.
Basics of the Endnote bibliography and refererence manager program 2013 Attila Skulteti
MANAGEMENT OF STATISTICAL PRODUCTION PROCESS METADATA IN ISIS
Data Virtualization Community Edition
A New Look for the NHANES Website (NHANES Tutorial)
A Metadata System for Geomagnetism
Software Documentation
Michigan Questionnaire Documentation System (MQDS)
RFPMonkey.com External Review
Printer Admin Print Job Manager
Student Pathways Survey / Plan
Content & the Supply Chain
SDMX FROM NEEDS Kamel ABDELLAOUI Rafik Mahjoubi
The usage of web interviewing in Lithuanian Labour Force Survey
What’s New in Colectica 5.3 Part 1
Section 3: Sweep implementation
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 11/14/2018.
Data Management: Documentation & Metadata
DDI for the Uninitiated
Using DDI to Automate Blaise Instrument Generation

What’s New in Colectica 5.3 Part 2
Enhancing ICPSR metadata with DDI-Lifecycle
Software Systems for Survey and Census
Web archive data and researchers’ needs: how might we meet them?
Course: Module: Lesson # & Name Instructional Material 1 of 32 Lesson Delivery Mode: Lesson Duration: Document Name: 1. Professional Diploma in ERP Systems.
REAL-TIME, INTERACTIVE DOCUMENT AUTOMATION
A Question Database for the German Longitudinal Election Study
Tax Card Online for students
Validation process and the IT tools used at KAS
Social Research Methodology and Supplementary Documentation John Kallas University of the Aegean, Department of Sociology.
COUNTER Update February 2006.
Question Banks, Reusability, and DDI 3.2 (Use Parameters)
Journal Usage Statistics Portal (JUSP): a simpler way to measure use and impact
RESEARCH TOOLS OR INSTRUMENTS
Qualtrics for data collection
Prepared by Peter Boško, Luxembourg June 2012
Baseline Household Survey (CAPI) High-frequency Data Collection (CATI)
The modules of the EU Labour Force Survey
Statistical System in India
Questasy: Documenting and Disseminating Longitudinal Data Online with DDI 3 Edwin de Vet 5/21/2019.
Data Liberation Initiative (DLI)
Web Application Development Using PHP
Item 5 Modernisation of the EU-SILC Production
Presentation transcript:

Implementing DDI in a Survey Organisation 10/05/2019 Implementing DDI in a Survey Organisation 3 December 2012

10/05/2019 Contents Background Our aims The transition

10/05/2019 Background 1.

10/05/2019 Background NatCen Social Research is an independent social research organisation in the UK Carry out large scale surveys from design to reporting Health Survey for England and Scottish Health Survey British Social Attitudes Survey Growing Up in Scotland English Longitudinal Study of Ageing Understanding Society Make data available for secondary analysis through the UK Data Service Produce user documentation that allows data users to understand the data

Documentation User Guide 10/05/2019 Documentation User Guide Background to study Sampling Survey methodology Weighting Response rates Documentation of survey instrument showing question text, answer categories, routing and variable name Information on transformations carried out on the data, derived variables, recode Dataset documentation – variable lists arranged by topic (All documentation is provided as PDF files)

Documentation – other issues 10/05/2019 Documentation – other issues Some studies involve collecting biomarkers (blood, saliva, urine), separate self-completion data Longitudinal studies also need to document changes between waves Other types of data collection, audio files, social media etc. Currently this information is compiled as text from various sources But all this is metadata and needs to be managed and made accessible

Current working patterns 10/05/2019 Current working patterns Studies run by research groups within the organisation Larger projects have data managers, in smaller projects, data management is done by researchers Each group evolved their own way of producing documentation – often last thing done in the project Metadata ‘hidden’ in text/pdf files, sometimes not easily found for re-use After recent reorganisation we are reviewing how we do data management, including capturing and managing metadata

10/05/2019 Our aims 2.

10/05/2019 Aims Move away from the situation where metadata ‘capture’ is done at the end of a study by someone who may not have been involved in the stages they are documenting Metadata ‘capture’ will be done at the stage the information is first generated AND this should not be an extra burden for anyone Final documentation will be produced using the existing metadata from each of the earlier stages

10/05/2019 How will we do this Not necessarily looking for an off the shelf complete study package We want to: exploit capacity of our existing software and processes to capture/export metadata find opportunities to introduce new tools that enhance our current process

10/05/2019 How will we do this We believe that metadata tools are useful/acceptable if: they provide a straightforward, structured way of capturing and communicating information they offer some benefit at the capture stage the information provided can be easily extracted later

10/05/2019 Transition 3. How do we get from where we are now to where we’d like to be

Existing flows (illustrative) 10/05/2019 Existing flows (illustrative) CAPI Blaise Study design Question design Survey implementation CAWI Word Word Self completion Word / pdf Word, Blaise Coding / editing Data processing SPSS FW monitoring Newfield Data delivery SPSS Most projects this whole cycle. 1 study design (various, mainly word, some email / xl) researchers->collaborators/clients 2. Q design (various – mostly word, some other – some copying from previous, some direct into blaise) 3. Implementation in some mode(s) (blaise / word->pdf) 4. Fw monitoring / reporting (newfield SQLs / xls / other) 5. Coding (blaise / qdcor)(word spec) also 1st stage cleaning / some DVs / reconciliation 6. Data processing (SPSS) 2nd stage cleaning / DVs / weights / labels 7 data delivery (SPSS / SAS / Stata) 8 archive (SPSS) Documentation from all these places Could add to this – project management, other things. Automatically Up till recently have been thinking about CAI instrument and dataset as metadata source Now looking at beginning of process and throughout the cycle Documentation Word / pdfD Archive SPSS Other sources Publications, citations, etc.

Stages where a new tool would be welcomed 10/05/2019 Stages where a new tool would be welcomed Questionnaire design Coding and editing Project database Stages where a new tool would be welcomed Where it would provide a structure way of communicating information. Where there would be a tangible benefit to team AND where the information provided can be extracted as metadata. Currently identified 3 possible ‘entry points’ DON’T TALK ABOUT THEM YET – NEXT 3 SLIDES Q design Coding/editing spec Proj database / proj design initiation

Questionnaire design stage 10/05/2019 Questionnaire design stage Researcher works with client to define and test questions Researcher passes final question specification to programmer Programmers would like a consistent structured way for this to happen. Questionnaire design stage – communication between researcher and programmer Researcher works with client to define and test questions or choose validated questions to reuse from other studies. Browser interface on our server for client to access??? Researcher lets programmer know which questions to add to CAPI programme or to reuse from other studies. Usually done by researcher sending Word draft and requesting changes by email or Excel ‘log’. Varies across projects. Programmers would like a consistent structured way for this to happen. Researcher types the text anyway. So ideal place to introduce software that allows question specification and can export DDI3 XML

10/05/2019 Coding and edit Researcher produces list of questions that will need coding with details and instructions Could be replaced with a structured document Coding and edit sta Researcher produces list of questions that will need coding and provides code frames (or for standard questions like occupational coding, coding team have existing code frames. Again currently done as Word document. Could be replaced with a structured ‘document’ where field are completed by researcher and DDI3 XML exported ge – communication between researcher, data manager, programmer and coding team

Project database – administration 10/05/2019 Project database – administration Kept by our administrator, with basic information about each project Fields could be added to provide a wider range of metadata Project database – administration Kept by our administrator. Basic information about each project. Project number, name, research director in charge, fieldwork manager, client. SQL database ? Fields could be added to provide a wider range of metadata – elements of project design Could provide the basis for a metadata repository or feed into it.

10/05/2019 Thank you If you want further information or would like to contact the authors, Joan Corbett Senior Data Manager E. joan.corbett@scotcen.ac.uk Roger Stafford E. roger.stafford@natcen.ac.uk Visit us online, natcen.ac.uk