Hannele Keckman-Koivuniemi and Mari Kleemola : Data Processing in FSD : CHALLENGES IN A NEW ARCHIVE IASSIST2003 Ottawa,

Slides:



Advertisements
Similar presentations
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.
Advertisements

Quantitative Data Preparation Louise Corti ESDS/ UKDA Social Science Data Archives for Social Historians: creating, depositing and using qualitative data.
Depositing Data for Archiving Libby Bishop ESDS Qualidata, University of Essex Changing Families, Changing Food Meeting University of Sheffield 15 March.
Accessing the NCDS and the BCS70 via the Economic and Social Data Service Jack Kneeshaw NCDS/BCS70 workshop 21 February 2007 ESDS Longitudinal.
New Services for Data Creators and Providers Louise Corti, Head ESDS Qualidata/ Outreach & Training Alasdair Crockett, ESDS Data Services Manager.
Quantitative Data Preparation Alasdair Crockett, Data Services Manager UK Data Archive.
Accessing the MCS from the Economic and Social Data Service Jack Kneeshaw MCS workshop 28 June 2007 ESDS Longitudinal.
Accessing the NCDS and the BCS70 via the Economic and Social Data Service Jack Kneeshaw NCDS/BCS70 workshop 16 October 2007 ESDS Longitudinal.
Nesstar, ESDS International and ESDS Qualidata online demonstrations ASLIB visit to the UK Data Archive Wednesday 24 November 2004 Louise Corti, Associate.
Organising and Documenting Data Stuart Macdonald EDINA & Data Library DIY Research Data Management Training Kit for Librarians.
Multiple Indicator Cluster Surveys Survey Design Workshop MICS Technical Assistance MICS Survey Design Workshop.
Metadata Management at GESIS-ZA Reiner Mauer GESIS – Data Archive and Data Analysis CESSDA-Expert Seminar Odense, September 11th 2008.
MANAGING YOUR DATA WELL …………………………………………
DDA and metadata handling Questions Variables Study description Adresses Administrative data related to studies.
Metadata at ICPSR Sanda Ionescu, ICPSR.
An Archive’s Perspective to DDI3 Mari Kleemola Information Services Manager Finnish Social Science Data Archive CESSDA Expert Seminar Ljubljana,
Sami Borg and Helena Laaksonen : Acquisition policies for a new data archive IASSIST2005 Edinburgh, May 2005
Access to and specifics of detailed national LFS data – the case of Slovenia Sebastian Kočar Social Science Data Archives University of Ljubljana 4th DwB.
INTER-UNIVERSITY CONSORTIUM FOR POLITICAL AND SOCIAL RESEARCH Social Science Data and Resources for Researchers Converting Legacy Documentation to DDI:
Mari Kleemola and Jouni Sivonen: Learning NESSTAR IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.
Arja Kuula: The DDI and Qualitative data IASSIST2001 Amsterdam, May 2001 Finnish Social Science Data Archive.
NESSTAR - the data archive perspective by Margaret Ward UK Data Archive.
Institute of Transport Research - Berlin-Adlershof 1 Clearing House for Transport Data & Transport Models IASSIST Strength in Numbers, Ottawa (Canada)
IASSIST 2003 Changes in the Way Data Archives Process Data Data Processing at ICPSR Darrell Donakowski.
Depositing and Disseminating Digital Resources Alan Morrison Collections Manager AHDS Subject Centre for Literature, Linguistics and Languages.
IASSIST Conference 2006 – Ann Arbor, May Metadata as report and support A case for distinguishing expected from fielded metadata Reto Hadorn S I.
Codebook Centric to Life-Cycle Centric In the beginning….
FGDC, Meet the DDI Adding Geospatial Metadata to a Numeric Data Catalog Julie Linden Yale University.
Data Management: Documentation & Metadata Types of Documentation.
CESSDA Expert Seminar CESSDA Expert Seminar Odense, 11-12/9/2008 Presentation made by Dimitra Kondyli.
Multiple Indicator Cluster Surveys Data Interpretation, Further Analysis and Dissemination Workshop Data Archiving.
Instructions and forms
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Country Practices on Census Data Archiving.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
Implementing Digital Object Identifiers at the GESIS Data Archive for the Social Sciences Workshop “Persistent Identifiers for the Social Sciences” Bonn,
Biostatistics Analysis Center Center for Clinical Epidemiology and Biostatistics University of Pennsylvania School of Medicine Minimum Documentation Requirements.
ORGANIZING AND STRUCTURING DATA FOR DIGITAL PROJECTS Suzanne Huffman Digital Resources Librarian Simpson Library.
Research data workflow Practice in Slovenian Social Science Data Archives SERSCIDA WP4 – WORKSHOP Ljubljana September 2013.
DATA MANAGEMENT SUPPORT FOR RESEARCHERS …………………………………………
1 Data Management (1) Data Management (1) “Application of Information and Communication Technology to Production and Dissemination of Official statistics”
FORMS OF COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES Sebastian Kočar (ADP, UL) First Regional Workshop – Microdata Access in.
Data management in the field Ari Haukijärvi 2nd EHES training seminar.
DLI Training April 2004 Kingston Ontario. DDI What, Why, How?
Do We Need to Preserve Research Data? Taina Jääskeläinen FSD Forskning – Arkiv – Forskning 31 May 2007.
BLAISE to DDI Vipavc Irena, ADP, Slovenia CESSDA - Seminar, September, 2004.
Metadata management: DDI and Nesstar at the Czech Social Science Data Archive Jindrich Krejci & Yana Leontiyeva Data without Boundaries, Ljubljana 24 &
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
WGISS /09/2015 DATA PRESERVATION – CNES APPROACH B. Chausserie-Laprée.
Colectica: A Platform for DDI 3 based Metadata Management Design. Collect. Share.
Analysis Introduction Data files, SPSS, and Survey Statistics.
The Data Documentation Initiative: more discussion Chuck Humphrey University of Alberta Atlantic DLI Workshop 2005, Acadia University.
COLECTICA FOR EXCEL: USING DDI LIFECYCLE WITH SPREADSHEETS NADDI 2013.
Data for secondary analysis: the experience of the UK Data Archive Hilary Beedham UK Data Archive.
The Data Documentation Initiative (DDI) Fostering Community Engagement and Adoption Breakout 9 RDA Sixth Plenary, Paris Mary Vardigan, ICPSR, University.
Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.
Ingest – Workflow Irena Vipavc Brvar ADP SEEDS Workshop I Belgrade, October.
Component D: Activity D.3: Surveys Department EU Twinning Project.
Ingest – Acquisition and deposit Irena Vipavc Brvar ADP SEEDS Workshop I Belgrade, October.
University of Colorado at Denver and Health Sciences Center Department of Preventive Medicine and Biometrics Contact:
PhD-course Research Data Management (RDM) Expert Centre Research Data.
Data Management and Archival Storage Bojana Tasić FORS SEEDS Workshop I Belgrade, October.
Karen Dennison Collections Development Manager
DIGITAL RESEARCH DATA MANAGEMENT
Data Management: Documentation & Metadata
What’s New in Colectica 5.3 Part 2
Enhancing ICPSR metadata with DDI-Lifecycle
Using DDI in Harmonizing Survey Data
Updates on the XSLT stylesheets for DDI
Metadata The metadata contains
Data Liberation Initiative (DLI)
Presentation transcript:

Hannele Keckman-Koivuniemi and Mari Kleemola : Data Processing in FSD : CHALLENGES IN A NEW ARCHIVE IASSIST2003 Ottawa, May 2003 Finnish Social Science Data Archive

5/2003 (hkk&mk) 2 General FSD established in 1999 About 400 archived studies One third of them are international FSD receives circa 100 new studies annually

5/2003 (hkk&mk) 3 Pre-Requirements Data belongs to some area in the field of social sciences Aspects of copyright and ownership are clear, no legal impediments Original purpose, information content and technical properties make data suitable for archiving

5/2003 (hkk&mk) 4 Beginning the Process Depositor delivers: –Machine-readable data (mostly SPSS or Excel) –Supplementary material (questionnaire, coding instructions, collection procedure, publications) –Completed and signed deposit forms (material description and material deposit agreement)

5/2003 (hkk&mk) 5 Working on the Data (1) FSD processes all studies INTENSIVELY in the same way –time-consuming Objective: Content of the archived data corresponds closely to the original questionnaire

5/2003 (hkk&mk) 6 Working on the Data (2) Data are checked by using SPSS and preserved in SPSS portable format: –Data and identification information (labels) in the same file –Converting possible in the future –Customers use it, too All modifications are documented in the SPSS syntax

5/2003 (hkk&mk) 7 Checking the Data (1) FSD makes a copy of the original data Number of variables and cases are reviewed FSD checks frequencies to verify variables and values - both valid and invalid

5/2003 (hkk&mk) 8 Checking the Data (2) Variables are renamed (q1, q2_1, q2_2…) and labels are created corresponding to questionnaire Filter variables are examined Some variables may have to be dropped or added

5/2003 (hkk&mk) 9 Data Protection Depositors are supposed to delete personal data before delivery Sometimes FSD stores materials which contain personal data FSD anonymizes the data according to its own and depositor’s instructions

5/2003 (hkk&mk) 10 Versions FSD aims to process datasets once and for all Some of them have to be reprocessed First final: version 1.0 Cosmetic changes: version 1.1 Significant changes: version 2.0

5/2003 (hkk&mk) 11 Documentation Finally the dataset is described FSD uses DDI Metadata are both in Finnish and English, codebooks in Finnish –Available on the Internet NESSTAR, Madiera

5/2003 (hkk&mk) 12 Challenges for the Future (1) Introducing processing levels –what is the minimum level that enables preservation Getting supplementary documentation –lack of sufficient documentation delays the archiving process Version control –what to do with the original dataset and how to document changes

5/2003 (hkk&mk) 13 Challenges for the Future (2) CATI and CAPI versus survey Downloading the data through online- system Long term preservation of electronic documents –we are not alone here!

5/2003 (hkk&mk) 14 Contact Information Finnish Social Science Data Archive FIN UNIVERSITY OF TAMPERE FINLAND Tel Fax