Presentation on theme: "DLI Training Nesstar Workshop Ernie Boyko, Carol Perry Ontario DLI Training University of Guelph, Guelph, ON April 10-11, 2006."— Presentation transcript:
DLI Training Nesstar Workshop Ernie Boyko, Carol Perry Ontario DLI Training University of Guelph, Guelph, ON April 10-11, 2006
DDI Refresher What, Why, How?
Data Documentation Initiative The Data Documentation Initiative is an international effort to establish a standard for technical documentation describing social science data http://www.icpsr.umich.edu/DDI/index.ht ml http://www.icpsr.umich.edu/DDI/index.ht ml
DTD - Document Type Definition Consists of a Tag Library Tags have been developed by DDI A set of tags, when filled, are known as a codebook DDI – intends to comply to Dublin Core
Tags Tags present English language descriptions of XML (eXtensible Markup Language) Each tag can be optional or mandatory, repeatable or non-repeatable Set of tags for each section of DTD
5 Sections of DTD ( Document Type Definition ) 1.0 Document Description 2.0 Study Description 3.0 Data File Description 4.0 Variables Description 5.0 Other Study Materials
Document Description Bibliographic description of the DDI document itself, otherwise known as a marked-up codebook
Study Description Describes Study or Survey Includes title, abstract, keywords, author, publisher, collection methods, etc.
Data File Description Contains information describing the data file Includes file name, file type, case quantity, logical record length, total number of records, etc.
Variables Description Describes each variable Includes variable label, values, value label, question, summary statistics, etc.
Other Study Materials Includes documentation files in a variety of formats: pdf, excel, word, etc. Includes codebooks, questionnaires, user guides, variability tables, etc.
Fast forward … What has been done since 2004…
DLI Training 2005 The group tagging workshop
CANDDI Tag working group Michelle Edwards - UG Marie-Joseè Bourgeois – DLI Irene Wong – RDC UA Jane Fry – Carleton U
DINO Dec 2005 Questions for the Group Sharing the metadata xml files What sections of DDI should be included in the exchange? All five sections? Select sections?
How do we choose the tags? Preliminary set put together by U of Guelph in consultation with DLI staff Carleton, Guelph, DLI team using same set of tags Revision 4 was distributed to CANDDI tag team in Dec 2005 Work in progress
How do we fill the tags? DDI document occasionally vague Dublin Core tags –mandatory Do we fill these tags using examples from DDI document? How do we build consistency?
Example – Study title Examples from DDI documentation: 188.8.131.52 Title Domestic Violence Experience in Omaha, Nebraska, 1986-1987 Census of Population, 1950 [United States]: Public Use Microdata Sample Monitoring the Future: A Continuing Study of American Youth, 1995
How would a cataloguer do it? Domestic violence experience in Omaha, Nebraska, 1986-1987 Census of population, 1950 [United States]: Public use microdata sample Monitoring the future: A continuing study of American youth, 1995
Balance Between structure of DDI and need to co-ordinate with cataloguing rules
How do we decide … What is the right way to fill a tag for our needs Some tags require consensus on how they should be filled
Example 184.108.40.206 Description: Unique string or number (producers or archives number) for the data collection. An agency attribute is supplied.
Choices – StatCan data Bibliocat – pre-2000 surveys Statcan catalogue SDDS survey number in IMDB
Which choice is right for us? Survey of Household Spending ID 62M0004 62M0004XCB 3508
Another decision, same tag Year must be added after IDNo to distinguish files 3508-2000 What is appropriate separator? –, / : ; Will any cause problems later on?
Other study-related material 2.5 Other Study Description Materials 5.0 Other Study-related Materials
2.5 may include: appendices, sampling information, weighting details, methodological and technical details, publications based upon the study content, related studies or collections of studies, etc
How do we identify them? By catalogue number What if they are on-line publications Link to pdf? Link to dsp site? Link to StatCan catalogue page Link to them in our own collection
5.0 may include: questionnaires, coding notes, SPSS/SAS/Stata setup files (and others), user manuals, sample computer software programs, glossaries of terms, interviewer/project instructions, maps, database schema, data dictionaries, coding information, interview schedules, missing values information, frequency files, variable maps, etc
We need to collaborate… How do we decide as a group what we want How do we articulate our reasons for making the decision