4 Metadata at ICPSR -Catalog Records- Review and approval by metadata specialistStored in ORACLE databaseExported from database to DDI 2.1 XMLXML files stored on server (file system)HTML and PDF presentation created dynamically (through XSLT stylesheets) at user requestHTML presentation for viewing only; PDF is downloadable
5 Metadata at ICPSR -Catalog Records- DDI-XML files searched by field from home page to retrieve studies (Inktomisearch)
6 Metadata at ICPSR -Codebooks- HERMES – in-house automated process to generate (most of) the study distribution package:Input:SPSS system or portableOptional pre-formatted (question) text fileOutput:Full suite of statistical formats (setups and system)ASCII data fileDDI 2.1 file with frequencies and question text if available
8 Metadata at ICPSR -Codebooks- DDI 2.1 file may be converted to PDF to generateAn “ICPSR” codebookPart of the publicly distributed codebook as other non-DDI resources may be incorporatedIn some instances a DDI-based codebook will not be generated
9 Metadata at ICPSR -Codebooks- The DDI 2.1 file with variables descriptionIs archivedIs downloaded into the Social Science Variables Database (SSVD)
10 Metadata at ICPSR Social Science Variables Database Also built in ORACLE, but currently a separate entity, with links to studies’ and series’ descriptions.Includes variable-level metadata.Is DDI 2.x and 3.0 compliant (input and output)Will enable variable-level searches across studies and series of studies (simple SQL queries - retrieve matches, do not infer relevance)
11 Integrating DDI 3 into Archives SRO-ICPSR collaboration project SAS/SPSS/StatafilesOther…DDI 3.0BlaiseoutputDDI 2.xCommon RELATIONAL DATABASEmodel for data documentation- Compliant with DDI 3.0 -Emphasize – this is BY NO MEANS a presentation of the project which is obviously a lot more complex – but rather an over- simplification meant to illustrate the value of having a common (data) storage model based on a commonly used standard.So there will actually be two physical databases but built on a shared model and DDI 3- compliant.The databases will accept a variety of input formats – Blaise output (generated at SRO) , statistical formats, and both versions of DDI.The database content will then be used to build a variety of applications.One such application is the cross-study variable level search that ICPSR will provide on its Web site, and for which we currently use DDI2 files with question text added manually in most cases.But when the project is finalized and the databases are functional,ICPSR will also be able to use variable descriptions as generated from Blaise, that already include desirable information – like question text.So this is how the - Use of common database model – based on a commonly adopted standard – will thus make it possible for one application to use information that otherwise would have been unavailableClient Applications…Web Applications…ICPSR: Variable-level SearchICPSR projects will be able to use documentation generated by SRO projects…
12 Metadata at ICPSR -Online analysis- Survey Documentation and Analysis (SDA)Approx. 475 studies – data and documentation in proprietary format (ddl), DDI 2.x-compatible.Nesstar - used only as a “test” (currently not in production mode)https://www.icpsr.umich.edu/ICPSR/access/sda.html
13 Metadata at ICPSR Other study documentation QuestionnairesUser guidesData definitionsDistributed in machine-readable, but non-searchable formats – PDF, ASCII, Excel, etc.
Your consent to our cookies if you continue to use this website.