1. Every bit counts Data management and data publication in the earth sciences Jens Klump et al. International Data Exchange Workshop Kiel, 10 May 2007

2. Autors Jens Klump 1, Robert Huber 2, Jan Brase 3, Michael Diepenbroek 2, Hannes Grobe 4, Beate Hildenbrand 5, Heinke Höck 6, Michael Lautenschlager 6, Uwe Schindler 2, Irina Sens 3 and Joachim Wächter 1 1. GFZ Potsdam (proposed WDC-TERRA) 2. WDC-MARE, Univ. Bremen 3. TIB Hannover (Nat. Lib. Sci. & Tech. Germany) 4. WDC-MARE, AWI Bremerhaven 5. WDC-RSAT, DLR-DFD Oberpfaffenhofen 6. WDC-Climate, MPI-MET Hamburg

3. Data publication today

4. Use of Published Data Often, the source of data is not acknowledged. No citation of the data source. The data source needs to be deduced from the paper. No Metadata.

5. Data in the publication process today Manuscript Publication Library DataMetadata Private Files After Helly et al. (2003)

6. The consequences Most data remain underutilised because they are not accessible. → Unnecessary duplication Research results cannot be verified. → Falsification of results. Calls to make data accessible and share data were welcomed but did not give any results.

7. Why are data not made accessible? Data publication is hampered by structural barriers in the publication process: Journals do not devote space to data tables due to economic constraints and have no interest in archiving data. Authors do not receive professional recognition for publishing data because the datasets cannot be cited in a reliable way. Data are not cited because their location (URL), in many cases, is transient.

8. Necessary steps Data need to be citeable to be “valuable”. “Reputation” is the currency of science. Authors will only prepare data for publication if the effort is worthwhile. Data publication is labour intensive. Data must be accessible to be re-used. Access through persistent identifiers and long-term archives. Existence of data must be known. Dissemination of metadata to catalogues and portals. Intellectual property rights need to be secured. Authors need full control of their publications.

9. Project “Publication and Citation of Scientific Primary Data” Funded by the German Science Foundation. Project partners: German Nat. Lib. Science and Technology (Hannover) WDC-MARE (Bremen/Bremerhaven) WDC Climate (Hamburg) GFZ Potsdam (proposed WDC-TERRA) WDC-RSAT (Oberpfaffenhofen) Implementation of services for the publication of data. DOI registration agency at German National Library for Science and Technology (TIB Hannover). To date 6 DOI registration agents. Inclusion of data publications into library catalogues.

10. What is a DOI? DOI = Digital Object Identifier, a persistent, digital identifier of an object. DOI = Name of object, URL = Location of object. The location may change, the name persists, irrespective of the location of the object.

11. STD-DOI System Architecture

12. Example Data Publication TIBORDER catalogue of the German National Library of Science and Technology. TIBORDER doi:10.1594/GFZ.SDDB.1043 at the ICDP Scientific Drilling Database. doi:10.1594/GFZ.SDDB.1043

13. TIBORDER / GBV Catalogue

14. ICDP Scientific Drilling Database

15. Data Syndication Many available data remain underutilised because their existence is not known. Metadata can be harvested and indexed by data portals using OAI-PMH or RSS. Both OAI-PMH and RSS can be used to carry discipline specific metadata. Examples: PANGAEA Data Portals (OAI-PMH) Open Geospatial Consortium GeoRSS Portals can provide specific views on existing data.

16. DOI metadata The STD-DOI metadata are mainly Dublin Core elements, plus system specific elements. The metadata transmitted to the National Library via web service (HTTP/SOAP) and incorporated into the library catalogue. The metadata may contain references to other objects. Element isCitedBy, isDuplicateOf, isAlsoPublishedAs, …

17. External Semantics The element can be used to point to other electronic objects: Point to the literature where the data set is interpreted. Point to samples, from which the data were derived. Point to other datasets that belong to the same collection of datasets. Improve data discovery. SDDB Data SESAR (in prep.) Sensor Registry (in prep.) Literature Pangaea doi hdl IODP SEDIS doi

18. Information Discovery Link to publication Citation of data IGSN points to sample

19. SDDB Metadata Management Management of Metadata is kept simple by offering a data upload assistant. Data upload process is styled in analogy to eBay sales upload assistant. Most metadata are in the system already.

20. Internal Semantics SDDB metadata are held in a fully normalised relational database. SDDB metadata are fully browseable to allow iterative search. SDDB has (so far) no full-text search. Projects and Expeditions Locations Authors Datasets Measured Parameters Sampling Gear

21. Putting data into context Parameters are organised in a tree-structure. Homonyms are allowed – the parameter tree is ordered according to scientific context.

22. The spatial dimension Will soon be supplemented by OGC Web Services.

23. SDDB Plans for 2007/2008 Integration of GSI components (deegree2). Introduction of links to IGSNs. Migration of web frontend from PHP to Java/JSP/JSR168. Introduction of Fedora Repository as middleware to integrate data, publications and services.

24. More Information Project “Publication and Citation of Scientific Primary Data” http://www.std-doi.de ICDP Scientific Drilling Database http://www.scientificdrilling.org Thank you! This work is licensed under a Creative Commons by Attribution 2.0-de License.Creative Commons by Attribution 2.0-de License