1. Russian Academy of Sciences
Data Management in the World Data Centers for Solar-Terrestrial Physics and Solid Earth Physics
Natalia Sergeyeva
Director, WDCs for STP & SEP, Moscow, Russia
Geophysical Center of the Russian Academy of Sciences
1st GEO Data Providers Workshop
GEO-XIII Plenary, St. Pretersburg
7-10 November 2016

2. Solar-Terrestrial Physics
Multidisciplinary Centers
World Data Center for
Solar-Terrestrial Physics
World Data Center for
Solid Earth Physics
Geomagnetic Variations
Ionospheric Phenomena
Solar Activity and
Interplanetary Medium
Cosmic Rays
Seismology
Gravimetry
Geomagnetism –
Main Magnetic Field
Heat Flow
Application forms, Review procedure, Agreements with ICSU
2012
Regular Members
of the ICSU-World Data System.
, GEO XIII SE

3. WDC’s Functions, Data Management
Data collection
2012
WDCs provide full and open access to data.
WDCs provide data to scientists free of charge or at a cost not to exceed the cost of copying and sending the requested data.
WDCs operate … for the benefit of the international scientific community and provide a mechanism for international exchange of data
analysis, quality control, processing
metadata
covering documents
Data Long-term storage
archiving,
data maintenance
Data dissemination
ensure access to data,
publication on site,
services for users, promotion
, GEO XIII SE

4. WDS Data Sharing Principles
WDS aspirations are formulated in the Data Sharing Principles:
Universal and equitable access to quality-assured
scientific data, services, products and information,
Long-term data stewardship,
Compliance with agreed-upon data standards and conventions,
Providing mechanisms to facilitate and improve access to data.
In light of these positions and the certification criteria WDCs change and improve data management.
The Centers are concentrated on four new directions.
, GEO XIII SE

5. 1. Increase of data available in network
In order to expand the information resources in electronic form, to preserve valuable historical data and make them more accessible for use Centers carry out the Project “Digital Preservation of Data”.
The project aims to convert data on paper into electronic form and to create a database for public use.
It is planned to convert more than printed or handwritten paper documents with data from the observatories of Russia and adjacent CIS countries: (From to present)
- Magnetic activity K-index,
- Tables of mean hour values ​​of the geomagnetic field,
Ionospheric vertical sounding data.
Currently, about 150 000 documents are already converted and nearly half of them are in free access on the WDC for STP website.
, GEO XIII SE

6. Digital Preservation of Data
A book scanner with A3 table is used for making copies of documents in PDF format with good resolution
PDF document is checked and edited with
the special software.
After that it is placed on the website in open access
Paper document
Special procedure for the conversion of PDF document into a digital ASCII data file is developed
PDF format
Digital data as ASCII files
fills gaps in existing data sets
, GEO XIII SE

7. 2. DOIs for Data Publication and Citation
Data are considered as valuable results of scientific research
and should be cited as other scientific sources of information.
Recommendations of the ICSU-WDS, CODATA, FORCE11, DataCite, CrossRef
WDC for Solar-Terrestrial Physics launches the new Project “Earth Science DataBase“.
The Project focuses on creation of a modern system of registration and publication of data by assigning a digital object identifier DOI, and promotion of a culture of data citation.
Use of DOI allows users easier access to necessary data and promotes intensive use of data.
Metadata base including detailed description of data and information about producer and publisher is formed.
The object with the assigned DOI is registered in the CrossRef system.
, GEO XIII SE

8. Website of the Central Repository
esdb.wdcb.ru
, GEO XIII SE

9. DOI for Database and Datasets
DOI: /Mag-Variations-Database
Database
Earth’s magnetic field variations
Dataset 1
Vostok (VOS) Minute Values
Dataset 22
Mirny (MIR)
Minute Values
Dataset 2
Moscow (MSK)
Minute Values
DOI: /Mag-MSK-minute-values
Dataset 3
Heiss Isl. (HIS)
Minute Values
Dataset 15
Irkutsk (IRT)
Minute Values
DOI: /Mag-HIS-minute-values

10. Response Pages of DataBase & Dataset
DOI
Response Pages are placed in the Central Repository
URL for downloading
, GEO XIII SE

11. , GEO XIII SE

12. 3. DataBases instead of file system
Request Form for Information on
Earthquakes in Northern Eurasia
Output
formats:
txt
csv
Seismological DataBase
~ events, ~ 2 GB
, GEO XIII SE

13. Geomagnetic DataBase Output formats: WDC CSV IAGA 2002 Minute,
mean hour,
annual mean values
of magnetic field elements,
K - index values.
40-50 observatories of Russia and CIS countries
from to present
, GEO XIII SE

14. 4. Participation in WDS Metadata Catalogue & Data Portal
WDS Open Metadata Catalogue is created - a unified resource that aggregates metadata of WDS’s members and ensure the discovery of data and access to datasets.
It’s necessary for WDS Data Portal which will provide access to currently available metadata catalogues using international and community agreed standards.
Repository
of metadata:
DIF format,
XML language,
compatible with
ISO19115 standard.
OAI-PMH Protocol
Russian
WDCs
, GEO XIII SE

15. Participation in WDS Metadata Catalogue & Data Portal
Example of Data Search
Searc result
Inquiry form contains request for earthquake data
of Caucasus region
, GEO XIII SE

16. WDC for STP and WDC for SEP Projects
Increase of data available in network by retrospective data collection and digital preservation of data;
Creation of a modern system of registration and publication of data by assigning a digital object identifier DOI, the introduction of the practice of citing data;
Creation of databases instead of file system for more convenient access to data.
Participation in WDS Metadata Catalogue and Data Portal, creating metadata with descriptions of information resources. .
, GEO XIII SE

17. WDC for STP and WDC for SEP Projects
Implementation of these projects contributes to:
integration of WDC’s information resources into the World Data System,
ensuring of convenient access to a greater number of geophysical data stored in the Сenters,
transformation of WDC’s repositories to international standards for possibility of sharing them.
, GEO XIII SE

18. Thank you for listening!
, GEO XIII SE