1. Dissemination of Data and Data Banks Work Package I
by Joan Ramon Coll 1
Linden Ashcroft 1 ,2, Manola Brunet 1,3, Alba Gilabert 1 and Olga Alegria 1
1. Centre for Climate Change (C3), Geography Department, University Rovira i Virgili, Vila-seca, Catalunya
2. The Australian Bureau of Meteorology, Melbourne, Australia
3. Climate Research Unit, School of Environmental Sciences, University of East Anglia, Norwich, United Kingdom
UERRA General Assembly, GA 2017 and Review Meeting, November 2017, URV, Tarragona, Catalunya

2. 2. Data files structure for dissemination
Contents
1. Introduction
2. Data files structure for dissemination
3. Status of Data delivery to relevant partners and recipients
4. Data Banks (ECA&D, GPCC, ISPD, CEDA…)

3. 1. Introduction UERRA’s digitisation effort; ~9M of new observations
Mainly spatial infilling over data-sparse sub-regions: Southern part of Med, Eastern Europe & Balkans
Variables: SLP, TMP, WS, WD, RH, DP, SD, FS, RR at the hourly and daily scales
Mostly for the post-1950, but also pre-1950

4. 2. Data files structure for dissemination Table 1; Example of Data files
It is crucial to retaining all versions of the data, from the original images to the raw keyed data, through all of the quality control iterations and any conversions applied to ensure provenance and traceability.
Several versions of the recovered data are given in one file:
Original values
Values subjected to QC
Values converted to SI units.
Detailed metadata on temporal availability of each variable for each station, the conversion methods used, and the location of the original data source are also provided.

5. 2. Data files structure for dissemination Table 2; Example of Metadata files

6. 2. Data files structure for dissemination Table 3; List of conversions applied to digitised data, where x represents the original unit and y is the converted value.
Original units
Final units
Details
Wind speed conversions
Beaufort scale
m/s
replacement of x with y using the following map: 0=0 1=1 2=2.6 3=4.6 4=6.7 5=9.3 6=12.3 7=15.4 8=19 9= = = =35, from WMO Code 1100
Turkish 17-point power scale
replacement of x with y using the following map: 0=0 1=0.9 2=2.4 3=4.4 4=6.7 5=9.3 6=12.3 7=15.5 8=18.9 9= = = = = = = = =58.6 taken from data source (average of wind range used)
9 point power scale
replacement of x with y using the following map: 0=0 1=1 2=2.6 3=4.6 4=6.7 5=9.3 6=12.3 7=15.4 8=19 9=28.8, from 1931 French instruction book
km/h
y=x/3.6 rounded to 1 decimal place
knots
y=x* rounded to 1 decimal place
Wind direction conversions
16 point compass scale
degrees
replacement of x with y using the following map: C=0 NNE=22.5 NE=45 ENE=67.5 E=90 ESE=112.5 SE=135 SSE=157.5 S=180 SSW=202.5 SW=225 WSW=247.5 W=270 WNW=292.5 NW=315 NNW=337.5 N=360
32 point direction scale
y=x*11.25
degrees/10
y=x/10.0
Pressure conversions
mmhg
hPa
y=x* rounded to 2 decimal places
hpa*10
y=x/10
Temperature conversions
degF
degC
y=(x-32)*(5/9) rounded to 2 decimal places

7. 2. Data files structure for dissemination
WMO recommendations to derive daily means/sums from sub-daily observations
Example of the methodology applied

8. 3. Status of data delivery to relevant partners and recipients
Data recipient
Data delivered
Delivery status
UERRA WP2 (UK Met Office, MeteoFrance)
All available subdaily data
Delivered
UERRA WP3 (DWD)
UERRA WP4 (KNMI)
All available subdaily data and daily averages and totals
ECA&D system
GPCC
All available daily and subdaily precipitation data
NMSs that provided data sources for digitisation (MeteoCat, Slovenian Environmental Agency and DWD)
All data digitised from the sources provided
ISPD
ISTI & STFC/CEDA
NCEI
UK-MO HadISD
MARS archive
All available subdaily quality-controlled data
Delivered through STFC/CEDA
NMSs in countries for which data have been rescued
All available subdaily quality-controlled data for each country
In progress
UK Met Office: UK’s National Weather Service
MeteoFrance: Service Officiel de la Météorologie et de la Climatologie en France
DWD: Deutscher Wetterdienst
KNMI: Koninklijk Nederlands Meteorologisch Instituut
ECA&D: European Climate Assessment & Dataset
GPCC: Global Precipitation Climatology Centre
Meteocat: Servei Meteorològic de Catalunya
ISPD: International Surface Pressure Databank
ISTI: International Surface Temperature Initiative
STFC/CEDA: Science and Technology Facilities Council/Centre for Environmental Data Analysis
NCEI: National Center for Environmental Information
UK-MO HadISD: UK Meteorological Office Hadley Centre Hourly dataset
MARS: Meteorological Archival and Retrieval System
URV’s Chancellor in contact with WMO General Secretary

9. 4. Data Banks: ECA&D (European Climate Assessment & Dataset)
Station-based dataset
series of observations across Europe and Mediterranean.
Daily and sub-daily data.
63 countries.
12 elements (TX, TN, TG, SS, SD, RR, PP, HU, FX, FG, DD and CC).
78% of daily series can be downloaded from the website.
E-OBS daily gridded observational dataset
Elements; Precipitation, temperature and sea level pressure across Europe based on ECA&D information.
Period covered; /
Maintained and elaborated as part of the UERRA Project.

10. 4. Data Banks: GPCC (Global Precipitation Climatology Centre)
The GPCC provides gridded gauge-analysis products derived from quality controlled station data
Two products are for climate:
The Full Data Reanalysis Product ( ); Recommended for global and regional water balance studies, calibration/validation of remote sensing based rainfall estimations and verification of numerical models.
The VASClimO 50-year Dataset; Recommended for climate variability and trend studies.
Number of stations per grid (May 2012)
Precipitation in mm/month (May 2012)

11. 4. Data Banks: ISPD (International Surface Pressure Databank)
ISPD: The world’s largest collection of pressure observations.
Temporal coverage:
Elements: Sea level pressure and Surface pressure.

12. 4. Data Banks: CEDA (Centre for Environmental Data Analysis)
The mission of the CEDA is to deliver long term curation of scientifically important environmental data at the same time as facilitating the use of data by the environmental science community.
The CEDA Archive accepts data relevant to Atmospheric Sciences and Earth Observation fields. Data must be well formatted and have appropriate documentation.
JASMIN storage
JASMIN is a custom integrated data intensive super-computer providing four main functions: storage, batch computing, managed infrastructure compute and a private cloud to provide infrastructure as a service.
Data requirements:
Create a JASMIN account for registration.
Formatting data for archival.
Suitable metadata files…

13. Email: joanramon.coll@urv.cat
Thank you!!