The CERA2 Data Base Data input – Data output Hans Luthardt Model & Data/MPI-M, Hamburg Services and Facilities of DKRZ and Model & Data Hamburg,

H. Luthardt (M&D/MPI-M, Hamburg) / 2 Data Input

H. Luthardt (M&D/MPI-M, Hamburg) / 3 Including data into CERA Data sets from users can be included into the data base and made accessible (by internet) Inclusion is done by Model & Data if following conditions are met: data are of general interest data should become available to a broader community data size is small relative to the data archive size a complete set of meta data (fitting the CERA standard) must be provided

H. Luthardt (M&D/MPI-M, Hamburg) / 4 Store data data:data must be provided in a structure that can be transferred into the data base without further processing meta data: XML-files for the experiment and each of the data sets must be provided XML-templates are available from : or

H. Luthardt (M&D/MPI-M, Hamburg) / 5 Preferred storage structure for 3-d gridded data: single variable single level time series grib formatted / netCDF formatted (/ others) Data structures Application related data structure (2-D) (180 KByte/blob) original data structure (4-D) (3 MByte/blob)

H. Luthardt (M&D/MPI-M, Hamburg) / 6 Retrieve data sets

H. Luthardt (M&D/MPI-M, Hamburg) / 7 Retrieve data sets Database content: 220 TByte data volume 650experiments data sets Database content: 220 TByte data volume 650experiments data sets

H. Luthardt (M&D/MPI-M, Hamburg) / 8 Data and Meta data CERA Metadata Model

H. Luthardt (M&D/MPI-M, Hamburg) / 9 Search strategies Keyword Project Experiment Dataset Information Download Variable specific Dataset (by name) Postprocessing Code

H. Luthardt (M&D/MPI-M, Hamburg) / 10 Access to the data base Access to the CERA data base: by java servlet - using an internet browserjava servlet by java applet (java runtime required) - obselet!java applet by java command line tool (jblob )jblob Unrestricted browsing for meta data User account required for data download Start:

H. Luthardt (M&D/MPI-M, Hamburg) / 11 Access to the data base Retrieval by script : Java based – for Unix / Linux and Windows http and JDBC connection examples : jblob –datasetname -options jblob –datasetid -options jblob –showdatasets ” ” (% as wildcard)

H. Luthardt (M&D/MPI-M, Hamburg) / 12 Access to the data base Access to the CERA data base: by java servlet - using an internet browserjava servlet by java applet (java runtime required) - obselet!java applet by java command line tool (jblob )jblob Unrestricted browsing for meta data User account required for data download Start:

H. Luthardt (M&D/MPI-M, Hamburg) / 13 Access to the data base Access by java applet: (obsolet!) e.g. hierarchical topic search

H. Luthardt (M&D/MPI-M, Hamburg) / 14 Browse/Retrieve Metadata see wini.wdc-climate.de Metadata access via WWW: xsql query to DB xml output from DB xsl mapping to any metadata format raw xml xhtml ISO xml DC xml... various metadata formats http: XML xsl – mappi ng xsql –query lnternet Applicati on Server request: URL user applications

H. Luthardt (M&D/MPI-M, Hamburg) / 15 dynamic html pages http: html Servlet / JSP lnternet Applicatio n Server web browser Catalogue access via WWW URL parsed by JSP integrated DB retrieval by JSP response in standard html efficient administration of detailed meta information request: URL Access to the data base

H. Luthardt (M&D/MPI-M, Hamburg) / 16 Search for data The servlet interface currently allows search for: Project – experiment – data set (keyword) Data set names (or part of it) Data set associated with codes

H. Luthardt (M&D/MPI-M, Hamburg) / 17 Hierarchical search for data sets Project Experiment data set keywords

H. Luthardt (M&D/MPI-M, Hamburg) / 18 Access to the data base Access to the CERA data base: by java servlet - using an internet browser by java applet (java runtime required) - obselet! by java command line tool (jblob) Unrestricted browsing for meta data User account required for data download Start:

H. Luthardt (M&D/MPI-M, Hamburg) / 19 Search for data (hierarchical)

H. Luthardt (M&D/MPI-M, Hamburg) / 20 Search for data (hierarchical)

H. Luthardt (M&D/MPI-M, Hamburg) / 21 Search for data (hierarchical)

H. Luthardt (M&D/MPI-M, Hamburg) / 22 Search for data (hierarchical) Experiment decsription

H. Luthardt (M&D/MPI-M, Hamburg) / 23 Search for data (hierarchical) List of data sets

H. Luthardt (M&D/MPI-M, Hamburg) / 24 Search for data (hierarchical) Data set description

H. Luthardt (M&D/MPI-M, Hamburg) / 25 Search for data (hierarchical) Data set description: data organisation

H. Luthardt (M&D/MPI-M, Hamburg) / 26 Download data sets x Selecting data set for download (login required)

H. Luthardt (M&D/MPI-M, Hamburg) / 27 Search data sets (by Code)

H. Luthardt (M&D/MPI-M, Hamburg) / 28 Search data sets (by Code) Specifying code table

H. Luthardt (M&D/MPI-M, Hamburg) / 29 Search data sets (by Code) Specifying code number

H. Luthardt (M&D/MPI-M, Hamburg) / 30 Search data sets (by Code)

H. Luthardt (M&D/MPI-M, Hamburg) / 31 Search data sets (by dataset name)

H. Luthardt (M&D/MPI-M, Hamburg) / 32 Search data sets (by dataset name) Specifying name elemets

H. Luthardt (M&D/MPI-M, Hamburg) / 33 Search data sets (by dataset name)

H. Luthardt (M&D/MPI-M, Hamburg) / 34 Download data sets

H. Luthardt (M&D/MPI-M, Hamburg) / 35 Download data sets Process list: initiating data download

H. Luthardt (M&D/MPI-M, Hamburg) / 36 Download data sets Specifying time range for download

H. Luthardt (M&D/MPI-M, Hamburg) / 37 Download data sets Specifying processing options

H. Luthardt (M&D/MPI-M, Hamburg) / 38 Download data sets Starting download

H. Luthardt (M&D/MPI-M, Hamburg) / 39 Contact URLs: M&D : Data Base Portal : WDCC :