Global Argo Data Repository Status Report for 2009 Charles Sun US National Oceanographic Data Center 10 th Argo Data Management Team Meeting 30 September – 2 October 2009, Toulouse, France

2 Highlights of Activities Continued daily operations of the GADR. Continued daily operations of the GADR. Performed an automated procedure of “mirroring” a local Argo data set in sync with the Argo GDAC server at Monterey, CA. Performed an automated procedure of “mirroring” a local Argo data set in sync with the Argo GDAC server at Monterey, CA. Implemented an automated procedure for acquiring the CLIVAR & Carbon Hydrographic Data Office (CCHDO) data from the Web for archive accession. Implemented an automated procedure for acquiring the CLIVAR & Carbon Hydrographic Data Office (CCHDO) data from the Web for archive accession. Produced monthly archives of the Argo data archived at the NODC and populated them at Produced monthly archives of the Argo data archived at the NODC and populated them at Identified the deficiency of the Argo NetCDF format convention and developed a strategy for improving the Argo convention in compliance with the Climate and Forecast (CF) metadata convention. Identified the deficiency of the Argo NetCDF format convention and developed a strategy for improving the Argo convention in compliance with the Climate and Forecast (CF) metadata convention.

3 GADR Web Server Statistics Monthly average of requests (files): Monthly average of requests (files): – 595,908 in 2007 –1,021,903 in 2008 –1,006,767 in 2009 * Monthly average of data download: Monthly average of data download: –23.55 GB in 2007 –42.41 GB in 2008 –54.57 GB in 2009 * *ending August 2009

4 Argo User data and File Type Report extensaion # reqs % reqs % bytes # reqs % reqs % bytes.txt903, ,133, nc5,383, ,402, tgz111, , kmz , htm648, ,032, total7,223, GB12,279, GB

5 Argo Monthly Archives Web Site

6 Argo NetCDF Format Issue The Geographic Coordinate System is not well-defined in the Argo individual profile NetCDF format file. The Geographic Coordinate System is not well-defined in the Argo individual profile NetCDF format file. The Argo NetCDF convention is not in compliance with the CF (Climate and Forecast) metadata convention. The Argo NetCDF convention is not in compliance with the CF (Climate and Forecast) metadata convention. The CF (and COARS) NetCDF convention suggests: The CF (and COARS) NetCDF convention suggests: Any 4-dimensional data should have four coordinates (axes), "date or time" (a.k.a. "T"), "height or depth" (a.k.a. "Z"), "latitude" (a.k.a. "Y"), or "longitude" (a.k.a. "X"). Any 4-dimensional data should have four coordinates (axes), "date or time" (a.k.a. "T"), "height or depth" (a.k.a. "Z"), "latitude" (a.k.a. "Y"), or "longitude" (a.k.a. "X"). Order of dimensions: If any or all of the dimensions of a variable have the interpretations of "date or time“, "height or depth" "latitude”, or "longitude" then those dimensions should appear in the relative order T, then Z, then Y, then X in the CDL definition corresponding to the file. Order of dimensions: If any or all of the dimensions of a variable have the interpretations of "date or time“, "height or depth" "latitude”, or "longitude" then those dimensions should appear in the relative order T, then Z, then Y, then X in the CDL definition corresponding to the file. The dimension name of each coordinate variable should be the same as its variable name, i.e., time(time), depth(depth), latitude(latitude), and longitude(longitude). The dimension name of each coordinate variable should be the same as its variable name, i.e., time(time), depth(depth), latitude(latitude), and longitude(longitude).

7 What do we have in the Argo NetCDF format files? netcdf R _058 { dimensions: DATE_TIME = 14 ; … ; N_PROF = 1 ; N_PARAM = 3 ; N_LEVELS = 454 ; N_CALIB = 1 ; N_HISTORY = UNLIMITED ; // (2 currently) variables: double JULD (N_PROF) ; JULD:long_name = “…" ; float PRES(N_PROF, N_LEVELS) ; PRES:long_name = “…" ; float TEMP(N_PROF, N_LEVELS) ; TEMP:long_name = “…”; float PSAL(N_PROF, N_LEVELS) ; PSAL:long_name = “…." ; … data: JULD = ; LATITUDE = ; LONGITUDE = ; PRES = 2.0, 4.0, 6.0, … TEMP = , , , … PSAL = , , ,...

8 What’s the Issue? Annoying and Inconvenient! Use a generic NetCDF browser, “ncBrowse”, to illustrate the Argo NetCDF format issue.

9

10 Profile Plot Comparison Original Format Profile PlotModified Format Profile Plot

11 Suggestions of Format Changes (shown in red) netcdf R _058_mod { dimensions: DATE_TIME = 14 ; … ; N_PROF = 1 ; N_PARAM = 3 ; N_LEVELS = 454 ; N_CALIB = 1 ; N_HISTORY = UNLIMITED ; // (2 currently) TIME = 1 ; PRES = 454 ; LONGITUDE = 1 ; LATITUDE = 1 ; variables: double JULD (N_PROF) ; double TIME(TIME) ; float PRES(N_PROF, N_LEVELS) ; float PRES(PRES) ; float TEMP(N_PROF, N_LEVELS) ; float TEMP(TIME,PRES,LATITUDE,LONGITUDE) ; float PSAL(N_PROF, N_LEVELS) ; float PSAL(TIME,PRES,LATITUDE,LONGITUDE) ; …

12 Other Suggestions for Improvements Spell out whole variable names, such as “pressure” instead of “PRES”, “temperature” or “sea_temperature” instead of “TEMP” etc. Spell out whole variable names, such as “pressure” instead of “PRES”, “temperature” or “sea_temperature” instead of “TEMP” etc. Use lower case for all variable names. Use lower case for all variable names.

13 Future Plan Continue GADR operations. Continue GADR operations. Continue to acquire the CCHDO data via the Internet on a quarterly basis. Continue to acquire the CCHDO data via the Internet on a quarterly basis. Continue to populate the Argo data archives on a monthly basis. Continue to populate the Argo data archives on a monthly basis.

14 Comments & Questions

15 Background

16 GADR Functions – 1 Archive profiles, metadata, trajectory and technical information received from the US GDAC on a monthly basis. Archive profiles, metadata, trajectory and technical information received from the US GDAC on a monthly basis. Provide offsite storage of data. Provide offsite storage of data. Provide usage statistics, data system monitoring information and problem reporting facility. Provide usage statistics, data system monitoring information and problem reporting facility.

17 GADR Functions – 2 Provide hardcopy data sets for distribution to users. Provide hardcopy data sets for distribution to users. Provide tools to allow transformation of Argo NetCDF data into other forms. Provide tools to allow transformation of Argo NetCDF data into other forms. Provide data integration tools to allow client to get Argo float data combined with data collected with other instruments. Provide data integration tools to allow client to get Argo float data combined with data collected with other instruments.