Presentation is loading. Please wait.

Presentation is loading. Please wait.

Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Multi-file Data Aggregation with Ocean Data View.

Similar presentations


Presentation on theme: "Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Multi-file Data Aggregation with Ocean Data View."— Presentation transcript:

1 Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Multi-file Data Aggregation with Ocean Data View

2 SDN Data Retrieval… may yield a large number of zip files may yield a large number of zip files each zip file may contain a potentially large number of individual data files each zip file may contain a potentially large number of individual data files the type of data and set of variables may differ from file to file the type of data and set of variables may differ from file to file Challenge: While all individual data files are in ODV spreadsheet format the large number of files and their diversity make normal (single file) ODV spreadsheet import impractical.

3 Solution: SDN Spreadsheet importer consisting of file analysis and aggregation.

4 File Analysis… For every file determine the type of data (profile, time-series, trajectory). For every file determine the type of data (profile, time-series, trajectory). Uses the //SDN_parameter_mapping sectionUses the //SDN_parameter_mapping section //SDN_parameter_mapping // SDN:LOCAL:PRESSURE SDN:P011::PRESPS01 SDN:P061::UPDB // SDN:LOCAL:T90 SDN:P011::TEMPS901 SDN:P061::UPAA // SDN:LOCAL:Salinity SDN:P011::PSALPR02 SDN:P061::UUUU // SDN:LOCAL:fluorescence SDN:P011::CPHLPM01 SDN:P061::UGPL // SDN:LOCAL:Trans_red_25cm SDN:P011::POPTDR01 SDN:P061::UPCT // SDN:LOCAL:POTM SDN:P011::POTMCV01 SDN:P061::UPAA // SDN:LOCAL:Density SDN:P011::SIGTPR01 SDN:P061::UKMC

5 Aggregation… ODV collections are created for every data type found. ODV collections are created for every data type found. Data of a given file are imported into the corresponding ODV collection. Data of a given file are imported into the corresponding ODV collection. Process is fully automatic. Process is fully automatic. Results in one or more ODV collections containing all data of a given type. Results in one or more ODV collections containing all data of a given type.

6 Availability… This feature is available in ODV 4.3.3, released March 25, This feature is available in ODV 4.3.3, released March 25, WARNING: Many SDN files do not fully comply with SDN spreadsheet format. WARNING: Many SDN files do not fully comply with SDN spreadsheet format. List of problems has been submitted. List of problems has been submitted.


Download ppt "Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Multi-file Data Aggregation with Ocean Data View."

Similar presentations


Ads by Google