Presentation is loading. Please wait.

Presentation is loading. Please wait.

Mitglied in der Helmholtz-Gemeinschaft WCS Server for CF-NetCDF An Overview AQCoP Meeting, August 2011 | M. Decker, M. Schultz, K. Hoijarvi, R.B. Husar.

Similar presentations


Presentation on theme: "Mitglied in der Helmholtz-Gemeinschaft WCS Server for CF-NetCDF An Overview AQCoP Meeting, August 2011 | M. Decker, M. Schultz, K. Hoijarvi, R.B. Husar."— Presentation transcript:

1 Mitglied in der Helmholtz-Gemeinschaft WCS Server for CF-NetCDF An Overview AQCoP Meeting, August 2011 | M. Decker, M. Schultz, K. Hoijarvi, R.B. Husar

2 Mitglied in der Helmholtz-Gemeinschaft Functioning software package that implements a WCS compliant data server delivering NetCDF files Based on Python Runs on Windows and Linux Supports WCS 1.1.2 Protocol Supports NetCDF 3 and NetCDF 4 large file formats Supports station data from SQL database 18. Mai 20142 Introduction

3 Mitglied in der Helmholtz-Gemeinschaft Metadata about... the service available datasets Extraction of... a rectangular area (boundingbox) individual variables (fields) individual points or ranges in time (subsetting of other dimensions)...the foundation for using interoperable web applications 18. Mai 20143 WCS gives you...

4 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 20144 High-Level view of WCS

5 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 20145 Example metadata response (GetCapabilities)

6 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 20146 Software Dependencies Operating systemWindows (>= XP)GNU/Linux Python>= 2.6 (but not 3 - yet) Python web frameworkweb.py (http://webpy.org/)http://webpy.org/ Python XML parserLxml (http://lxml.de/)http://lxml.de/ Python numerical packageNumPy (http://numpy.scipy.org/)http://numpy.scipy.org/ Logging Backend for web.py (optional) WsgiLog (http://pypi.python.org/pypi/wsgilog/)http://pypi.python.org/pypi/wsgilog/ Python netcdf interface[currently part of server package] PyNIO (http://www.pyngl.uc ar.edu/Nio.shtml)http://www.pyngl.uc ar.edu/Nio.shtml More??

7 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 20147 Server Concept

8 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 20148 Server Directory Structure OWS web static datafed testprovider... cache NetCDF interface code web interface code web home ( index.html,... ) temp dir example data dir other data dirs

9 Mitglied in der Helmholtz-Gemeinschaft Code is OpenSource under The MIT LicenseThe MIT License Collaboration Tools: Esipfed-Wiki: documentationdocumentation SourceForge project page: forum, bugtrackerproject page DARCS distributed version control system: code DARCS (currently) two main repositories: WUSTL and FZ JuelichWUSTL FZ Juelich easy to set up your own full-featured repository further information available on the SourceForge project page Test-driven development process unit tests: OWS/test/unit.py integration tests: OWS/test/integ.py 18. Mai 20149 Development

10 Mitglied in der Helmholtz-Gemeinschaft install 3rd party software (see dependencies) get WCS server archive from SourceForge project page Windows: win32-ows-*.zip Linux: linux-ows-*.tar.gz put archive contents into sensible location for server operation for example /usr/local/ows (Linux) or C:\ows (Windows) add server dir to PYTHONPATH environment variable 18. Mai 201410 Getting Started I: Installation

11 Mitglied in der Helmholtz-Gemeinschaft example data dir included: testprovider contains example files ( index.html, wcs_capabilities.conf ) that you can adapt for your own data create NetCDF test cubes call web/static/testprovider/create_all.py extract metadata for operation: call web/owsadmin.py wcs_prepare testprovider start the server: web/ows.py 1080 check if it works: http://localhost:1080/testprovider 18. Mai 201411 Getting Started II: test it

12 Mitglied in der Helmholtz-Gemeinschaft create a data directory in web/static/ populate it with (CF-compliant) NetCDF files configure metadata create wcs_capabilities.conf create human-readable index.html( optional, but encouraged) you can use the example files from testprovider run metadata extractor: owsadmin.py wcs_prepare needs to be re-run after data dir content has been updated also adapt the global index.html in web/static 18. Mai 201412 Getting Started III: serving your data (NetCDF)

13 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 201413 Getting Started IV: serving station data (SQL) create a data directory in web/static/ create SQL views to: location data: loc_code, lat, lon + optional parameter data: loc_code, lat, lon, datetime, parameter, flags edit configuration: SQL database connection location SQL view name + fields time periodicity for each coverage SQL data view name + fields for each parameter configure metadata as with NetCDF data The real work is done inside the SQL database when creatring SQL views, the rest is just listing the names!

14 Mitglied in der Helmholtz-Gemeinschaft start the standalone server: ows.py [port number] (default port: 1080) data will be available via WCS at http://localhost: / ?... 18. Mai 201414 Getting Started V: running the server

15 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 201415 Thank you for your attention!

16 Mitglied in der Helmholtz-Gemeinschaft 18. Mai 201416


Download ppt "Mitglied in der Helmholtz-Gemeinschaft WCS Server for CF-NetCDF An Overview AQCoP Meeting, August 2011 | M. Decker, M. Schultz, K. Hoijarvi, R.B. Husar."

Similar presentations


Ads by Google