© University of Reading 2008www.reading.ac.uk Reading e-Science Centre September 10, 2015 Integrating a Web Map Service into the THREDDS Data Server Jon.

Slides:



Advertisements
Similar presentations
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Advertisements

EURO4M Project Kick-Off, April 2010 OGC Web Services Data visualization using OGC web services Maarten Plieger Wim Som de Cerff Royal Netherlands Meteorological.
The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
BARRODALE COMPUTING SERVICES LTD. Managing and serving large volumes of gridded spatial environmental data Adit Santokhee, Chunlei Liu,
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
Web based tools Ideas for presentation of operational meteorological data Ernst de Vreede KNMI EGOWS /6/2009 Ideas for presentation of operational.
BlogMyData A Virtual Research Environment for collaborative visualization of environmental data Andrew Milsted | 14 September 2010.
Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.
The MashMyData project Combining and comparing environmental science data on the web Alastair Gemmell 1, Jon Blower 1, Keith Haines 1, Stephen Pascoe 2,
Exploring large marine datasets using an interactive website and Google Earth Jon Blower, Dan Bretherton, Keith Haines, Chunlei Liu, Adit Santokhee Reading.
NASA World Wind. What is NASA World Wind? A richly interactive 3D planetary visualization tool. Smart client architecture. Portal for NASA data. Integrates.
Sharing and visualizing earth science data with Web Services and Virtual Globes Jon Blower (with help from lots of others!) Reading e-Science Centre Environmental.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
1 The NOAA Weather and Climate Toolkit Steve Ansari, Stephen Del Greco (NOAA / NCDC) Mark Phillips (UNC-Asheville / NEMAC) Bill Hankins (STG Inc.)
THREDDS Data Server, OGC WCS, CRS, and CF Ethan Davis UCAR Unidata 2008 GO-ESSP, Seattle.
The use of standard OGC web services in integrating distributed model, satellite and in-situ datasets Alastair Gemmell Jon Blower Keith Haines Environmental.
1 The NOAA Weather and Climate Toolkit Steve Ansari, Stephen Del Greco, Neal Lott (NOAA / NCDC)
Athens Feb 2008 EuroMISS and EuroDess Viewing and Validation Services Keith Haines.
Interoperability ERRA System.
GADS: A Web Service for accessing large environmental data sets Jon Blower, Keith Haines, Adit Santokhee Reading e-Science Centre University of Reading.
Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.
Using python client libraries to access remote servers via Web Coverage Services Dominic Lowe, BADC Ben Domenico, Unidata/UCAR* and the GALEON Team * Work.
© Crown copyright Met Office WCSplus Making the Web Coverage Service work for the Fluid Earth Sciences Community Bruce Wright (Senior IT Architect), 7.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NOAA/NGDC ESIP Meeting January 7 th, 2009 Simple NOAA Archive Access Portal.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
material assembled from the web pages at
Global Imagery Browse Services Overview AMSR Science Team Meeting Matt Cechini, GIBS Lead Helen Conover, AMSR-E SIPS.
Web mapping interoperability in practice, a Java approach guided by the OpenGis Web Map Server Interface Specification Pedro Fernández, R. Béjar, M.A.
Unidata’s TDS Workshop TDS Overview – Part II Unidata July 2011.
N-Wave Stakeholder Users Conference Wednesday, May 11, Marine St, Rm 123 Boulder, CO Linda Miller and Mike Schmidt Unidata Program Center (UPC)-Boulder,
DELIVERING ENVIRONMENTAL WEB SERVICES (DEWS) Partners: UK Met Office (Lead Partner), British Atmospheric Data Centre (BADC), British Maritime Technology.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
Discovery and Web Services in Support of SST Datasets at the PO.DAAC Edward Armstrong, Jorge Vazquez Toshio M. Chin, Charles Thompson Jet Propulsion Laboratory/California.
Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS)
BARRODALE COMPUTING SERVICES LTD. Spatial Data Activities at the Reading e-Science Centre Adit Santokhee, Jon Blower, Keith Haines Reading.
OceanBrowser viewing service, overview and upgrades Alexander Barth (1), Charles Troupin (2), Aida Alvera Azcárate (1), Jean-Marie Beckers (1) (1) University.
DAP4 James Gallagher & Ethan Davis OPeNDAP and Unidata.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
1ECOOP Plenary Meeting Athens 2008 EUROMISS EUROpean Marine Information System of Systems S Pouliquen, Thomas Loubrieu ECOOP plenary meeting.
Unidata TDS Workshop THREDDS Data Server Overview
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science.
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
Environmental informatics at Reading Keith Haines, Jon Blower, Alastair Gemmell, Kevin Yang, Dan Bretherton, Marc Stringer Reading e-Science Centre.
Requests from F. Blanc Retrieve information from each individual national reports and present this. –2. Data serving –The HYCOM products are freely available.
Service Composition for GIS Sai Ma, Minruo Li, Weichang Du Faculty of Computer Science, University of New Brunswick, Canada 2008 IEEE Congress on Services.
THREDDS Catalogs Ethan Davis UCAR/Unidata NASA ESDSWG Standards Process Group meeting, 17 July 2007.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
User Working Group 2013 Data Access Mechanisms – Status 12 March 2013
GIS in the cloud: implementing a Web Map Service on Google App Engine Jon Blower Reading e-Science Centre University of Reading United Kingdom
1-2-3 February 2006 –Page 1 Mersea Integrated System How to improve Access/Downloading services ? How far do we go in terms of standardization ?
1 MESSAGE EXCHANGE FOR Web Service-Based Mapping Services AHMET SAYAR INDIANA UNIVERSITY COMMUNITY GRIDS LAB. COMPUTER SCIENCE DEPARTMENT August 17, 2005.
Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012.
Managing WMS and WCS on multidimensional NetCDF Datasets with Geoserver Martin Desruisseaux, Geomatys Mickael Treguer, Ifremer.
Using Google Maps and other OpenSource GIS software for displaying geospatial data Jon Blower, Dan Bretherton, Keith Haines, Chunlei Liu, Adit Santokhee.
Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
© University of Reading 2009www.reading.ac.uk Reading e-Science Centre October 6, 2009, GO-ESSP, Hamburg Fast regridding of complex grids for visualization.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
Update on Unidata Technologies for Data Access Russ Rew
The MyOcean View Service: demo Jon Blower, Guy Griffiths, Kevin Yang, Keith Haines (University of Reading, UK) Thomas Loubrieu (Ifremer, France)
Dr Jon Blower University of Reading, United Kingdom Reading e-Science Centre, Environmental Systems Science Centre, UK National Centre for Earth Observation.
Data Browsing/Mining/Metadata
Spatial Data Activities at the Reading e-Science Centre
Data sharing and visualisation
Presentation transcript:

© University of Reading 2008www.reading.ac.uk Reading e-Science Centre September 10, 2015 Integrating a Web Map Service into the THREDDS Data Server Jon Blower, University of Reading, UK Pauline Mak, University of Tasmania, Australia Ethan Davis, John Caron, Unidata

Motivation THREDDS is a very popular system for sharing environmental data –Catalogue –Data access via OPeNDAP However, client-side tools are required for visualization –Not easy to use by people outside “our” community Web Map Service provides quick route to visualization –Produces georeferenced images –Images can be overlain to compare data –Very suitable for Web-GIS (low barrier to entry to users) Use of WMS mandated in Europe by INSPIRE directive –THREDDS already used by data providers WMS for NetCDF data already exists ( –Both TDS and ncWMS are Java-based Hence we aim to integrate ncWMS with TDS

Web Map Service: a closer look GetCapabilities -> metadata GetMap -> map image, based on client-selected parameters, inc: –Image width/height –Image coordinate reference system –Geographic bounding box –Depth/height and time –Style GetFeatureInfo -> information about a particular map pixel –Format not standardized Specification supports 4D data –(Although tools often do not)

WMS Interoperability NASA World Wind Cadcorp SIS Google Earth 3rd-party clients can’t use the custom WMS extensions

Why ncWMS? Based on same technology as TDS –Esp. Java NetCDF libraries Significant effort put into fast image generation Extensions to WMS to support scientific use cases –But fully backward-compatible with WMS specification

© University of Reading 2008www.reading.ac.uk Reading e-Science Centre September 10, 2015 Scientific visualization using (nc)WMS

Notable features of ncWMS Fast generation of images Ability to read CF-NetCDF on variety of grids –inc. arbitrary grids and Murray tripolar Reproject images into large number of coordinate systems –E.g. polar stereographic Configuration via administrative web interface

Non-standard features Piecemeal metadata-serving in JSON format –avoids large XML Capabilities document Extra metadata for science data –e.g. units of measurement New parameters in GetMap for styling: –Choose colour palette –Set contrast range –Linear or logarithmic scaling –Far simpler than Styled Layer Descriptor Generation of timeseries plots via GetFeatureInfo … but fully backward-compatible with WMS1.1.1 and 1.3.0

Godiva2: a web client for ncWMS Interactively explore 4D geospatial raster datasets on the web ~40 datasets –Research data, operational forecasts, satellite products Backed by ncWMS server OGC Website of the Month, January

Selection of depth Select from all the depth levels of the model

Selection of time (range) Select from all the timesteps in the model Selection of a time range leads to an animation

Finding the data value at a point Click on the data layer, data value and precise position is shown Lon: Lat: Value: 19.27

Timeseries plots If a time range is selected, can create a timeseries plot at a point

Vector plots

Selection of colour palette

Contrast-stretching Manual or automatic

Polar projections

Choice of background images

Export to Google Earth Allows visualization of multiple data sources Hurricane Katrina, August 2005 Storm track positions (analysed from ECMWF vorticity data) by Lizzie Froude, ESSC Sea surface temperature data from UK Met Office FOAM model Combination shows cooling of surface waters on right-hand side of cyclonic storm track High winds cause upwelling of cool, deep water

Who’s using ncWMS/Godiva2? 100,000 GetMap requests served in 3 months –From 5 continents Customized versions of Godiva2 site set up for MERSEA and ECOOP projects –Major EU framework projects – INSPIRE compliance important! –Will be used in MyOcean UK National Centre for Ocean Forecasting Server software installed by: –Plymouth Marine Labs –AIMS, Australia –NOAA, US –USGS Code contributions from: –MeteoGalicia, Spain –TPAC, Tasmania –AIMS, Australia

© University of Reading 2008www.reading.ac.uk Reading e-Science Centre September 10, 2015 Case study: European operational oceanography

Current architecture as used in MERSEA and ECOOP projects OPeNDAP (THREDDS) NetCDF Data Provider 1 OPeNDAP (THREDDS) NetCDF OPeNDAP (THREDDS) NetCDF WMS Dynamic Quick View Web portal (rebranded Godiva2) Data providers already use TDS and OPeNDAP Requires minimal setup Single point of failure Relies on fast, reliable OPeNDAP servers Data Provider 2 Data Provider 3

Improved architecture: Anticipated MyOcean deployment NetCDF THREDDS WMS OPeNDAP WCS? THREDDS WMS OPeNDAP WCS? THREDDS WMS OPeNDAP WCS? WMS bundled with THREDDS Data providers install single piece of software

Technical challenges Merging Spring-based code (ncWMS) with servlet- based code (TDS) –Spring is fairly non-intrusive so not too hard to decouple –TDS moving toward Spring architecture –Spring cleanly separates internal logic from presentation Merging catalogue and configuration systems –TDS system is more scalable Changes to underlying Java-NetCDF libraries –Upgrade from version 2.2 to version 4 Aligning all of this with THREDDS-WCS –Single point of configuration for WMS and WCS metadata

Conclusions First prototype of TDS-WMS now developed To do: –Testing (inc. scalability) –Tidying-up and refactoring –Integration of logging and usage monitoring –Integration of administrative web pages Anticipated immediate use in major European project MyOcean (By the way - version 4.0 of Java NetCDF libs appear significantly faster than version 2.2!)