WPS 4 ODV: on-the-fly server-side plotting of data (in Google Earth)

Slides:



Advertisements
Similar presentations
Get Started with GIS Mapping Part 2 of 3 Madhu Lakshmanan.
Advertisements

SubVersion SubVersion svn.oss.deltares.nl. workflow.
Lecture plan Information retrieval (from week 11)
Web Toolkit Julie George & Ronald Lopez 1. Requirements  Java SDK version 1.5 or later  Apache Ant is also necessary to run command line arguments 
1 Google Earth Powered by MapGuide. 2© 2006 Autodesk Session Outline MapGuide / Google Earth Integration Overview Demo How it Works and How to Use It.
ECOOP Data Management System (T2.2/WP2) Declan Dunne 13 th February 2008, Athens.
Kick-off meeting Delft, April FP – SPACE no Data Fast First step in data management – repository Gerrit Hendriksen Gerben.
Recent Work in Progress
SE 370: Programming Web Services Week 4: SOAP & NetBeans Copyright © Steven W. Johnson February 1, 2013.
The North American Carbon Program Google Earth Collection Peter C. Griffith, NACP Coordinator; Lisa E. Wilcox; Amy L. Morrell, NACP Web Group Organization:
Streaming NetCDF John Caron July What does NetCDF do for you? Data Storage: machine-, OS-, compiler-independent Standard API (Application Programming.
7 +/- 2 Maybe Good Ideas John Caron June (1) NetCDF-Java (aka CDM) has lots of functionality, but only available in Java – NcML Aggregation – Access.
Summary previous session 1 3 D:\ tools models add meta information netCDF on web server transform to netCDF netCDF on OPeNDAP server data.
Chapter 10 ADO. What is ADO? ADO is a Microsoft technology ADO stands for ActiveX Data Objects ADO is a programming interface to access data in a database.
Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.
Creating WordPress Websites. Creating a site on your computer Local server Local WordPress installation Setting Up Dreamweaver.
Website Development with PHP and MySQL Introduction.
Status of advanced access and viewing services following SeaDataNet D5.6 and D8.7 By Dick M.A. Schaap – Technical Coordinator Barcelona – Spain, 19 – 20.
workflow. SubVersion Version control Quality control: “Something adheres to some criteria” Without a properly defined something there.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
GIS technologies and Web Mapping Services
EMODnet Chemistry 2 Advanced services Progress by Deltares Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Istanbul.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Presenting Statistical Data Using XML Office for National Statistics, United Kingdom Rob Hawkins, Application Development.
Website Design Lecture 1. Outline Introduction to the module Outline of the Assessment Schedule Lecture Static XHTML, client side and server side Why.
10/13/2015 ©2006 Scott Miller, University of Victoria 1 Content Serving Static vs. Dynamic Content Web Servers Server Flow Control Rev. 2.0.
Cross Site Integration “mashups” cross site scripting.
GCE Data Toolbox -- metadata-based tools for automated data processing and analysis Wade Sheldon University of Georgia GCE-LTER.
Integrated Grid workflow for mesoscale weather modeling and visualization Zhizhin, M., A. Polyakov, D. Medvedev, A. Poyda, S. Berezin Space Research Institute.
OceanBrowser viewing service, overview and upgrades Alexander Barth (1), Charles Troupin (2), Aida Alvera Azcárate (1), Jean-Marie Beckers (1) (1) University.
MAKANI ANDROID APPLICATION Prepared by: Asma’ Hamayel Alaa Shaheen.
A web interface for gridding and visualizing oceanographic data Alexander Barth (1,2), Aida Alvera-Azcárate (1,2), Charles Troupin (1), Mohamed Ouberdous.
Emodnet Chemistry Lot Guidelines for data products.
PaPCo, Das2, and Autoplot Jeremy Faden, University of Iowa.
1 DAPPER: An OPENDAP Server for In-Situ Data Joe Sirott Donald W. Denbo, Willa H Zhu University of Washington PMEL/NOAA.
The CERA2 Data Base Data input – Data output Hans Luthardt Model & Data/MPI-M, Hamburg Services and Facilities of DKRZ and Model & Data Hamburg,
Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netCDF Workshop October 25, 2012.
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
OPeNDAP Hyrax Harnessing the power of the BES OPeNDAP Hyrax Back-End Server Patrick West
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
Windows 7 WampServer 2.1 MySQL PHP 5.3 Script Apache Server User Record or Select Media Upload to Internet Return URL Forward URL Create.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
Repository for Archiving, Managing and Accessing Diverse DAta Thiru.
TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.
Apache Cocoon – XML Publishing Framework 데이터베이스 연구실 박사 1 학기 이 세영.
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View Achievements and Future Developments.
MIKADO – Generation of ISO – SeaDataNet metadata files
Intermountain West Data Warehouse - Western Air Quality Study
Python Programming Unit -1.
Data Are from Mars, Tools Are from Venus
NEMO – Reformating tool
Designing High Performance BIRT Reports
Maria Gunnarsson Statistic Sweden Mikael Nordberg Statistic Sweden
Using Ocean Data View for EMODnet Chemistry Reiner Schlitzer
Implementing the WPS Standard A Case Study for Dissemination of Coastal and Marine Tools GIMA Master Thesis Joost Boerboom.
OCTOPUS – SeaDataNet Format conversion tool
21 Essential Data Visualization Tools
Data Sharing We all need data
Spark Presentation.
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Dynamic visualization of odv files via WPS
Accessing Remote Datasets through the netCDF interface.
WP4 EMODNet Visualiation techniques using OGC-WPS
Improvements in database of data products and services
New Round of Regional data collections Deltares
Tile layers, map image layers, and on-premises Web GIS
Updating the existing advanced viewing services
OPeNDAP/Hyrax Interfaces
WP4 EMODNet Visualiation techniques
Presentation transcript:

WPS 4 ODV: on-the-fly server-side plotting of data (in Google Earth) EMODNet chemistry contribution, Barcelona, Mar 2014 Gerben J. de Boer, Gerrit Hendriksen, Giorgio Santinelli 14 oktober 2019

OpenEarthTools Google Earth static products 14 oktober 2019

Matlab oceandataview and googleplot 14 oktober 2019

OpenEarth Matlab GooglePlot

*.png *.kml *.nc collection *.odv collection Portal links Linkable static collection of png files per granule (made by ODV?) Linkable static collection of kml files per granule (python or Matlab Linkable DYNAMIC collection of kml files per granule (python) pyWPS pyWPS *.png *.kml ODV batch mode OpenEarth Matlab GooglePlot 13,000 lines > KMLpcolor() wrapper for Simplekml.py > Matplotlib back-end for Simplekml.py Cache of netCDF files incl. resolved P011, P061 and EDMO codes as NOAA/MyOcean THREDDS OPeNDAP) Cache in RDBMS (PostgreSQL, PostGIS or Oracle if someone pays the license) *.nc collection SQL/WFS/ SOS/ OPENDAP Data only, product done bij GHER, Liege *.odv collection Robo-harvested cache of ODV files ODV files at EDMO sources P0x EDMx

pyWPS MSc thesis finished this summer under National GIS MSc program http://localhost/ tor testing

Processing 1 ODV fle http://localhost/cgi-bin/pywps.cgi? &service=wps &version=1.0.0 &request=Execute &Identifier=odvProcess &DataInputs=[ url=d:/../userkc30e50-data_centre632-090210_result/… world_N50W10N40E0_20060101_20070101.txt; parameter=Wind_direction%28dd%29_[deg] ] 14 oktober 2019

WPS output xml with link to kmz kml is inefficient xml so needs zipping for faster delivery kmz is zip file renamed kmz with the kml inside it. a kmz can include more, like the scattered dot png 14 oktober 2019

kmz can be opened in Google Earth Value is mapped in a grey scale colormap 14 oktober 2019

Data value lights up as text upon mouse hoover-over 14 oktober 2019

Data and meta-data is stored as html table inside kmz 14 oktober 2019

Time of each data encoded as kml time: time slider to select period 14 oktober 2019

WPS output xml with json inside it Java Script Object Notation json is an efficient ascii stream many libraries can easily parse json, especially java script as used in websites webviewer can render table or plot 14 oktober 2019

Also for directory with ODV files but a bit slow, ODV has some performance issues for large folders http://localhost/cgi-bin/pywps.cgi? &service=wps &version=1.0.0 &request=Execute &Identifier=odvProcess &DataInputs=[ url=d:/../userkc30e50-data_centre632-090210_result; parameter=Wind_direction%28dd%29_[deg] ] 14 oktober 2019

SDN integration issues Speed-up getting the data: needed for on-the-fly ODV cache Matlab toolbox Python pyODV: quick ‘n dirty parser (scaffolded: no P01) API: http://odv.awi.de API: ODV collections PostgreSQL/Oracle cache (python has mature SQL library) netCDF collection cache (python has mature netcdf library) How to request plot for one variable: How do you know what’s in a file? Meta-data is too aggregated. 2-step query like SOS? Where to host test WPS server? Test dataset cache 4 Deltares server? 14 oktober 2019

PyWPS ODV code in open access repos 14 oktober 2019

WPS inputs: ideas? WPS input Colormap choice Colorlimits Outputformat: kmz, json, png, … Flag for pop-up table (slow for large datasets) Plot options: Trajectory: connect dots with lines Timeseries: dynamic plot Profiles: plot as column with z exaggeration 14 oktober 2019