Weather prediction& Flooding: Practical issues of Sensor Web services implementation and gridification Prof. Natalia Kussul, NSAU WGISS-25, Sanya.

Slides:



Advertisements
Similar presentations
Page 1 CSISS LCenter for Spatial Information Science and Systems 03/19/2008 GeoBrain BPELPower Workflow Engine Liping Di, Genong Yu Center.
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Sensor Web Enablement and GEOSS Presented by: Terence van Zyl.
Prof. Natalia Kussul, PhD. Andrey Shelestov, Lobunets A., Korbakov M., Kravchenko A.
1 SensorWebs and Security Experiences Dan Mandl Presented at WGISS Meeting in Toulouse, France May 11, 2009.
18 Copyright © 2005, Oracle. All rights reserved. Distributing Modular Applications: Introduction to Web Services.
1 Copyright © 2005, Oracle. All rights reserved. Introducing the Java and Oracle Platforms.
The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
|epcc| NeSC Workshop Open Issues in Grid Scheduling Ali Anjomshoaa EPCC, University of Edinburgh Tuesday, 21 October 2003 Overview of a Grid Scheduling.
.NET Technology. Introduction Overview of.NET What.NET means for Developers, Users and Businesses Two.NET Research Projects:.NET Generics AsmL.
Overview Environment for Internet database connectivity
Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Tayeb Lemlouma & Nabil Layaïda Presented by Sébastien Laborie November.
Architectures for Data Access Services Practical considerations for design of discoverable, reusable interoperable data sources.
TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.
Database System Concepts and Architecture
31242/32549 Advanced Internet Programming Advanced Java Programming
Node Lessons Learned James Hudson Wisconsin Department of Natural Resources.
Sensor Grid Application in Nature Reserve Monitoring Prof. Xu Zhang Guang Deng Research Institute of Forest Resource Information Techniques Chinese Academy.
Proposed update of Technical Guidance for INSPIRE Download services based on SOS Matthes Rieke, Dr. Albert Remke (m.rieke, 52°North.
16/11/ IRS-II: A Framework and Infrastructure for Semantic Web Services Motta, Domingue, Cabral, Gaspari Presenter: Emilia Cimpian.
Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group
Idaho National Engineering and Environmental Laboratory What is a Framework? Web Service? Why do you need them? Wayne Simpson November.
Introduction to WSDL presented by Xiang Fu. Source WSDL 1.1 specification WSDL 1.1 specification – WSDL 1.2 working draft WSDL.
Snejina Lazarova Senior QA Engineer, Team Lead CRMTeam Dimo Mitev Senior QA Engineer, Team Lead SystemIntegrationTeam Telerik QA Academy SOAP-based Web.
1 Generic logging layer for the distributed computing by Gene Van Buren Valeri Fine Jerome Lauret.
FOSS4G 2009 Building Human Sensor Webs with 52° North SWE Implementations Building Human Sensor Webs with 52° North SWE Implementations Eike Hinderk Jürrens,
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Distributed Heterogeneous Data Warehouse For Grid Analysis
Understand Web Services
Pacific Island Countries GIS/RS User Conference 2010, Suva, November 2010 Sensor Web Enablement for the Pacific Vulnerability and adaptation of coastal.
CSE 636 Data Integration Web Services.
Interpret Application Specifications
Generation of WEB SERVICES Using PROGRAM SLICING RAVINDRA KUMAR SUDIP AKURA AMIT KUMAR BALKARAN SINGH SIDHU
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Web Service Implementation Maitreya, Kishore, Jeff.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse.
A Scalable Application Architecture for composing News Portals on the Internet Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta Famagusta.
Web services: Why and How OOPSLA 2001 F. Curbera, W.Nagy, S.Weerawarana Nclab, Jungsook Kim.
Codeigniter is an open source web application. It occupies a very small amount of space in the memory and is most useful for developers who aim to develop.
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
Environmental Monitoring: Database and Beyond Chengyang Zhang Computer Science Department University of North Texas.
Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
Web mapping interoperability in practice, a Java approach guided by the OpenGis Web Map Server Interface Specification Pedro Fernández, R. Béjar, M.A.
Sensors, SWE and European spatial data initiatives – INSPIRE and GMES Brno, Radim Štampach, Ph.D.
Web Services based e-Commerce System Sandy Liu Jodrey School of Computer Science Acadia University July, 2002.
CEOS WGISS, Hanoi May OSCAR Prototyping the sensor web Wyn Cudlip BNSC/QinetiQ Presentation to WGISS Hanoi May 2007 (Slides.
CEOS WGISS 28 Meeting, Pretoria, September 2009 Wyn Cudlip BNSC/GeoSeren Presentation to WGISS28 Pretoria, September 2009 Experiences with SWE
The european ITM Task Force data structure F. Imbeaux.
Web Services. Abstract  Web Services is a technology applicable for computationally distributed problems, including access to large databases What other.
NSAU Flood Model Use in Sensor Web: Lessons Learned Sergii Skakun Space Research Institute NASU-NSAU, Ukraine CEOS WGISS-27 May 11-15, 2009 Toulouse, France.
Preliminary Ocean Project Page 1 WGISS SG May 15, C. Caspar G. Tandurella P. Goncalves G. Fallourd I. Petiteville Preliminary Ocean Project Phase.
S imple O bject A ccess P rotocol Karthikeyan Chandrasekaran & Nandakumar Padmanabhan.
Review of Paper: Johan Hjelm “Position dependent services using metadata profile matching” Youyong Zou Apr.15,2001.
Managing Enterprise GIS Geodatabases
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Practical issues of Sensor Web implementation and gridification Kussul N., Korbakov M., Kravchenko O.
Data Assimilation Decision Making Using Sensor Web Enablement M. Goodman, G. Berthiau, H. Conover, X. Li, Y. Lu, M. Maskey, K. Regner, B. Zavodsky, R.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
K-WfGrid: Grid Workflows with Knowledge Ladislav Hluchy II SAS, Slovakia.
SSE WebMapViewer Recent Developments Steven Smolders SSE Workshop ESA - ESRIN, Frascati, Rome.
Botts – August 2004 Sensor Web Enablement Sensor Web Enablement WG (SWE-WG)
Java Web Services Orca Knowledge Center – Web Service key concepts.
Sabri Kızanlık Ural Emekçi
WEB SERVICES.
Sensor Web & Grid Technical Issues
Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta
Distributed System using Web Services
Presentation transcript:

Weather prediction& Flooding: Practical issues of Sensor Web services implementation and gridification Prof. Natalia Kussul, NSAU WGISS-25, Sanya

Outline Sensor Web: overview Test case: floodings SensorML: experience Sensor Observation Service: experience Sensor Web: gridification Our plans

Sensor Web: the purpose Integration of heterogeneous sensors into the information infrastructure Sensors discovery and data access Composition of dataflows between system components Events triggering by sensors conditions

OGC O&MObservations & MeasurementsApproved SensorMLSensor Model LanguageApproved TransducerMLTransducer Model LanguageApproved OGC SOSSensor Observations ServiceApproved OGC SPSSensor Planning ServiceApproved OGC SASSensor Alert ServiceIn progress OGC WNSWeb Notification ServicesIn progress OpenGIS Standards SW Enablement working group at OGC have developed a number of standards governing different aspects of Sensor Web

Test Case The task under study is flooding in different regions of world Particular test case is floodings in Mozambique

Test Case: Weather Prediction data flow

Test case: Flood Monitoring data flow

Test Case: data sources ASAR MODIS MERIS LandSat DEM

Test Case: SW perspective

Test Case: Mozambique

SensorML Sensor modeling language is the cornerstone of all SW services It provides comprehensive description of sensor parameters and capabilities It can be used for describing different kind of sensors: –Stationary or dynamic –Remote or in-situ –Physical measurements or simulations

SensorML: example <swe:Quantity definition= "urn:ogc:def:phenomenon:temperature"/> <swe:Quantity definition= "urn:ogc:def:phenomenon:pressure"/> <swe:Quantity definition= "urn:ogc:def:phenomenon:windSpeed"/> <swe:Time definition="urn:ogc:def:phenomenon:time uom="urn:ogc:def:unit:iso8601"/> <swe:Quantity definition="urn:ogc:def:phenomenon:temperature uom="urn:ogc:def:unit:celsius"/> <swe:Quantity definition="urn:ogc:def:phenomenon:pressure uom="urn:ogc:def:unit:bar" scale="1e-3"/> <swe:Quantity definition="urn:ogc:def:phenomenon:windSpeed uom="urn:ogc:def:unit:meterPerSecond"/>

SensorML: WRF model Modeling and simulation are very important parts of environmental monitoring Sensor Web infrastructure should be able to integrate modeling data in convenient way We have tried to describe weather modeling process using WRF numerical model in terms of SensorML

SensorML: WRF model An example of single model input in SensorML:

SensorML: WRF model There are nearly 50 inputs and 20 outputs for basic WRF configuration Each of them requires quite significant amount of XML code to be properly described It would be great if next revision of SensorML will include some elements for simpler description of multidimensional data Another negative issue is inconsistency between SML specification, published XML schemas and educational materials

Sensor Observation Service We have studied two possible implementations of Sensor Observation Service (SOS) for serving temperature sensors data Implementations under study were: –UMN Mapserver v5 ( –52North SOS ( Lesson learnt: there isnt (yet) really good and reliable solution for serving data through SOS protocol However for some cases 52Norths implementation provides good experience

Sensor Observation Service UMN Mapserver (as SOS server) –Pros: Very good and reliable abstraction for different data sources (raster files, spatial databases, WFS, etc) Simple application model (CGI executable) Wide set of features beside SOS Open software –Cons: SOS support is declared but far from being working Poor documentation on SOS topic Strange plans for future development (automatic SensorML generation)

Sensor Observation Service 52North SOS –Pros: SOS implementation is stable and complete Platform-independent (Java-based) A part of wider SW implementations stack (SPS, SAS) Open software Source code is clean and easily reusable –Cons: No data abstraction: the only data source is relational database of specific structure Database structure is far from optimal (strings as primary keys, missed indexes, etc) Complex application model (Java web application)

Sensor Observation Service We have used 52North implementation for building a testbed SOS server: – Server is providing data of temperature sensors over Ukraine and South Africa region Data comes from PostGIS database with some tweaks to make is compatible with 52North database structure (VIEWS, index tables, etc) Performance is quite good for our DB. Yet, for other DBs such adaptations could lead to unacceptable drops in performance

Sensor Observation Service

Example of single SOS measurement T04:00:00+04 WMO

Sensor Observation Service... and the whole time serie of observations

Gridification: rationale Sensor Web services like SOS, SPS and SAS can benefit from integration with Grid platform like Globus Toolkit Advantages includes: –Sensors discovery through Index Service –High-level access to XML description –Convenient way for implementation of notifications and event triggering –Reliable data transfer for large datasets –Enforcement of data and services access policies

Gridification: implementation We have developed a testbed SOS service using the Globus Toolkit platform For now, service works as proxy translating and redirecting user request to usual SOS-server

Gridification: implementation We have developed a testbed SOS service using the Globus Toolkit platform For now, service works as proxy translating and redirecting user request to usual SOS-server Next version should have in-service implementation of SOS-server functionality

Gridification: problems The main problem of implementation of OGC Grid service lies in complexity of XML schema used According to OGC SOAP Interoperability Experiment, none of available SOAP binding tools were able to parse OGC schemas completely (year 2003) Situation havent improved significantly till now The main problem of complexity is GML data types

Gridification: problems This problems could be solved by using custom serializers for services XML data However this way is complex in implementation and debugging Lets hope that the situation will improve from both sides

Out plans Our future works include: Implementation of Mozambique test case in terms of Sensor Web To participate in IC "Space and Major Disasters with architectural proposals To provide stable Grid-based implementation of Sensor Web services To collaborate with International Red Cross organization within its tasks

Our plans: Red Cross tasks

Thank you!