GRID-ENABLED MEDIATION SERVICES FOR GEOSPATIAL INFORMATION Ilya Zaslavsky, Chaitan Baru San Diego Supercomputer Center University of California San Diego

Outline The Geosciences Network Project (GEON) The Geosciences Network Project (GEON) Grid-enabling GEON services Grid-enabling GEON services Web services, grid services, OGSA, OGC Web services, grid services, OGSA, OGC Running example: geologic map integration Running example: geologic map integration Ontology services Ontology services Map assembly services Map assembly services Demo Demo

GEON: The Geosciences Network IT: SDSC, Penn State, San Diego State University IT: SDSC, Penn State, San Diego State University Geosciences: Arizona State University, Bryn Mawr College, Cornell University, Rice University, UNAVCO, University of Arizona, University of Idaho, University of Missouri, University of Texas El Paso, University of Utah, Virginia Tech Geosciences: Arizona State University, Bryn Mawr College, Cornell University, Rice University, UNAVCO, University of Arizona, University of Idaho, University of Missouri, University of Texas El Paso, University of Utah, Virginia Tech Education and Outreach: DLESE, Cornell, UNAVCO Education and Outreach: DLESE, Cornell, UNAVCO Agency Partners: USGS, NASA Agency Partners: USGS, NASA Industry partners: IBM, ESRI, GeoFusion Industry partners: IBM, ESRI, GeoFusion Two testbeds Broad range of geoscience data sets

GEON IT Issues Prototyping a national information infrastructure for Geosciences Prototyping a national information infrastructure for Geosciences Close collaboration between geoscientists and IT to interlink databases and Grid-enable applications Close collaboration between geoscientists and IT to interlink databases and Grid-enable applications The GEON Grid: heterogeneous networks, compute nodes, storage capabilities (SRB, Rocks, Globus) The GEON Grid: heterogeneous networks, compute nodes, storage capabilities (SRB, Rocks, Globus) “Deep” data modeling of 4D data “Deep” data modeling of 4D data Situating 4D data in context—spatial, temporal, topic, process Situating 4D data in context—spatial, temporal, topic, process XML-based standards for data exchange XML-based standards for data exchange Semantic integration of Geosciences data Semantic integration of Geosciences data Logic-based formalisms to represent knowledge and map between ontologies Logic-based formalisms to represent knowledge and map between ontologies GEMS= Grid-Enabled Mediation Services GEMS= Grid-Enabled Mediation Services

Grid Services OGSA: architecture OGSA: architecture Globus: software tools ( Globus: software tools ( Global Grid Forum: standards ( Global Grid Forum: standards ( Features: Features: WSDL/SOAP-based WSDL/SOAP-based Security and authentication Security and authentication Persistent state mechanisms Persistent state mechanisms SDSC GEMS (and GeoGEMS) SDSC GEMS (and GeoGEMS)

SDSC Grid-Enabled Mediation Services (GEMS) Based on XML, XQuery (next generation of MIX—Mediation of Information using XML) Based on XML, XQuery (next generation of MIX—Mediation of Information using XML) Defined in terms of a set of services that are used at: Defined in terms of a set of services that are used at: “Registration time” “Registration time” Dataset registration, schema registration, ontology registration Dataset registration, schema registration, ontology registration Source content and capability related services: e.g., “term resolution” service, capability description service, … Source content and capability related services: e.g., “term resolution” service, capability description service, … “View definition time” “View definition time” Data Integration Services, Discovery services Data Integration Services, Discovery services Query runtime Query runtime Dynamic binding of logical to physical resources Dynamic binding of logical to physical resources Administrative Services Administrative Services Services to manage access controls, control replication, … Services to manage access controls, control replication, …

GEMS Components Query Optimization & Plan Generation Verification, Access Control, and Query Rewrite Result Assembly (e.g. map generation) Ontology Service Community Authorization Service Monitoring & Discovery Service Network Weather Service Replica Location Service Client Compute Resources Distributed Compute and Storage Resources Databases File system File system File system Compute Resources Compute Resources Registration Services Metadata Registry Deployment Services Data Integration Services

Querying and Mapping GUI (vector)... WSDL WS WSDL WS WSDL Mediator SOAP server SOAP server SOAP server SOAP server WS WSDL Querying and Mapping GUI (raster) Spatial results assembly... Global legend generation Integrated View ArcXML exchanges ArcIMS WS HTTP GET WMS WS Ontology-based rewriting OGSA AXIS Tomcat Apache STACKSTACK OGSAOGSA

Example: Geologic Map Integration

GeoGEMS: Registration Source schema, with user-defined types and operations Source schema, with user-defined types and operations Exposed functions (in ArcIMS lingo) Exposed functions (in ArcIMS lingo) Get_service_info Get_service_info Get_feature_count Get_feature_count Get_image  png Get_image  png Get_Features  XML string Get_Features  XML string Get_Extract  zipped shapefile Get_Extract  zipped shapefile Semantics registration (*.owl) Semantics registration (*.owl) Data quality information Data quality information + standard items: narrative, spatial extent… + standard items: narrative, spatial extent…

Ontology Services for Map Integration A.Concept Expansion Extracting all sub-concepts of the queried term (WHERE period=“Tertiary”) from global ontology B. Concept Resolution Each source returns unique values for each query term (stored in mapping.xml)  rewriting query in terms of local source Global ontology Tertiary Quaternary/Tertiary Tertiary/Jurassic Tertiary/Cretaceous WHERE TIME_UNIT = "Tertiary" OR TIME_UNIT = "Quaternary/Tertiary" OR TIME_UNIT = "Tertiary/Jurassic" OR TIME_UNIT = "Tertiary/Cretaceous" OR TIME_UNIT = "Tertiary"

Operational uses of ontology in GIS Many operations in GIS are based on establishing object identity Many operations in GIS are based on establishing object identity Edge-matching Edge-matching Planar enforcement Planar enforcement Generalization Generalization … Associating spatial objects with concepts in domain ontology provides for a richer set of object identity rules Associating spatial objects with concepts in domain ontology provides for a richer set of object identity rules

Automatic labeling results…

Special Cases: 1 B: basal nucleus of Meynert (C ) B: basal nucleus of Meynert (C ) LGP: lateral globus pallidus, C LGP: lateral globus pallidus, C Basal nucleus cells (B) are within LGP, but their precise locations not known  polygon is coded LGP, B is a secondary descriptor Basal nucleus cells (B) are within LGP, but their precise locations not known  polygon is coded LGP, B is a secondary descriptor

Special Cases: 3 DG: dentate gyrus, C DG: dentate gyrus, C PoDG: polymorph layer of the dentate gyrus PoDG: polymorph layer of the dentate gyrus CA1: field CA1 of hippocampus (C ) CA1: field CA1 of hippocampus (C ) All of them have a common parent: hippocampus  a common parent is used to label polygon; polylines are labeled separately All of them have a common parent: hippocampus  a common parent is used to label polygon; polylines are labeled separately

Mediator Legend Generator Map Assembler Ontology … GRID SERVICES FOR MAP INTEGRATION ArcIMS and WMS Services wrapped in WSDL/SOAP Querying multiple map services In GEON (

Spatial Results Assembly Previously (in MIX): XMAS query specifies how result fragments are merged into XML tree Previously (in MIX): XMAS query specifies how result fragments are merged into XML tree Now: Now: XML fragments contain or reference fragments of different types XML fragments contain or reference fragments of different types Format of the output map is determined at run time Format of the output map is determined at run time Query results must be placed in spatial context, which is not explicitly requested in a query Query results must be placed in spatial context, which is not explicitly requested in a query The composite map should support further queries The composite map should support further queries

Map Assembly Scenarios - 1 Client-side overlay of map images from individual sources Grid service interface: Grid service interface: GifService:getGif (String imageService, String layerID, String highlightColor, String envelope, String imageSize, String expression) GifService:getGif (String imageService, String layerID, String highlightColor, String envelope, String imageSize, String expression) Example (“Tertiary” in Nevada): Example (“Tertiary” in Nevada): GifService:getGif ("nevada", "2", “255,255,0”, ” ,51.09, , ”, “611,580 “ “(TIME_UNIT = 'Tertiary' OR TIME_UNIT = 'Quaternary/Tertiary' OR TIME_UNIT = 'Tertiary/Jurassic' OR TIME_UNIT = 'Tertiary/Cretaceous' OR TIME_UNIT = 'Tertiary')” ) GifService:getGif ("nevada", "2", “255,255,0”, ” ,51.09, , ”, “611,580 “ “(TIME_UNIT = 'Tertiary' OR TIME_UNIT = 'Quaternary/Tertiary' OR TIME_UNIT = 'Tertiary/Jurassic' OR TIME_UNIT = 'Tertiary/Cretaceous' OR TIME_UNIT = 'Tertiary')” ) These are converted to GET_IMAGE or Getmap requests at source wrappers These are converted to GET_IMAGE or Getmap requests at source wrappers Variants: using ImageFusion service at the middleware to merge individual images into one Variants: using ImageFusion service at the middleware to merge individual images into one

Map Assembly Scenarios - 2 Results image is generated at the mediator by merging coordinate information from ArcIMS/WFS/Oracle sources Each source returns XML-formatted coordinate strings Each source returns XML-formatted coordinate strings Only image of query results get generated Only image of query results get generated Original images don’t have to be updated Original images don’t have to be updatedVariants: Passing coordinate data on to client as SVG/VML Passing coordinate data on to client as SVG/VML Xml coordinates

Map Assembly Scenarios - 3 New image service dynamically generated at the mediator from raster and/or vector fragments New image service dynamically generated at the mediator from raster and/or vector fragments More flexible More flexible Services: GridFTP, (un)compress, ImageAssembly, ImageFusion, Query, DataConversion Services: GridFTP, (un)compress, ImageAssembly, ImageFusion, Query, DataConversion Further user interaction - with the new service Further user interaction - with the new service Convenient session management Convenient session management Raster/vector fragments ArcIMS Image Service

Wrappers Raster Mapping Client Vector Mapping Client Java Application Command Module Result Assembly Service Command Module Wrappers Raster Mapping Client Vector Mapping Client Java Application Mediator Source Wrappers Raster Mapping Client Vector Mapping Client Java Application getExtract getFeatures getImage getFeatureCount getServiceInfo compress WSDL: Organizationof map assembly services Organization of map assembly services File Transfer service Uncom- press service Image Assembly service Image Fusion service Query service Data Conversion service ArcIMS Image service Ontology and other services Command.xml Request=extent&query&clienttype Request fragments Response: type&extent&handle Request:type& clienttype&han dle&extent

Map Assembly As Grid Service Creation – via factory interface: Creation – via factory interface: Creates a new grid service instance, as ArcIMS service Creates a new grid service instance, as ArcIMS service Create  grid service handle (unique URL) Create  grid service handle (unique URL) Grid Service Reference (GSR): a WSDL description of the service instance (returned by Http GET on GSH) Grid Service Reference (GSR): a WSDL description of the service instance (returned by Http GET on GSH) Lifetime management: Lifetime management: SoftStateDestruction and ExplicitDestruction interfaces SoftStateDestruction and ExplicitDestruction interfaces Notification and authentication interfaces Notification and authentication interfaces

Mediator Legend Generator Map Assembler Ontology … GRID SERVICES FOR MAP INTEGRATION ArcIMS and WMS Services wrapped in WSDL/SOAP Querying multiple map services In GEON ( DEMO

Questions??