1. Page 1 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Current Status of GMU Grid Project and OGC OWS 2.0 Update Laboratory for Advanced Information Technology and Standards (LAITS) George Mason University (GMU) ldi@gmu.edu http://laits.gmu.edu September 8, 2004 Liping Di

2. Page 2 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Content of the presentation Introduction Status of Software Development and Integration. –Data and service catalogs Grid-based catalog service for web (GWRS) –Metadata –Services –BPEL engine –Web service client Status of Testbed deployment –Development environment at GMU/LAITS –Creditable testbed to be deployed. –Data at the testbed –Services available at the testbed. OGC OWS 2.0 Update

3. Page 3 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Introduction GMU’s OGC Grid project is to provide Geospatial web services, which are compliant with OGC specifications, at the Grid environment –Enable interoperable data access to large data archives. –Provide standard-based chainable geospatial analysis services –Provide geospatial modeling and virtual data product generation. Partners in the project –NASA Ames Research Center (NASA Information Power Grid). –DOE Lawrence Livermore National Lab (LLNL) (Earth System Grid). This project is also a part of CEOS Grid testbed. Funded by NASA Earth Science Technology Office (ESTO) –Three-year project from May 2003-April 2006 This presentation gives an update on recent progress of this project since last WGISS meeting.

4. Page 4 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 The Grid-enable CSW (GCSW) In the past several months, we developed a data and service catalog server based on OGC Catalog Service for Web (CSW) specification. –written in Java with JDBC connection to MySQL. Any OGC CSW clients can access the server for catalog service (web service). The server is wrapped as a Grid catalog service. –Provide both data (both virtual and non-virtual) and grid- enabled service catalogs. –Enable other Grid services to access the catalogs.

5. Page 5 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Current implementation of OGC CSW App. Client/User Interface Dataset Catalogue entry Service Catalogue entry Web Service (AXIS) Server Catalogue Service for Web IM IM: Information Model System Environment Solaris/Linux Tomcat/Ant GT 3.2 (Grid Service) MySQL CSW as Web Service OGC Interface as Web Service Grid Service Interface data served by service service referenced by data cross-reference Metadata generating Service Type Catalogue entry Data object Service Instance GCSW as Grid Service repositoryItem Grid Tools (Globus 3.2) (GSI, GridFTP, RLS) Grid Service Specifications (OGSA/OGSI) Grid Technologies

6. Page 6 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Design of the Information Model (IM) of GCSW RegistryObject Classification ClassificationSchema …… Association ServiceBindings RegistryEntry Service ExtrinsicObject CSWExtrinsicObject RepositoryItem Service IM (ISO 19119) Dataset IM (ISO 19115) NASA EOS Core System (ECS) ebRIM + OGC Catalogue Service for CSW + OGC Catalogue Service for ISO 19115/19119

7. Page 7 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Integration for OGC & Grid w/GCSW Query GCSW Job submit Job status query Job result return GWCS iGSM Grid Client WC S GCSW CS W GWMS WMS RLS OGC Client Remote Local GWCS WC S 1 8 2 7 3 4 5 6 Mod i 1 iGSM: intelligent Grid Service Mediator Grid Services OGC Services OGC request and responseGrid request and response GWCS: Grid enabled WCS working as Grid Service Client Server

8. Page 8 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Data Flow Diagram for Integration w/GCSW Ames HDF Data GMU HDF Data local GWCS remote GWCS User Data Request iGSM Is data local? GCSW Yes No iGSM Security Authentication Job submit Remote secure copy MPGC request or Other standard OGC request remote GWMS

9. Page 9 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Design of the Metadata IM for GCSW ISO 19115 Part one ISO 19115 Part two (FGDC extenstion) NASA ECS ISO 19119 Dataset Type Metadata Dataset Instance Metadata Service Type Metadata Service Instance Metadata Abstract/Extract Dataset Instance Metadata (dt_md) (IM11) datasetTypeID (dtTypeID) M productName -- LongName (resTitle) M productDateTime (resRefDate -> resProDate) M responsibleParty (respParty) (to IM12) M BBOX (westBL, eastBL, northBL, southBL) M datasetLanguage (dataLang) (Default: English) M datasetCharacterSet (dataChar) (Default: utf8) topicCategory -- ECSTopicKeyword (tpCat) M spatialResolution (dataScaleDist) datasetAbstract -- CollectionDescription (idAbs) M distributionFormat (disFormatName) (Default: hdf) distributionVersion (disFormatVersion) (Default: 1.0) collectionRange – (beginDateTime, endDateTime) spatialRepresentationType (spatRpType) (Default: grid) referenceSystemInfo (refSysInfo) (to IM13) lineageStatement (lnStatement) onlineResourceLinkage (olResLink) metadataFileIdentifier (mdFileID) metadataStandardName (mdStanName) metadataStandardVersion (mdStandVer) metadataLanguage (mdLang) metadataCharacterSet (mdChar) mdResponsibleParty (mdRespParty) (to IM12) M mdDateStamp (mdDateSt) M instrumentLongName (instflnm) instrumentShortName (instshnm) M platformLongName (platflnm) platformShortName (flatshnm) M processingLevelID (prolevid) M ECSTopicKeyword (tpKeyword) M ECSDisciplineKeyword (dsKeyword) M ECSVariableKeyword (vrKeyword) ECSTermKeyword (tmKeyword) datasetStatus -- CollectionState (idStatus) … … Metadata Instance

10. Page 10 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Extraction of HDF-EOS Metadata for GCSW HDF File (MODIS, ASTER, … ) ECS – ISO Mapping Table XML File (Based on ISO19139) Template XML File (Based on ISO19139) ECS Metadata Key/Value Read out Map ISO Metadata Key/Value Modify 1 2 3 a b a b Create a mapping table between ECS metadata and ISO19139 metadata. Store it in MySQL database. Create a template XML file based on the selected ISO19139 schemas. Pre-steps 1 2 3 Read out the ECS metadata from HDF files (MODIS, ASTER, … ). Map the ECS metadata elements to ISO elements according to the selected ISO19139 schemas. Modify the template XML file by inserting the mapped ISO elements. Steps

11. Page 11 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Analysis/Transformation Services Several services are developed as a part of OGC OWS 2.0 and GeoBrain Projects. –Web Image Classification Service (WICS) Provide both unsupervised and supervised multi-band classification services. –Web Coordinate Transformation Service (WCTS) Provide reprojection services for 12 map projections supported by NASA HDF-EOS. –Both services are chainable –Draft OGC WICS and WCTS specifications are based on those two implementations. A chainable reformatting service is being developed –Support about 40 formats. More chainable geospatial analysis services are going to be developed in the near future –SOAP Interface, WSDL description. All services are being wrapped as Grid services.

12. Page 12 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 BPELPower LAITS has developed a BPEL management and execution engine called BPELPower. –Based on Open Source software such as BPWS4J, WSIF, WSDL4J, AXIS and SOAP which only provide the function library. –Running on the top of application servers, such as Tomcat, J2EE, JBoss, Weblogic, and WebSphere. Integrates services into collaborative and transactional business processes. Supports the various invocation of web services, e.g., EJB, JMS, JCA, SOAP, MIME, HTTP GET / POST and Java classes.

13. Page 13 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 BPELPower Functions Displaying processes and services (including part of IBM BPWS4J functions); Deploying and un-deploying processes and services(including part of IBM BPWS4J functions); Executing simple processes and services automatically; Executing simple processes and services manually; Executing complex processes and services automatically; Executing complex processes and services manually; Managing processes and services; Managing instances and activities; Web addresses with examples of workflows –simple interface http://bpel.laits.gmu.edu/bpelpower/admin/index.html http://bpel.laits.gmu.edu/bpelpower/admin/index.html –new interface, under constructing http://bpel.laits.gmu.edu/bpelpower/admin/index.jsp http://bpel.laits.gmu.edu/bpelpower/admin/index.jsp

14. Page 14 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Web Service Client Our Grid system will provide OGC Interfaces. –OGC client will be able to access the Grid the same as OGC Web services. Our OGC compliant client--Multi-protocol Geospatial Client (MPGC) has been updated to support –OWS 2 WCS enhancement (WCS 1.0.2.0) –Support the CSW specification –Dynamic construction of geospatial process models (Service chaining and virtual data generation)

15. Page 15 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Current VO for the Testbed GMU Laits (Solaris) (laits.gmu.edu) Globus 3.2.1 with IPG CEOS Certs. GMU Llinux (Linux) (llinux.laits.gmu.edu) Globus 2.2 with Laits Certs. Ames Evelyn (Irix) Globus 2.4 with IPG Certs. GMU CA center Ames Angel (Linux) Globus 3.0 with IPG Certs. GMU LAITS VO NASA IPG VO GMU Data (Linux) (data.laits.gmu.edu) Globus 3.2.1 with Laits Certs.

16. Page 16 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Testbed Update  Installed gt3.0 on a Linux machine and gt2.4 on an Irix machine at NASA Ames. Now Ames is upgrading machines with new security, when it is finished, we will upgrade to gt3.2.1 and gt3.9.2.  Installed gt3.2.1 and gt3.9.2 on Sun Solaris and one of Linux machines, and gt2.2 on another Linux machine at GMU LAITS.  Issued IPG certificates to the above machines at GMU LAITS and NASA Ames, and test and debug their authentication to each other among those boxes.  Setup MCS/RLS at GMU LAITS and NASA Ames.  Setup MySQL server at GMU LAITS and NASA Ames.  Work is in progress with DOE LLNL to join the virtual organization.  In order to build a credible test environment, LAITS is adding a new computer system into the testbed

17. Page 17 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 The New Computer System The new computer system is used to build a creditable testbed for both OGC Grid and GeoBrain projects. –The system will be arrived at mid September. The system consists of –3 Apple X servers, each having 2 G5 CPUs (1 head node and 2 cluster nodes) –Each server has an unique Internet address while the head node can distribute tasks to the cluster nodes –3 X Raid storages, 3.5 TB each (Total 11.5 TB disk space) –The Raid storage is linked to servers through a fiber channel switch. –The fiber channel switch is also linked to GSFC SAN. –The system is configured to allow adding more cluster nodes and Raid disks. The system will be hosted by NASA GSFC –1 Gb/s Internet connection is provided to the system.

18. Page 18 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Datasets at the testbed We will put variety of data generated by NASA on the system. –MODIS low and high level products. –Global topographic data generated by Shuttle. –Landsat 1990 and 2000 global datasets. –Aster, MISR, etc. Those data will be the foundation for the services provided by our system.

19. Page 19 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Services at the system OGC-compliant data access and process services will be available at the system –Data access: WCS, WMS, CS/W-available at the end of this year. –Process services: WCTS, WICS, Reformating, …. All services are available both to CEOS Grid testbed and as general web services. Virtual geospatial products will be provided through geospatial modeling and workflow executions –All services available at the system are chainable and can be bond with OGC-compliant data sources dynamically. The services will be available to all Internet users in the form of web services and to all users in the Grid virtual organization through Grid services.

20. Page 20 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Screenshot of the Prototype System http://grid.laits.gmu.edu Grid Environment and Virtual Organization (VO)

21. Page 21 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – MPGC WCS This is a WCS client portal to access Grid- Enabled OGC compliant Services.

22. Page 22 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – MPGC WRS URL of WRS Query Theme Query Items based on Metadata Query Results – Registered Objects Registered Object Detail

23. Page 23 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – WRS web interface 1/2 Query Interface http://llinux.laits.gmu.edu:8080/WRShttp://llinux.laits.gmu.edu:8080/WRS

24. Page 24 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – WRS web interface 2/2 Query Result Return Interface

25. Page 25 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – CSW web interface 1/4 OpenGIS Catalogue Services for Web (CSW) http://www.laits.gmu.edu:8099/cswhttp://www.laits.gmu.edu:8099/csw

26. Page 26 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – CSW web interface 2/4 CSW getCapabilities()’s GET & POST methods interface

27. Page 27 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – CSW web interface 3/4 Result return interface for CSW getCapabilities()

28. Page 28 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 End User Interface – CSW web interface 4/4 CSW getRecords() POST method interface

29. Page 29 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 OGC OWS 2.0 Update OGC Web Service Initiative 2.0 (OWS 2.0) –March 2004 to September 2004 OWS 2.0 Threads –OWS Common Architecture –Information Interoperability –Imagery Handling Services/Decision Support (IH4DS) –Technical Baseline Maturation –GeoScout –OpenLS™ services. Two Demonstration –Natural Resource Demo supported by IH4DS –Defense Demo supported by GeoScout LAITS involved in IH4DS –Many software development reported in this presentation is also part of the OWS 2.0

30. Page 30 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 OWS Common Architecture The Common Architecture (CA) thread addresses issues and requirements driving the further elaboration of the of the core set of OGC specifications to bring them inline with the industry mainstream Web Services implementations. –Define a consistent adaptation and integration of Web Services standards, defined by leading organizations such as W3C, OASIS, Microsoft, IBM, Sun Microsystems, and the open-source community, with the OWS service framework in general and the set of core OGC specifications (WMS, WFS, CS-W, WCS, and WOS). –Address issues of fundamental architectural significance to OWS, including metadata about resources (services and data) how to adopt Web Service (specifically WSDL, SOAP, UDDI) technologies Common Architecture for WMS, WFS, CS-W, WCS, WOS.

31. Page 31 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Information Interoperability The Information Interoperability (II) thread of OWS2 focuses on the interoperable expression, exchange and access of geographic information within and across information communities (Information communities are groups that share common geographic terms and common spatial feature definitions). The work of OWS2 for this thread includes –Application Schema from GML Schema –WFS Support for GML Level 0 Profile –Integrated Reference Client supporting: WFS WMS CS/W WCS

32. Page 32 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Technical Baseline Maturation The OGC Technical Baseline contains a list of all OGC specifications and specification candidates, their type, title, current version, document number, description, and primary author/editor. This information provides the reader with a current snapshot of work within the OGC. OWS 2.0 develops conformance tests for the core set of the Technical Baseline that include: WMS, WFS, CS-W, WCS, and WOS.

33. Page 33 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 GeoScout The purpose of the GeoScout task is to mature the OGC technology base so that the GeoScout program can purchase and deploy SCOTS products with a high confidence of success. –This thread leverages the work being done under the Information Interoperability (II) and Technical Baseline Maturity (TBM) tasks and applies it to the GeoScout specific requirements. Only open to US participants –Application Schemas –SCOTS Assessment and Enhancement

34. Page 34 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 OpenLS™ services The OpenGIS Location Services (OpenLS) represent an open (middleware) platform for location-based application services for mobile assets and terminals. The primary goal of the OpenLS initiative series is to define the specifications for the “Core Services and Abstract Data Types (ADT)” that comprise this platform. –The services are defined in two OGC specifications. The OWS 2 work is to –Enhance these specs (add minor features). –Add new specifications for traffic and tracking services.

35. Page 35 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Imagery Handling Services for Decision Support (IH4DS) Working on the following areas: –Image Archive Server (WCS enhancements) (GMU lead) –Image Metadata (GMU lead) –Image processing services Web coordinate transformation service (WCTS) (PCI & GMU lead) Web Image classification service (WICS) (GMU lead) –Chaining and Orchestration (Intergraph & GMU lead) –Decision Support Client (Intergraph lead) Participants: –GMU/LAITS, Ionic, Raytheon (NASA Data Pools), Intergraph, PCI, SPOT Image Interoperability Program Reports (IPR) –WCS change proposal (WCS 1.0.2.0) –IM, WICS, WCTS IPR

36. Page 36 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 OWS 2 IH4DS Demo The IH4DS demo was conducted on September 2 at Raytheon Landover facility The demo scenario is forest fire near LA The demo shows how OGC specifications can help the decision support for fighting the forest fires in 3 phases –Pre-fire : Evaluate the fire danger through estimating the availability of fuels- using MODIS and Landsat data. –During fire: Detecting fires using MODIS for early detection, SPOT, and air-borne remote sensors for hotspot validation and monitoring. –After fire: Damage estimation by using SPOT data (Burn scar classification). Shows the individual services. Shows chain of WCS, WCTS, and WICS for fire detection, locating, mapping, and fire damage estimation (virtual products). Interoperability of workflows are also shown.

37. Page 37 LAITS Laboratory for Advanced Information Technology and Standards 9/6/04 Thank You for your attention ! Any Questions ?