GML Data Models and Web Services for GPS and Earthquake Catalogs Marlon Pierce, Galip Aydin Community Grids Lab, Indiana University

QuakeSim Applications Several QuakeSim codes work directly with observational data. Several QuakeSim codes work directly with observational data. Examples discussed at ACES include Examples discussed at ACES include GeoFEST, VirtualCalifornia, Simplex, and Disloc all depend upon fault models.GeoFEST, VirtualCalifornia, Simplex, and Disloc all depend upon fault models. RDAHMM and Pattern Informatics codes use seismic catalogs.RDAHMM and Pattern Informatics codes use seismic catalogs. RDAHMM primarily used with GPS dataRDAHMM primarily used with GPS data Problem: We need to provide a way to integrate these codes with the online data repositories. Problem: We need to provide a way to integrate these codes with the online data repositories. QuakeTables Fault Database was developedQuakeTables Fault Database was developed What about GPS and Earthquake Catalogs?What about GPS and Earthquake Catalogs? Many formats, data available in tars or files, not searchable, not easy to integrate with applicaitonsMany formats, data available in tars or files, not searchable, not easy to integrate with applicaitons Solution: use databases to store catalog data; use XML (GML) as exchange data format; use Web Services for data exchanges, invoking queries, and filtering data. Solution: use databases to store catalog data; use XML (GML) as exchange data format; use Web Services for data exchanges, invoking queries, and filtering data.

What Are Web Services? Web Services are not web pages, CGI, or Servlets Web Services are not web pages, CGI, or Servlets Web Services framework is a way for doing distributed computing with XML. Web Services framework is a way for doing distributed computing with XML. WSDL: Defines interfaces to functions of remote components.WSDL: Defines interfaces to functions of remote components. SOAP: Defines the message format that you exchange between components.SOAP: Defines the message format that you exchange between components. XML provides cross- language support XML provides cross- language support Suitable for both human and application clients Suitable for both human and application clients Web Server DB JDBC Browser Web Server SOAP Appl SOAP WSDL

Geographical Information Service (GIS) Data Formats and Services OpenGIS Consortium is an international group for defining GIS data formats and services. OpenGIS Consortium is an international group for defining GIS data formats and services. Main data format language is the XML-based GML. Main data format language is the XML-based GML. Subdivided into schemas for drawing maps, representing features, observations, …Subdivided into schemas for drawing maps, representing features, observations, … First Step: design GML schemas and build specialized Web Services for GPS and Earthquake data. First Step: design GML schemas and build specialized Web Services for GPS and Earthquake data. OGC also defines services. OGC also defines services. Services include Web Features Services, Web Map Services, and similar.Services include Web Features Services, Web Map Services, and similar. These are currently pre-Web Service, based on HTTP Post, but they are being revised to comply with WS standards.These are currently pre-Web Service, based on HTTP Post, but they are being revised to comply with WS standards. Next Step: Implement OGC compatible Web Services for this problem. Next Step: Implement OGC compatible Web Services for this problem. Also build services to interact with QuakeTables Fault DB.Also build services to interact with QuakeTables Fault DB.

GML and Existing Data Formats GPS or seismic data used in this project are retrieved from different URLs and have different text formats. GPS or seismic data used in this project are retrieved from different URLs and have different text formats. Seismic data formats Seismic data formats SCSN, SCEDC, Dinger-Shearer, HaukksonSCSN, SCEDC, Dinger-Shearer, Haukkson GPS data formats GPS data formats JPL, SOPAC, USGSJPL, SOPAC, USGS We defined 2 GML Schemas to unify these We defined 2 GML Schemas to unify these A summary of all supported formats and data sources can also be found there. A summary of all supported formats and data sources can also be found there.

So We Built It First version of the system available First version of the system available Tried XML databases but performance was awfulTried XML databases but performance was awful Currently database uses MySQLCurrently database uses MySQL Download results are in GML, but we can convert to appropriate text formats. Download results are in GML, but we can convert to appropriate text formats.

Search DB For Earthquake Catalogs Results

Search XML DB For GPS Catalogs 1

Use Ours or Set Up Your Own URL to access our browser interface: URL to access our browser interface: URL to download and set up your own URL to download and set up your own /install/install.htmlhttp://complexity.ucs.indiana.edu/~gaydin/cce /install/install.htmlhttp://complexity.ucs.indiana.edu/~gaydin/cce /install/install.htmlhttp://complexity.ucs.indiana.edu/~gaydin/cce /install/install.html

Fault Quest: QuakeTables+OGC Web Map Service Demo

Conclusions This is a little discussion with a big conclusion-- This is a little discussion with a big conclusion-- If you want to build iSERVO or something like it, data access services are an important foundation. If you want to build iSERVO or something like it, data access services are an important foundation.

GML Schemas as Data Models for Services Fault and GPS Schemas are based on GML- Feature object. Fault and GPS Schemas are based on GML- Feature object. Seismicity Schema is based on GML-Observation object. Seismicity Schema is based on GML-Observation object. Working schema available from Working schema available from

JSP + Client Stubs DB Service 1 JDBC DB Job Sub/Mon And File Services Operating and Queuing Systems Browser Interface Viz Service Host 1Host 2Host 3 RIVA

QuakeSim Portal Shots

Other Issues We want to abstract the data storage system to allow simple federation of relational and XML databases We want to abstract the data storage system to allow simple federation of relational and XML databases UK e-Science’s OGSA-DAI project is an interesting but complicated example.UK e-Science’s OGSA-DAI project is an interesting but complicated example. We’d like to simplify this approach We’d like to simplify this approach Metadata is also important Metadata is also important Useful for capturing data pedigree and validation.Useful for capturing data pedigree and validation. “This fault data generated with Simplex by Jay Parker using the parameters….” “This fault data generated with Simplex by Jay Parker using the parameters….” “Those 1935 Fault measurements aren’t so good.” “Those 1935 Fault measurements aren’t so good.” We have developed some general applications for metadata management We have developed some general applications for metadata management Newsgroups, citations, references, glossaries as examples.Newsgroups, citations, references, glossaries as examples. Would like to apply to scientific metadataWould like to apply to scientific metadata

Future Directions We are interested in Semantic Web markups (particularly RDFS) to provide metadata descriptions of We are interested in Semantic Web markups (particularly RDFS) to provide metadata descriptions of InstrumentsInstruments Data setsData sets Computing hardwareComputing hardware Applications/codesApplications/codes We want this to form the basis for building composite services. We want this to form the basis for building composite services. Infrastructure improvements: reliable, fault tolerant grid infrastructure needed as grid components come and go. Infrastructure improvements: reliable, fault tolerant grid infrastructure needed as grid components come and go. Component based portals: reuse portal interfaces between projects. Component based portals: reuse portal interfaces between projects. ISERVO: International collaborations with Australia, Japan, and possibly other countries ISERVO: International collaborations with Australia, Japan, and possibly other countries Through ACES: APEC Cooperation for Earthquake SimulationThrough ACES: APEC Cooperation for Earthquake Simulation

Acknowledgements Community Grids: Geoffrey Fox, Choonhan Youn, Galip Aydin, Mehmet Aktas Community Grids: Geoffrey Fox, Choonhan Youn, Galip Aydin, Mehmet Aktas NASA JPL: Andrea Donnellan (PI), Jay Parker, Peggy Li, Robert Granat NASA JPL: Andrea Donnellan (PI), Jay Parker, Peggy Li, Robert Granat UC-Davis: John Rundle UC-Davis: John Rundle UC-Irvine: Lisa Grant UC-Irvine: Lisa Grant USC: Dennis Mcleod USC: Dennis Mcleod Brown: Terry Tullis Brown: Terry Tullis

Problems: Data Access and Sharing, Code Integration Codes all use custom text formats for describing input and output. Codes all use custom text formats for describing input and output. Input and output data often combined with code-specific information. Input and output data often combined with code-specific information. Number of iterations, array sizes, etc.Number of iterations, array sizes, etc. Data files often created by hand from journals, online repositories Data files often created by hand from journals, online repositories Online repositories themselves use differing formatsOnline repositories themselves use differing formats Challenges are to develop common data formats, access services, and client query tools. Challenges are to develop common data formats, access services, and client query tools.

Web Services for Data Access and Computing Service Invocation Web services: Web services: WSDL: Interface definition language, describes your serviceWSDL: Interface definition language, describes your service “GeoFEST may be invoked with these input types” “GeoFEST may be invoked with these input types” SOAP: Transport envelope for remote procedure calls/messagesSOAP: Transport envelope for remote procedure calls/messages “Invoke GeoFEST with this set of input” “Invoke GeoFEST with this set of input” Together, WSDL and SOAP are useful for manipulating, returning XML data values Together, WSDL and SOAP are useful for manipulating, returning XML data values So GML schemas act as our data models and return valuesSo GML schemas act as our data models and return values Status: built several general purpose services Status: built several general purpose services Remotely executing codes, monitoring queuing systems, manipulating/moving files around, describing applications, storing portal session values, accessing data bases of faults,…Remotely executing codes, monitoring queuing systems, manipulating/moving files around, describing applications, storing portal session values, accessing data bases of faults,… Work underway to build data services Work underway to build data services

QuakeSim Basics Under development in collaboration with researchers at JPL, UC-Davis, USC, and Brown University. Under development in collaboration with researchers at JPL, UC-Davis, USC, and Brown University. Geoscientists develop simulation codes, analysis and visualization tools. Geoscientists develop simulation codes, analysis and visualization tools. We need a way to bind distributed codes, tools, and data sets. We need a way to bind distributed codes, tools, and data sets. We need a way to deliver it to a larger audience We need a way to deliver it to a larger audience Instead of downloading and installing the code, use it as a remote service.Instead of downloading and installing the code, use it as a remote service.

What’s the Problem? Data sources typically were provided in single downloads Data sources typically were provided in single downloads Tar bundles or textTar bundles or text This has changed for SCEC catalogs since we developed this project.This has changed for SCEC catalogs since we developed this project. SCIGN is adopting a Web Services approach for GPS data.SCIGN is adopting a Web Services approach for GPS data. Formats defined but presented as text Formats defined but presented as text Use XML to re-format the data.Use XML to re-format the data. Buys us investment in many XML manipulation, validation, and messaging tools.Buys us investment in many XML manipulation, validation, and messaging tools. We wanted to use databases to store and manage the information. We wanted to use databases to store and manage the information. This makes the data queryable This makes the data queryable Retrieve all entries > 1970Retrieve all entries > 1970 Retrieve all entries with M>3.0Retrieve all entries with M>3.0

Data Sources Summary A summary of all supported formats can be found here A summary of all supported formats can be found here servohttp://grids.ucs.indiana.edu/~gaydin/ servohttp://grids.ucs.indiana.edu/~gaydin/ servohttp://grids.ucs.indiana.edu/~gaydin/ servo Information about supported Earthquake catalog formats can be found in Information about supported Earthquake catalog formats can be found in Information about supported GPS data formats can be found in Information about supported GPS data formats can be found in

What Are Web Services? Web services framework is a way for doing distributed computing with XML. Web services framework is a way for doing distributed computing with XML. WSDL: Defines interfaces to functions of remote components.WSDL: Defines interfaces to functions of remote components. SOAP: Defines the message format that you exchange between components.SOAP: Defines the message format that you exchange between components. XML provides cross- language support XML provides cross- language support Suitable for both human and application clients Suitable for both human and application clients Web Server DB JDBC Browser Web Server SOAP Appl SOAP WSDL

Delivering Data for Human and Application Consumption We still have to get the results to the (remote) client. We still have to get the results to the (remote) client. The client may be a user or an application. The client may be a user or an application. Web Services provide a way to do this. Web Services provide a way to do this. Note Web Services are NOT Note Web Services are NOT Web pagesWeb pages ServletsServlets CGI scriptsCGI scripts