GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics Indiana University, Bloomington IN

Solid Earth Research Virtual Observatory Grid A number of simulation methods for studying earthquakes are being developed by GEM consortium including: –Simplex, Disloc (JPL) –Virtual California (UC-Davis) –PARK codes (Brown) As codes become more robust and accepted, problems emerge: –Need to manage information about distributed data sources: multiple databases, sensors, simulated data. –Need to organize, manage information about multiple code installation sites. –Need to simplify access to data, use of codes, and use of visualization/analysis tools for broad range of users –Need to link together NASA funded activity to develop SERVOGrid Interoperability framework

SERVOGrid Architecture Database Closely Coupled Compute Nodes Analysis and Visualization Repositories Federated Databases Sensor Nets Streaming Data Loosely Coupled Filters

Grid Web Service and Portlet based Portal Architectures Web services are part of a broad industry and academic initiative to build distributed computing infrastructure around existing standards (HTTP, XML, etc). Web services can be used to provide lightweight service descriptions and send messages between components in XML. OGSA (Open Grid Service Architecture) builds on basic Web Services –Component model for Grid replacing/building on CORBA, COM, Enterprise Javabeans etc. Portlets provide component model for user interfaces

Computing Portal Grid Web Services We have built a suite of general purpose Grid Web services for managing distributed applications. Core Computing services define general purpose functions: –Ex: job submission, file transfer, job monitoring, management of jobs and results –Described as a GridShell as plays same role to Grid that Shell does for UNIX on a single machine Application Grid Web services include metadata about applications. –Built on top of core services. –Original application NOT changed We have developed a toolkit that allows one to convert general software packages into Grid Web Services and manage application collections

Raw (HPC) Resources Middleware Database Portal Services System Services Application Service System Services Grid Computing Environments User Services “Core” Grid Application Metadata Actual Application

Application Grid Web Services AGWS are designed to make scientific applications (i.e. earthquake modeling codes) into Grid Resources AGWS services are described by two XML Schemas: –Abstract descriptors describe application options. Used by the application developer to deploy his/her service into the portal. –Instance descriptors describe particular user choices and archive them for later browsing and resubmission.

Portals Aggregate Access to Distributed Services

JSP + Client Stubs DB Service 1 JDBC DB Job Sub/Mon And File Services Operating and Queuing Systems Browser Interface DB Service 2 JDBC DB Host 1Host 2Host 3

GEM Portlets and Portal Stacks User interfaces to GEM services (Code Submission, Job Monitoring, File Management for Host X) are all managed as portlets. Users, administrators can customize their portal interfaces to just precisely the services they want. Core Grid Services User facing Web Service Ports Application Grid Web Services Aggregation Portals Message Security, Information Services

File Selector Screenshot Users can view files on remote hosts –Shown is user file list for host noahsark. –Host solar is also shown. Files can be uploaded or downloaded between PC and remote host. Files may be crossloaded between two remote hosts. Same interface definition may be used to access databases.

Lists user files on selected host, noahsark. File operations include Upload, download, Copy, rename, crossload Tabs indicate available portlet interfaces. File management

Application Selection Screen Shots Users can select from available codes (Simplex, Disloc, various VirtualCalifornia) Users also select from available hosts for particular code (grids, noahsark, solar shown). Selecting solar (Sun 64 Node E10000) prompts user for information needed to use PBS script generating service.

Select desired application and host Generate script for job submission User Application Selection and Submission

Application Administrator Interfaces Application Administrators deploy and manage applications Update screen shows various application and host parameters that are set by the user. These are used to generate user interfaces for the selected codes.

Provide information about application and host parameters Select application to edit Administer Grid Portal

Futures I: General Capabilities System builds on Gateway Portal developed for NCSA Alliance and DoD HPCMO. This project intends to: Integrate portlets from other groups in collaborations (common interoperability framework for all tiers) Continue developing message-based security system (currently available as demonstration) that signs SOAP messages. Integrate AGWS and Results Manager with arbitrary Schema Wizard/Storage/Browser system used in Indiana XML newsgroups. Add negotiation capabilities to Web Services for version control Track evolving OGSA service standards and implementations. Add dynamic information service and monitoring capabilities for transient Web Services. Distributed, ant-based tools to simplify service upgrades of distributed servers (and simplify our lives).

Futures II: SERVOGrid Assist with design of common data format and associated tools for GEM codes. –i.e. SERVOGrid Object Model defined in XML Add support for service linkage (workflow) for specific GEM applications –e.g. Disloc Simplex interoperation). Add support for Web-based visualization with portlet interface. SERVOGrid portal will be publicly available