Unicore and the EM Profile GGF13 Seoul Korea March 15, 2005 Dr. David F. Snelling Fujitsu Labs Europe Fujitsu Laboratories of Europe © 2004

UniGrids Objectives Develop: Create Generic Services for An OGSA compliant Unicore Implementation A framework and technology for Grid interoperability A framework for Grid economics Create Generic Services for Visualisation and steering of simulations Device monitoring and control Access to distributed data and databases Application instrumentation Influence selected Grid standards and promote European research results

Retain These Ideals Unicore Principles Seamless Computing High Security Portable Server Complex Workflows File Management Advanced Client Interface Extensibility Retain These Ideals

Unicore: GPE Architecture Applications Grid SDK Grid Beans Client Framework U-GPE Grid Programming Library High-level Grid API Operations Job management File transfers Brokering Steering, etc. Descriptions Resources (CIM) Jobs (JSDL) Workflows (BPEL) Open Grid Services Architecture Unicore Atomic Services Web Service Resource Framework (WSRF) WSRF- enabled Servers WSRF- enabled Storage WSRF- enabled Network

Unicore GPE Grid Services Target System Factory Create a virtual compute resource for a VO. Target System Service Job Submit (JSDL and AJO) Resource Description Properties Job Management Service Basic control and status properties File Management Service Copy, Delete, List Directory, ... File Import/Export Services WS Based File Transfer Capability

Atomic Services Detail Operations Service Resource Type Properties TSR-EPR create(type, config) Target System Factory (TSF) Target System Memory=1Gb Running Jobs=23 Storage=Temp, Root etc. create Target System Service (TSS) Extends WS-RP/LT Job-EPR submit(JSDL, initialTT) Job3 Job2 Status=Running OriginalJSDL=<JSDL..> ExecutionJSDL=<JSDL..> etc. Job1 create Job Management Service (JMS) Extends WS-RP/LT start() abort() hold() resume() AvailableFileSpace=127kb SupportedProtocols= {GridFTP, UPL, scp} etc. Work create Storage Management Service (SMS) Extends WS-RP/LT listDirectory(path) listFile(path) createDirectory(path) changePermissions(path, perm) copy(path, path) rename(path, path) delete(path) import(path, protocol, isPipe) export(path, protocol, isPipe) Home Root TS-Property Temp File Import 1 Import 2 Sourcefile=c:/tmp/test.txt DestFile=/tmp/test.txt Transferred=300kb etc. Export 1 Export 2 Sourcefile=/tmp/output.txt DestFile=c:/tmp/output.txt Transferred=12kb create File Import Service (FIS) Extends WS-RP/LT putChunk(offset) File Export Service (FES) getChunk(offset, size)

Unicore and JSDL Job Submission Description Language Capabilities Pre-stage, Execute, Post-stage. Uniformity across batch subsystems. Support for multiple file transfer protocols. Capabilities Optional data sources/sinks, with different credentials possible Seamless or restricted resource description Abstract or concrete application description Suitable for Unicore resource broker and NAREGI scheduler Act as JSDL to JSDL processors Restrictions No support for “Multi-Jobs” or work-flow. Prototype Working in Production

Schema Overview <JobDefinition> <JobDescriptionSection> <JobIdentification ... />? <User id="xsd:uri” ... /> ? <Application id="xsd:uri" ... /> ? <Resource id="xsd:uri” ... />* <DataStaging id="xsd:uri” ... />* <Limits id="xsd:uri” ... />? </JobDescriptionSection> <Profile> <Description ... />? <User id="xsd:uri” ... />? <Application id="xsd:uri" ... />? </Profile>* </JobDefinition>

JSDL Example <JobDefinition> <JobDescriptionSection> <JobIdentification/> <Application id=”Daves App"> <ApplicationName “NanoCodesRS”/> <ApplicationVersion “V1.7a”/> </Application> </JobDescriptionSection> <Profile id=“Profile1”> <Resource id=” LargeSystem”> <ResourceCount “64”/> <CPUCount “8”/> </Resource> </Profile> <Profile id=“Profile2”> <Resource id=” SmallSystem”> </JobDefinition>

OGSA Specification Overview SYSTEMS MANAGEMENT GRID COMPUTING UTILITY COMPUTING Use Cases & Applications Distributed query processing Data Centre Collaboration Persistent Archive ASP Multi Media VO Management Core Services OGSA Self Mgmt OGSA-EMS WS-DAI Information WSDM Discovery GGF-UR WS-Base Notification Naming Privacy Trust GFD-C.16 Infrastructure Specifications WSRF-RP WSRF-RL Data Model WSRF-RAP WS-Security SAML/XACML X.509 WS-Addressing HTTP(S)/SOAP WSDL CIM/JSIM Data Transport GRID Computing, Distributed Computing and Utility Computing are different views of the same important problem domain.

Status Legend Standard Evolving Gap Hole Existing, adopted specification from a recognized Standards Development Organization. Evolving Emerging specifications with reference implementations and standardization in process Gap Identified architectural component with no existing specifications complete, but work is in progress somewhere. Hole Identified architectural component without apparent activity.

OGSA Architecture: Status SYSTEMS MANAGEMENT GRID COMPUTING UTILITY COMPUTING Use Cases & Applications Distributed query processing Data Centre Collaboration Persistent Archive ASP Multi Media VO Management Core Services OGSA Self Mgmt OGSA-EMS WS-DAI Information WSDM Discovery GGF-UR WS-BaseNotification Naming Privacy Trust GFD-C.16 Infrastructure Specifications WSRF-RP WSRF-RL Data Model WSRF-RAP WS-Security SAML/XACML X.509 WS-Addressing HTTP(S)/SOAP WSDL CIM/JSIM Data Transport Hole Gap Evolving Standard