Presentation is loading. Please wait.

Presentation is loading. Please wait.

Unicore and the EM Profile

Similar presentations


Presentation on theme: "Unicore and the EM Profile"— Presentation transcript:

1 Unicore and the EM Profile
GGF13 Seoul Korea March 15, 2005 Dr. David F. Snelling Fujitsu Labs Europe Fujitsu Laboratories of Europe © 2004

2 UniGrids Objectives Develop: Create Generic Services for
An OGSA compliant Unicore Implementation A framework and technology for Grid interoperability A framework for Grid economics Create Generic Services for Visualisation and steering of simulations Device monitoring and control Access to distributed data and databases Application instrumentation Influence selected Grid standards and promote European research results

3 Retain These Ideals Unicore Principles Seamless Computing
High Security Portable Server Complex Workflows File Management Advanced Client Interface Extensibility Retain These Ideals

4 Unicore: GPE Architecture
Applications Grid SDK Grid Beans Client Framework U-GPE Grid Programming Library High-level Grid API Operations Job management File transfers Brokering Steering, etc. Descriptions Resources (CIM) Jobs (JSDL) Workflows (BPEL) Open Grid Services Architecture Unicore Atomic Services Web Service Resource Framework (WSRF) WSRF- enabled Servers WSRF- enabled Storage WSRF- enabled Network

5 Unicore GPE Grid Services
Target System Factory Create a virtual compute resource for a VO. Target System Service Job Submit (JSDL and AJO) Resource Description Properties Job Management Service Basic control and status properties File Management Service Copy, Delete, List Directory, ... File Import/Export Services WS Based File Transfer Capability

6 Atomic Services Detail
Operations Service Resource Type Properties TSR-EPR create(type, config) Target System Factory (TSF) Target System Memory=1Gb Running Jobs=23 Storage=Temp, Root etc. create Target System Service (TSS) Extends WS-RP/LT Job-EPR submit(JSDL, initialTT) Job3 Job2 Status=Running OriginalJSDL=<JSDL..> ExecutionJSDL=<JSDL..> etc. Job1 create Job Management Service (JMS) Extends WS-RP/LT start() abort() hold() resume() AvailableFileSpace=127kb SupportedProtocols= {GridFTP, UPL, scp} etc. Work create Storage Management Service (SMS) Extends WS-RP/LT listDirectory(path) listFile(path) createDirectory(path) changePermissions(path, perm) copy(path, path) rename(path, path) delete(path) import(path, protocol, isPipe) export(path, protocol, isPipe) Home Root TS-Property Temp File Import 1 Import 2 Sourcefile=c:/tmp/test.txt DestFile=/tmp/test.txt Transferred=300kb etc. Export 1 Export 2 Sourcefile=/tmp/output.txt DestFile=c:/tmp/output.txt Transferred=12kb create File Import Service (FIS) Extends WS-RP/LT putChunk(offset) File Export Service (FES) getChunk(offset, size)

7 Unicore and JSDL Job Submission Description Language Capabilities
Pre-stage, Execute, Post-stage. Uniformity across batch subsystems. Support for multiple file transfer protocols. Capabilities Optional data sources/sinks, with different credentials possible Seamless or restricted resource description Abstract or concrete application description Suitable for Unicore resource broker and NAREGI scheduler Act as JSDL to JSDL processors Restrictions No support for “Multi-Jobs” or work-flow. Prototype Working in Production

8 Schema Overview <JobDefinition> <JobDescriptionSection>
<JobIdentification ... />? <User id="xsd:uri” ... /> ? <Application id="xsd:uri" ... /> ? <Resource id="xsd:uri” ... />* <DataStaging id="xsd:uri” ... />* <Limits id="xsd:uri” ... />? </JobDescriptionSection> <Profile> <Description ... />? <User id="xsd:uri” ... />? <Application id="xsd:uri" ... />? </Profile>* </JobDefinition>

9 JSDL Example <JobDefinition> <JobDescriptionSection>
<JobIdentification/> <Application id=”Daves App"> <ApplicationName “NanoCodesRS”/> <ApplicationVersion “V1.7a”/> </Application> </JobDescriptionSection> <Profile id=“Profile1”> <Resource id=” LargeSystem”> <ResourceCount “64”/> <CPUCount “8”/> </Resource> </Profile> <Profile id=“Profile2”> <Resource id=” SmallSystem”> </JobDefinition>

10 OGSA Specification Overview
SYSTEMS MANAGEMENT GRID COMPUTING UTILITY COMPUTING Use Cases & Applications Distributed query processing Data Centre Collaboration Persistent Archive ASP Multi Media VO Management Core Services OGSA Self Mgmt OGSA-EMS WS-DAI Information WSDM Discovery GGF-UR WS-Base Notification Naming Privacy Trust GFD-C.16 Infrastructure Specifications WSRF-RP WSRF-RL Data Model WSRF-RAP WS-Security SAML/XACML X.509 WS-Addressing HTTP(S)/SOAP WSDL CIM/JSIM Data Transport GRID Computing, Distributed Computing and Utility Computing are different views of the same important problem domain.

11 Status Legend Standard Evolving Gap Hole
Existing, adopted specification from a recognized Standards Development Organization. Evolving Emerging specifications with reference implementations and standardization in process Gap Identified architectural component with no existing specifications complete, but work is in progress somewhere. Hole Identified architectural component without apparent activity.

12 OGSA Architecture: Status
SYSTEMS MANAGEMENT GRID COMPUTING UTILITY COMPUTING Use Cases & Applications Distributed query processing Data Centre Collaboration Persistent Archive ASP Multi Media VO Management Core Services OGSA Self Mgmt OGSA-EMS WS-DAI Information WSDM Discovery GGF-UR WS-BaseNotification Naming Privacy Trust GFD-C.16 Infrastructure Specifications WSRF-RP WSRF-RL Data Model WSRF-RAP WS-Security SAML/XACML X.509 WS-Addressing HTTP(S)/SOAP WSDL CIM/JSIM Data Transport Hole Gap Evolving Standard


Download ppt "Unicore and the EM Profile"

Similar presentations


Ads by Google