UK Role in Open Grid Services Architecture Towards an Architectural Road Map Malcolm Atkinson Director of NeSC 18 th April 2002

Outline Background What is OGSA? The Confluence of Web Services & Grid Presented already by Ian Foster The UK Architectural Task Force Why Engage with OGSA What should the UK do

Web Services Grid Technology Grid Services

UK ATF Malcolm Atkinson Jon Crowcroft David De RoureVijay Dialani Andrew HerbertIan Leslie Ken MoodySteven Newhouse Tony Storey …………… Plus consultations UK Role in Open Grid Services Architecture, Version th March teams ATF

Why Change? Fire fighting safety Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Whole population health monitoring Epidemic Detection & Management Understanding Cells & Organs In Flight problem management Oceans, Climate, Ecosystems, … AmbitionData Challenge Deluge of Data More, Faster Digital Streams Heterogeneous evolving models Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software Encapsulating understanding Multiple technologies Heterogeneous evolving models Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution scientists, resources & instruments Diverse: Organisations & Countries Mobile: equipment, people & phenomena Uncertainty about communication quality Sustaining the Computation Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Do it often Run it for everyone Do it for everything Do it quickly Keep it running Pay for it Change it often

Why Change? Fire fighting safety Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Whole population health monitoring Epidemic Detection & Management Understanding Cells & Organs In Flight problem management Oceans, Climate, Ecosystems, … AmbitionData Challenge Deluge of Data More, Faster Digital Streams Heterogeneous evolving models Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software Encapsulating understanding Multiple technologies Heterogeneous evolving models Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution scientists, resources & instruments Diverse: Organisations & Countries Mobile: equipment, people & phenomena Uncertainty about communication quality Sustaining the Computation Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Best of Both Worlds Description Driven Dynamic Integration (WS) Automated Generation of Code (WS) Security (Grid & WS) Resource Discovery (WS & Grid) High-level Platform (WS & Grid) Tools (WS) Distribution & Heterogeneity (WS & Grid) …

Why Change? Fire fighting safety Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Whole population health monitoring Epidemic Detection & Management Understanding Cells & Organs In Flight problem management Oceans, Climate, Ecosystems, … AmbitionData Challenge Deluge of Data More, Faster Digital Streams Heterogeneous evolving models Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software Encapsulating understanding Multiple technologies Heterogeneous evolving models Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution scientists, resources & instruments Diverse: Organisations & Countries Mobile: equipment, people & phenomena Uncertainty about communication quality Sustaining the Computation Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Dominant Data: Common Needs Metadata & Discovery Grid Data Management (Giggle) Grid FTP Databases & Transactions (WS) Distributed Data Mining Information Management Knowledge Management

Why Change? Fire fighting safety Eruption, Flood & Pollution Response Diagnosis & Treatment Planning Whole population health monitoring Epidemic Detection & Management Understanding Cells & Organs In Flight problem management Oceans, Climate, Ecosystems, … AmbitionData Challenge Deluge of Data More, Faster Digital Streams Heterogeneous evolving models Uncertainty about data quality Finding the Nuggets Reason to Trust the Answer Software Challenge Composing Software Encapsulating understanding Multiple technologies Heterogeneous evolving models Uncertainty about component quality Solving a Problem Reason to Trust the Answer An Answer in Time Dependability Challenge Geographic Distribution scientists, resources & instruments Diverse: Organisations & Countries Mobile: equipment, people & phenomena Uncertainty about communication quality Sustaining the Computation Problem Detection & Recovery, Security, … Reason to Trust System Dependability Affordable Common Issues New Opportunity Grid Protocols & Services SOAP multiple mappings Grid Monitoring & Management Security (WS & Grid) …

UK Focus: Data Knowledge

The Picture from Space Phase 1: Foundations & Planning GGF Collaboration on OGSA Design & Prototyping Requirements, Education & Consultation Common Infrastructure Baseline DB Access & Integration Validation & Testing Baseline Logging Infrastructure Phase 2: Automation & Information Refining & Exploiting Description Languages Data Information Semantic Grid Advanced DB Integration Scheduling for Data Intensive Computation Computational Grid Economies Trustable ServicesPerformance EngineeringDependable EngineeringDesign for TestabilityEngineering for ChangeManagement & Ops SupportPrivacy, Ethics & Legal

Project Transitions NowQ2Q3Q4Q1Q2Q3Q GT3 GT2 Demo at GGF Specification & Motivation Early Adopters Testers

Building OGSA Capability NowQ2Q3Q4Q1Q2Q3Q Demo at GGF Specification & Motivation GT3 GT2 Early Adopters Testers GSI + WS Alpha GT3Beta GT3Production GT3 Requirements & Consultation Architecture Road Map & Advisory Documents Early DB Integration components Review New Core M/W Projects Advanced Integration Components Semantic Grid Components Grid economy infrastructure

The First Steps Best available platform from industry & Globus Demo., Design & Review Beta release to selected projects Logging & Monitoring Semantics of WS Description Languages Advanced Information Handling Pilot Project & Community Consultation Web Services & GSI & AxisTrials of Web Services & GSI & Axis Infrastructure: GS APIs, Types & Primitives Grid DB Access Services Requirements & Standards Trials: Grid DB Access Services

What does it mean? More Description What it does How it delivers Security Coordination … More Support Late dynamic binding Context adaptation Tools & Automation Visualisations Autonomic infrastructure … Increased Flexibility Industrial Forces Supported technology Political force Immovable force? Standards … Extensive Families Type systems & Schema Composable Services Standards requirement … Changes The way we share The way we think Higher-level Discourse

?

Web Services Rapid Integration Dynamic binding Commercial Power Financial & Political Independence Client from Service Service from Client Separation Function from Delivery Description WSDL, WSC, WSEF, … Tools & Platforms Java ONE, Visual.NET WebSphere, Oracle, … www. w3c. org / TR / SOAP or TR/wsdl

Grid Technology Virtual Organisations Sharing & Collaboration Security Single Sign in, delegation Distribution & fast FTP But Various Protocols Resource Mangement Discovery Process Creation Scheduling Monitoring Portability Ubiquitous APIs & Modules Govnmt Agency Buy in Foster, I., Kesselman, C. and Tuecke, S., The Anatomy of the Grid: Enabling Virtual Organisations, Intl. J. Supercomputer Applications, 15(3), 2001

Open Grid Services Architecture Virtual Grid Services Applications Multiple implementations of Grid Services Using operations Implemented by OGS infrastructure Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration

OGSA Features WSDL + WSIL + WSEL + … Description Discovery Tools & Platforms Apache axis … Invocation SOAP RPC / RMI Optimised binding Representations XML + Schema Life Time Management Factories Transient & Persistent GS GS Handles GS Records Soft State Notification Authentication Certificates + Delegation Change Management Platform Foster, I., Kesselman, C., Nick, J. and Tuecke, S., The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration

OGSA Development More Description More Languages Trustworthy services Owners, Costs & Charging Transaction & Coordination Work Flow Precision & Semantics Tools & Platforms Partial Models Varied, open, analysis, synthesis Directed composition Change Managers Invocation & Reps Standard Schemas Namespaces Engineering Factories Transient & Persistent GS GS Handles GS Records Soft State Notification Design for Testability Dynamic Testing Change Management Dynamic Evolution Platforms Mapping to host, invocation, notification, protocol transmission, authentication

OGSA Development 2 Higher-Level Description Information-level Semantic-level Virtualisation Tools & Platforms Higher-level Models User-Guided Automation Invocation & Reps Agreed Semantic Models Trustworthy Translation Engineering Accessible Trade-offs Dynamic Control Autonomic Design for Q and Test Q Testing & Certification Change Management Dynamic Evolution Platforms Raising their level More high-level facilities Coherent Understandable Specified