Presentation is loading. Please wait.

Presentation is loading. Please wait.

Software Solutions & group Copyright © 2007 Intel Corporation Ralf Ratering, Hans–Christian Hoppe Intel Software&Solutions Group GPE4UNICORE Grid Programming.

Similar presentations


Presentation on theme: "Software Solutions & group Copyright © 2007 Intel Corporation Ralf Ratering, Hans–Christian Hoppe Intel Software&Solutions Group GPE4UNICORE Grid Programming."— Presentation transcript:

1 Software Solutions & group Copyright © 2007 Intel Corporation Ralf Ratering, Hans–Christian Hoppe Intel Software&Solutions Group GPE4UNICORE Grid Programming Environment for UNICORE

2 Copyright © 2007 Intel Corporation How about other Grid Software? GPE services run in the Globus Toolkit 4 container GPE client framework works with UNICORE6 and ChinaGrid What is GPE good for? GPE turns a collection of distributed computers/data centers into a Grid Why does Intel develop GPE? GPE is an Open Source technology demonstrator for customers and ISVs Influence standards Drive new technologies into market What does GPE provide? A full Grid Software stack including graphical user interfaces and programming libraries ?

3 Copyright © 2007 Intel Corporation GPE Current Status GPE included in UNICORE6 alpha6 release at www.unicore.eu/download/unicore6 –Application Client and GridBeans –Expert Client –BPEL workflow service –UNICORE-specific source code available from CVS Main GPE development under http://gpe4gtk.sourceforge.net –Complete GPE sources available under BSD license –Server implementation uses Globus Toolkit 4 container

4 Copyright © 2007 Intel Corporation GPE Ecosystem GPE4GTK as standalone solution –Intel software testing –Proof of concepts at customers –Research and Education GPE user interfaces and GridBeans –UNICORE 6 –China Education Grid (Ministry of Education) –South Korea (K-Grid) Support for virtual machine technology –Cooperation with Globus team –Cooperation with CERN –Strong interest in industry

5 Copyright © 2007 Intel Corporation Why do we engage in UNICORE? Major Grid platform in European HPC community UNICORE is great for HPC on demand UNICORE6 implementation will have great performance and scalability Join forces in standards bodies

6 Copyright © 2007 Intel Corporation GPE Components Globus Toolkit 4 Container TSI Atomic Services Service Registry Resource Broker BPEL Workflow Service OS Repository Service Application Client Portal Client Expert Client Admin Client UNICORE6 container Atomic Services Service Registry Resource Broker BPEL Workflow Service TSI GPE Client API GridBeans File Manager

7 Copyright © 2007 Intel Corporation Atomic Services: Standard Grid Interfaces using WSRF Target System Factory Target System Service Job Management Service Storage Management Service File Transfer Service Add target system to Grid Target System Resource Hardware and software properties, workload, etc. Use target system Job Resource Job status, description, owner, etc. Manage jobs Storage Resource Available file space, mount point, etc. Manage file transfers Access storages File Transfer Resource Transferred bytes, used port numbers, etc. Properties Resources Services Operations

8 Copyright © 2007 Intel Corporation How do GridBeans work? Applications Services GridBean Service Application GridBean download Apps Client Expert Client Portal Client Application GridBean App2 GB App3 GB App1 GB GridBeans encapsulate application logic GridBeans provide Swing interfaces for Java clients and JSR-168 portlets for web portals GridBeans create JSDL descriptions from user input

9 Copyright © 2007 Intel Corporation Data Center 1 GPE: Running a Workflow... Atomic Services Resource Broker BPEL Workflow Service send job description including workflow Other web services orchestrate Implements Target System Service Interface Applications Services Utility

10 Copyright © 2007 Intel Corporation A GPE- BPEL Workflow Wait until job status is SUCCESSFUL or FAILED Start the job: Start request is stored in startJobRequest variable Wait until the job status is READY or FAILED Retrieve the job EPR from the SubmitResponse through jobManagement partnerlink JSDL Submit JSDL to target system service

11 Copyright © 2007 Intel Corporation Implementing and Influencing Standards with GPE Open Grid Forum (OGF) –JSDL (Job Submission Description Language) GPE-BPEL extension –OGSA (Open Grid Services Architecture) BES (Basic Execution Services) DMI (Data Movement Interface) –ByteIO (File Transfer and Streaming) OASIS –WSRF (Web Services Resource Framework) –WSN (Web Services Notification) –WSS (Web Services Security) –WSBPEL (WS-Business Process Execution Language) W3C –WS-Addressing, SOAP, WSDL, XML, etc.

12 Copyright © 2007 Intel Corporation Expert Client DEMO

13 Copyright © 2007 Intel Corporation Outlook: Using Virtual Machine Technology on the Grid Reliability: Partitions remain unaffected if other partitions crash Security: Protect sensitive user data in VM instance Flexibility: VMs can checkpoint and migrate during run-time –I want to move to a faster system, when it becomes available –My job has high priority, please free the fastest machine for me Configurability: Dynamically deployed OS images and applications on user request –I need two cores on a fast CPU with 1Gb of memory and RedHat Linux 9 Management: Maintenance of systems, software and users in centralized services

14 Copyright © 2007 Intel Corporation GPE Virtualization Globus virtual workspaces integrated in GPE –Collaboration with ANL team led by Kate Keahey –Virtual target system factory invokes Globus workspace service to create XEN virtual machines –OS Images are fetched from GPE OS Image Repository Service –Available since GPE 1.3 Create show cases with CERN in OpenLab collaboration –Use virtual machines for gLite testing –Implement prototypes for virtual machines hosting gLite computing elements Create show cases with industrial customers

15 Copyright © 2007 Intel Corporation GPE Plans for 2007 Further exploit Intel technology –Use virtualization, management and security capabilities on new Intel platforms –Leverage virtualization technology in the Grid Move towards Enterprise SOA –Run proof of concepts at Intel customers and partners –Identify concrete business needs Harden HPC-centric implementation for production environments –Scalability, Robustness, Performance Implement prototypes of upcoming OGF specifications –participate in interop feasts

16 Copyright © 2007 Intel Corporation Backup

17 Copyright © 2007 Intel Corporation History: From UNICORE to GPE Pallas: –German HPC software company implemented UNICORE client software –Commercial version UNICOREpro in 2003 –Other products included Vampir and VampirTrace (now Intel Trace Collector and Trace Analyzer) After Pallas acquisition by Intel in 2003, the new Open Source project GPE started –Idea: Support Globus and other Grid Middleware implementations, too –Keep the good concepts from UNICORE Graphical User Interfaces Resource Abstraction Client Plug-in Concept Ease of use

18 Copyright © 2007 Intel Corporation Data Center Running a Simple Job Target System Service Application GridBean send job description TSI Job Mgmt. Service File Transfer Service transfer input/output control job TSI GridBean creates JSDL description from user interface Applications Services Utility


Download ppt "Software Solutions & group Copyright © 2007 Intel Corporation Ralf Ratering, Hans–Christian Hoppe Intel Software&Solutions Group GPE4UNICORE Grid Programming."

Similar presentations


Ads by Google