1. http://www.cogkits.org Commodity Grid (CoG) Kits Keith Jackson, Lawrence Berkeley National Laboratory Gregor von Laszewski, Argonne National Laboratory http://www.cogkits.org

2. Summary Slide Kits Impact and Connections IMPACT.  Allow application developers to make use of Grid services from higher- level frameworks such as Java and Python.  Easier development of advanced Grid services.  Easier and more rapid application development.  Encourage code reuse, and avoid duplication of effort amongst the collaboratory projects.  Encourage the reuse of Web Services as part of the Grids. CONNECTIONS: We are working closely or as part of with the Globus research project, we work with a variety of major funded applications through SciDAC, NSF, en EU grants, E.g. DOE Science Grid, Earth Systems Grid, Supernova Factory, NASA IPG. The Novel Ideas Develop a common set of reusable components for accessing Grid services. Focus on supporting the rapid development of Science Portals, Problem Solving Environments, and science applications that access Grid resources. Develop and deploy a set of “Web Services” that access underlying Grid services. Integrate the Grid Security Infrastructure (GSI) into the “Web Services” model.  Provide access to higher level Grid services that are language independent and are described via commodity Web technologies such as WSDL.. Principal Investigators: Gregor von Laszewski, ANL Keith. Jackson, LBL 09/07/2001 MICS/SciDAC Program Name MICS Program Manager: Marry Ann Scott Milestones/Dates/Status  The main goal of this project is to create Software Development Kits in both Java and Python that allow easy access to Grid services.  Provide access to basic Grid services:Year - GRAM, MDS, Security, GridFTP1 - Replica Catalog, co-scheduling 1&2  Composable Components: - Develop guidelines for component development1 - Design and implement component hierarchies1&2 - Develop a component repository2&3  Web/Grid Services: - Integrate GSI 1 - Develop an initial set of useful Web/Grid services1&2 Globus Toolkit Java based Grid Portals and Applications Java CoG Toolkit Python CoG Toolkit Commodity Python Tools and Services Commodity Java Tools and Services Portal High Energy Physics BiologyPSEChemistry Python IDE Earth Science Java IDE Java Distributed Programming Framework Java CoG Globus Service … … Composable CoG Components

3. http://www.cogkits.org Problem Statement Problem –Many application developers desire to program the Grid in frameworks familiar to them to for example enable rapid prototyping. –Current Grid toolkits are not sufficiently supported in such frameworks. Solution –The SciDAC CoG Kit project integrates Grid software based on the Globus Toolkit and a commodity framework such as Java and Python.

4. http://www.cogkits.org Impact Easier development of advanced Grid services Easier and more rapid application development Easier deployment of Grid services Code reuse and use of component repositories Use of Web services as part of the Grids Widespread use of the Grid

5. http://www.cogkits.org Novel Ideas Develop a common set of reusable components for accessing Grid services. Focus on supporting the rapid development of Science Portals, Problem Solving Environments, and science applications that access Grid resources. Develop and deploy a set of “Web Services” that access underlying Grid services. –Integrate the Grid Security Infrastructure (GSI) into the “Web Services” model. –Provide access to higher level Grid services that are language independent and are described via commodity Web technologies such as WSDL..

6. http://www.cogkits.org The Role of the CoG Kits Globus Toolkit Java based Grid Portals and Applications Java CoG Kit Python CoG Kit Commodity Python Tools and Services Commodity Java Tools and Services Portal High Energy Physics BiologyPSEChemistry Python IDE Earth Science Java IDE Java Distributed Programming Framework Java CoG Globus Service … Composable CoG Components

7. http://www.cogkits.org Use example based on Java Globus Toolkit Java based Grid Portals and Applications Python CoG Kit Commodity Python Tools and Services Commodity Java Tools and Services Portal High Energy Physics BiologyPSEChemistry Python IDE Earth Science Java IDE Java Distributed Programming Framework … … Java CoG Kit Java CoG Globus Service Visual Cafe Web Start Java SOAP Java XML JNDI LDAP Web Services Composable CoG Components Code-based Java Beans Visuals Argonne Midwest Regional Climate Model GRAMGSI Grid FTP GPDK

8. http://www.cogkits.org Milestones Deliver high-quality CoG Kits for Java and Python Provide access to basic Grid services: –GRAM, MDS, security, GridFTP, GSI –Replica Catalog, co-scheduling Develop composable components –Develop guidelines for component development –Design and implement component hierarchies –Develop a component repository Integrate Web and Grid services

9. http://www.cogkits.org ASSOCIATIONS We are working closely/are part of the the Globus Project. We (plan to) collaborate with applications through –SciDAC DOE Science Grid Earth Science Grid Data Grid Security Middleware Supernova Center CMCS

10. http://www.cogkits.org Observations Though collaboration is good we observe –Limited manpower/resources may limit our capabilities in expanding the collaborations. –Will we have enough resources to successfully communicate with all the groups? –To which groups should we restrict ourselves? Though our libraries are general in nature and easy to use –Do the application teams have the resources to pick them up end develop. –Do we need a development “squad” that assists in doing this Documenting and acknowledging other peoples work as part of the credit seems important

11. http://www.cogkits.org Response to Panel Specific capabilities being developed –If you like to access the Grid in Python or Java: Use Python and Java CoG Kits Planed schedule for the next 12 month –In General: Deliver a release compatible with Globus 2.0 Sample Java and Python components that can be reused in rapid prototyping (SC2002) while integrating them in commercial / public domain IDE’s Who will we be interoperate with the other panelists –(Gannon) Middleware technology for supporting portals Uses Java CoG Kit CoGs are interested in coming up with a joint stable software release –(Rahn) CMCS CoG could provide rapid access to Grid for this project if desired. The lessons learned from developing CoG Portals should be considered for CMCS portal –(Stevens) Middleware support for Group-to-Group collaboration As this group recently used Python, the Python CoG may be the vehicle to enable Grid access. “Special” proxy machines simplify the choice for a portal that makes the development environment on the access Grid uniform. –(Agrawal) Pervasive Collaborative Computing Environment Similar to the above We need to look closer in this proposal Possible Impact on others –Example: ESG web portal lessons learned from ANL Midwest regional climate model Implicit connection through Gannon –Supernova Center, investigate composable components