This work was carried out in the context of the Virtual Laboratory for e-Science project. This project is supported by a BSIK grant from the Dutch Ministry.

Slides:



Advertisements
Similar presentations
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Grid.
Advertisements

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Experiences.
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
7 april SP3.1: High-Performance Distributed Computing The KOALA grid scheduler and the Ibis Java-centric grid middleware Dick Epema Catalin Dumitrescu,
The Ibis Project: Simplifying Grid Programming & Deployment Henri Bal Vrije Universiteit Amsterdam.
WSUS Presented by: Nada Abdullah Ahmed.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Institute for Software Science – University of ViennaP.Brezany 1 Databases and the Grid Peter Brezany Institute für Scientific Computing University of.
Technical Architectures
Web-based Distributed Flexible Manufacturing System (FMS) Monitoring and Control Student: Wei Liu Instructor: Dr. Chang Apr. 23, 2003.
The Ibis Project: Simplifying Grid Programming & Deployment Henri Bal, Jason Maassen, Rob van Nieuwpoort, Thilo Kielmann, Niels Drost, Ceriel Jacobs, Frank.
The CrossGrid project Juha Alatalo Timo Koivusalo.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Grid Adventures on DAS, GridLab and Grid'5000 Henri Bal Vrije Universiteit Amsterdam Faculty of Sciences.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Jun Peng Stanford University – Department of Civil and Environmental Engineering Nov 17, 2000 DISSERTATION PROPOSAL A Software Framework for Collaborative.
Distributed Systems: Client/Server Computing
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Understanding and Managing WebSphere V5
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
STRATEGIES INVOLVED IN REMOTE COMPUTATION
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
Remote OMNeT++ v2.0 Introduction What is Remote OMNeT++? Remote environment for OMNeT++ Remote simulation execution Remote data storage.
INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.
Panel Abstractions for Large-Scale Distributed Systems Henri Bal Vrije Universiteit Amsterdam.
Optimized Java computing as an application for Desktop Grid Olejnik Richard 1, Bernard Toursel 1, Marek Tudruj 2, Eryk Laskowski 2 1 Université des Sciences.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
DISTRIBUTED COMPUTING
CoG Kit Overview Gregor von Laszewski Keith Jackson.
Why Java? A brief introduction to Java and its features Prepared by Mithat Konar.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories Wolfgang Ziegler, Oliver Wäldrich Fraunhofer Institute SCAI.
N*Grid – Korean Grid Research Initiative Funded by Government (Ministry of Information and Communication) 5 Years from 2002 to million US$ Including.
Evaluation of Agent Teamwork High Performance Distributed Computing Middleware. Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Hands-On Microsoft Windows Server Implementing Microsoft Internet Information Services Microsoft Internet Information Services (IIS) –Software included.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Tools for collaboration How to share your duck tales…
Web based Hydrology and Water Resources Information System for India
A High Performance Middleware in Java with a Real Application Fabrice Huet*, Denis Caromel*, Henri Bal + * Inria-I3S-CNRS, Sophia-Antipolis, France + Vrije.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
ICT infrastructure for Science: e-Science developments Henri Bal Vrije Universiteit Amsterdam.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
Hwajung Lee.  Interprocess Communication (IPC) is at the heart of distributed computing.  Processes and Threads  Process is the execution of a program.
CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.
Virtual Lab for e-Science Towards a new Science Paradigm.
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
6 February 2009 ©2009 Cesare Pautasso | 1 JOpera and XtremWeb-CH in the Virtual EZ-Grid Cesare Pautasso Faculty of Informatics University.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Getting Started with.NET Getting Started with.NET/Lesson 1/Slide 1 of 31 Objectives In this lesson, you will learn to: *Identify the components of the.NET.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Tool Integration with Data and Computation Grid “Grid Wizard 2”
DIRAC Project A.Tsaregorodtsev (CPPM) on behalf of the LHCb DIRAC team A Community Grid Solution The DIRAC (Distributed Infrastructure with Remote Agent.
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
GWE Core Grid Wizard Enterprise (
Real-World Distributed Computing with Ibis
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
University of Technology
Grid Engine Riccardo Rotondo
Presentation transcript:

This work was carried out in the context of the Virtual Laboratory for e-Science project. This project is supported by a BSIK grant from the Dutch Ministry of Education, Culture and Science (OC&W) and is part of the ICT innovation program of the Ministry of Economic Affairs (EZ). R. van Nieuwpoort, J. Maassen, C. Jacobs Vrije Universiteit, De Boelelaan 1081A 1081HV, Amsterdam, The Netherlands URL: URL: Ibis: Java-Centric Grid Computing R. van Nieuwpoort, J. Maassen, C. Jacobs Vrije Universiteit, De Boelelaan 1081A, 1081HV Amsterdam, The Netherlands The main goal of the Ibis project is to create an efficient Java-based platform for grid computing. The Ibis project currently consists of the Ibis communication library, a variety of programming models, the Java Grid Application Toolkit, and the Zorilla peer-to-peer grid middleware. All components can be deployed on any grid platform, due to the use of Java. Each of the components will be described in detail below. On the right there is a selection of the projects currently using Ibis software. Ibis is part of SP 3.1 of the VL-e project. Introduction ProActive is a grid Java library for parallel, distributed, and concurrent computing, also featuring mobility and security in a uniform framework. With a reduced set of simple primitives, ProActive provides a comprehensive API allowing to simplify the programming of applications that are distributed on Local Area Network (LAN), on cluster of workstations, or on Internet Grids. See the ProActive website for more information. ProActive has been ported to Ibis by Fabrice Huet. Laurent Baduel used this version for a Java version of EM3D: a parallel solver for electromagnetic waves propagation. ProActive The Institute of Numerical Methods and Informatics in Civil Engineering is implementing a Grid-System for the parallel simulation of soil-structure- interaction for geotechnical problems. Parallelization is based on mobile Java- Agents, taking advantage of agent features such as portability, mobility, reactivity etc. In the time critical parts of the parallel simulation, mainly solving a linear equation system, Ibis is used for a more efficient communication. Ibis offers all features needed for an efficient and trouble-free implementation, such as one-to-many communication and the possibility to send objects efficiently. Parallel simulation of soil-structure-interaction Triana is a workflow-based problem solving environment developed at Cardiff University that combines a simple and intuitive visual interface with powerful data analysis tools. Already used by scientists for a range of tasks, such as signal, text and image processing, Triana includes a large library of pre-written analysis tools and the ability for users to easily integrate their own tools. Triana is capable of using the JavaGAT to run parts of the task graph on the grid. Triana The MultimediaN institute performs various types of multimedia research, such as feature learning, object recognition and multimedia databases. One of their demonstrations, which is used to illustrate the effectiveness of using a grid in Multimedia computing, shows object recognition performed by a robot dog. The dog is connected to a wide-area Grid system, which potentially consists of hundreds of computers distibuted world-wide. The JavaGAT is used to start computations on the grid. MultimediaN Ibis offers a wide range of programming models, suitable for different classes of applications: RMI is best suited for client-servers application, Satin offers a master-worker/divide and conquer programming model, GMI implements object-oriented group communication, while MPJ offers pure Java MPI. Ibis Programming Models The Ibis communication library is specifically designed for usage in a grid environment. Its run-everywhere property and support for fault-tolerance, malleability and high-speed networks, make it an easy to use and reliable grid communication infrastructure. The modular design of Ibis is shown below: Ibis Communication Library TCPUDPP2PGMPandaMPI Application RMISatinRepMIGMIMPJ Ibis Portability Layer (IPL) The Java Grid Application Toolkit (JavaGAT) offers a set of coordinated, generic and flexible APIs for accessing grid services from application codes, portals, data managements systems. As shown in the above figure, the JavaGAT sits between grid applications and numerous types of grid middleware, such as Globus, Unicore, SSH or Zorilla. JavaGAT lifts the burden of grid application programmers by providing them with a uniform interface that provides file access, job submission, monitoring, and access to information services. As a result, grid application programmers need only learn a single API to obtain access to the entire grid. Due to its modular design, the JavaGAT can easily be extended with support for other grid middleware layers. Java Grid Application Toolkit GridlabGlobusUnicoreSSHLocalZorilla Application Files Information Services Monitoring Resource Management GAT Engine Zorilla is peer-to-peer grid middleware. It implements all functionality needed to run applications on a grid in a fully distributed manner, such as scheduling, file transfer and security. Deployment of Zorilla is easy; only a single application needs to be installed on the participating machines. Zorilla requires little configuration, since machines automatically organize themselves into a grid. Due to its peer-to-peer design, Zorilla scales to large numbers of machines. Jobs can be submitted to Zorilla directly or using the JavaGAT. Although Zorilla was explicitly designed to support supercomputing applications, it is possible to run any type of application. Zorilla The Vrije Universiteit Medical Centre has a magnetoencephalography (MEG) scanner which produces large amounts of data which must be processed. MEG is a tool to study the function of the human brain. It measures the magnetic field intensity at hundreds of points over the surface of the skull up to several thousand times per second. The size of a data set from each session is typically hundreds of megabytes. The task- farmingapplication used for data analysis uses the Ibis communication library to distribute the data over the workers. MEG Data Analysis VU medisch centrum