INFSO-RI-223782 Module 01 ETICS Overview Alberto Di Meglio.

Slides:



Advertisements
Similar presentations
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Advertisements

INFSO-RI Module 03 Installing the ETICS Client Alberto Di Meglio.
OMII-Europe Repository Steven Newhouse Director, OMII-UK.
By SAG Objectives Cross platform QA Automation for web applications Scheduling the automation Automatically build the test scripts Generate the.
1 Generic logging layer for the distributed computing by Gene Van Buren Valeri Fine Jerome Lauret.
Building New SOA and AJAX- Based Business Applications Mark Barnard R&D Manager – Natural Business Services Software AG (Canada) Inc.
INFSO-RI An On-Demand Dynamic Virtualization Manager Øyvind Valen-Sendstad CERN – IT/GD, ETICS Virtual Node bootstrapper.
SC7 WG6 Rome Engineering Ingegneria Informatica S.p.A. INFSO-RI Isabel Matranga ETICS Automated Building,Testing and Quality Assurance.
AgriDrupal - a “suite of solutions” for agricultural information management and dissemination, built on the Drupal CMS; - the community of practice around.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Understanding and Managing WebSphere V5
EMI INFSO-RI SA2: Session Summary Alberto Aimar WP Package Leader 1 June 2011, Lund.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
INFSO-RI Quality Assurance with ETICS – multi- node automated testing CGW 09 M.Zurek, A. A. Rodriguez, A. Aimar, A. di Meglio, L. Dini CERN Krakow,
KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis Solutions and Services for Accelerating your Applications.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Build and Test Portal SCI-BUS - agINFRA OSD Eva Takacs 4D Soft Kft. Budapest,
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
INFSO-RI JRA2: Testing senarious ETICS AH meeting Budapest, Iune 2009 Eva Takacs, Jozsef Kuti, András Milassin 4D Soft.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
CSF4 Meta-Scheduler Name: Zhaohui Ding, Xiaohui Wei
INFSO-RI SA1 Service Management Alberto AIMAR (CERN) ETICS 2 Final Review Brussels - 11 May 2010.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Oracle Data Integrator Architecture Components.
INFSO-RI Support for IPv6 in ETICS EGEE’08 Conference, Istanbul, September 2008 Marian ZUREK CERN - ETICS
INFSO-RI ETICS The Software Engineering Infrastructure Physics Services Meeting Geneva, July 3 rd 2008 Alberto Di Meglio CERN - ETICS
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
INFSO-RI Module 05 The ETICS Plugins and Compliance Analysis Alberto Di Meglio.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
Testing Grid Software on the Grid Steven Newhouse Deputy Director.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader.
INFSOM-RI WP 4 : Testing Tools and Methodologies Status Report ETICS Review – 15 February 2008 Éva Takács (4D SOFT)
Adrian Jackson, Stephen Booth EPCC Resource Usage Monitoring and Accounting.
© SERG Reverse Engineering (REportal) REportal: Reverse Engineering Portal (reportal.cs.drexel.edu)
Tool Integration with Data and Computation Grid “Grid Wizard 2”
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
INFSO-RI ETICS The Software Engineering Infrastructure EGEE 08 Istanbul, September 2008 Alberto Di Meglio CERN – ETICS Project manager.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Grid Technology SL Section Software Lifecycle Duarte Meneses.
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
INFSO-RI JRA2 Test Management Tools Eva Takacs (4D SOFT) ETICS 2 Final Review Brussels - 11 May 2010.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.
INFSOM-RI ETICS: E-infrastructure for Testing, Integration and Configuration of Software Alberto Di Meglio Project Manager.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
INFN OCCI implementation on Grid Infrastructure Michele Orrù INFN-CNAF OGF27, 13/10/ M.Orrù (INFN-CNAF) INFN OCCI implementation on Grid Infrastructure.
Ansible and Ansible Tower 1 A simple IT automation platform November 2015 Leandro Fernandez and Blaž Zupanc.
Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.
Experiencing in using ETICS, a multi-platform and open source build and test system for big software projects Elisabetta Ronchieri INFN CNAF 5 July 2011,
M.-E. Bégin¹, S. Da Ronco², G. Diez-Andino Sancho¹, M. Gentilini³, E. Ronchieri ², and M. Selmi² ¹CERN, Switzerland, ² INFN-Padova, Italy, ³INFN-CNAF,
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
INFSOM-RI Elisabetta Ronchieri INFN CNAF ETICS 2 nd EU Review (CERN) 15 February 2008 WP3 - Software Configuration Tools and Methodologies.
INFSOM-RI WP3: WP3: Software configuration tools and methodologies Status Report ETICS All-Hands – 23 May 2007 E. Ronchieri.
INFSO-RI Support for IPv6 in ETICS EGEE’08 Conference, Istanbul, September 2008 Marian ZUREK CERN - ETICS
INFSO-RI Module 03 Installing the ETICS Client ETICS Online Tutorials.
The Holmes Platform and Applications
E-Infrastructure for Testing, Integration and Configuration of Software Alberto Di Meglio CERN, INFN, Engineering, 4D Soft, University of Wisconsin.
Marc-Elian Bégin ETICS Project, CERN
Release BETA Integration Tool Status Geneva – 1 March 2007
The ETICS Build and Test Service
Module 01 ETICS Overview ETICS Online Tutorials
Presentation transcript:

INFSO-RI Module 01 ETICS Overview Alberto Di Meglio

INFSO-RI The Problem 2 ETICS Overview - Module 01OGF 25 - Catania, March 2009 Distributed Computing, Distributed Development

INFSO-RI The ETICS System Continuous software build, test and QA verification system Set of core tools and services Easily extensible with additional plugins Scheduled (cron) or on-demand build and test jobs User computers or remote distributed infrastructures Built-in connectors to distribute build and test jobs on different types of infrastructures from standard job management systems to the grid Open repository of configuration metadata, packages and build, test and QA reports Support for standard package management systems like YUM It’s multi-platform and independent from any specific language, build or test tool 3 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI Architecture 4 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI The Configuration Web Client 5 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI Command-line Client 6 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI Local and Remote Operations Build and test jobs can be executed on the user computer Or sent to remote distributed infrastructures ETICS has connectors for different types of infrastructures (like the grid or clouds) and different job management system (like PBS, LSF or Condor) The jobs can be scheduled using standard cron jobs and the ETICS command-line client All necessary dependencies are handled by ETICS Developers can build or test locally their software on a single platform and then submit the same build or test to be executed in parallel on multiple platforms 7 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI The Repository ETICS provides an online repository where all software packages and build, test and QA reports are stored The Repository generates dynamic YUM repository at every build to automate the execution of deployment, integration and functional tests It can be browsed and queried using a web application with a REST interface, a command-line client or a mountable file system (AFS-based) 8 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI The Repository Web Application 9 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI Extensibility and Plugins ETICS comes preconfigured with extensive build and test features It can also be extended by adding additional plugins The plugins are provided by ETICS and by its user community and can be easily installed from the online repository 10 ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI Examples of Plugins 11 ETICS Overview - Module 01 MetricsTypeProgramming languages/ technologies ToolETICS Plugin ComplexitystaticJava Python JavancssJCcnPlugin PyComplexityPlugin.py Design qualitystaticJavaJdependJDependPlugin N of potential bugsstaticC/C++ Python Perl PHP Java Flawfinder, RATS PMD Findbugs CFlawfinderPlugin CPyPhpRatsPlugin JPmdPlugin JFindbugsPlugin N of potential bugsdynamicC/C++ValgrindCValgrindPlugin Lines of codestaticAllSLOCCountSLOCCountPlugin CoveragedynamicJavaEmma Cobertura JUnitemmaPlugin JCoberturaPlugin Unit tests success rate dynamicJava Python JUnit PyUnit JUnitPlugin JUnitreportsPlugin.py PyUnitPlugin.py Compliance with standards staticIPv6 WSI IPv6Plugin WSInteroperabilityPlugi n ProfilingdynamicC/C++ Java Jrat Valgrind JRatPlugin CValgrindPlugin OGF 25 - Catania, March 2009

INFSO-RI Distributed Testing One of most powerful features of ETICS is the “Distributed Testing” or “Parallel Testing” This features allows to design complex tests composed of several interacting nodes and to deploy automatically complete test environments This feature is currently being developed and will be available to the ETICS user community in the Summer ETICS Overview - Module 01OGF 25 - Catania, March 2009

INFSO-RI ETICS Overview - Module 01 Next Module 02 – The ETICS Portal and the Web Applications OGF 25 - Catania, March 2009

INFSO-RI Thanks! 14 ETICS Overview - Module 01 OGF 25 - Catania, March 2009