EMI is partially funded by the European Commission under Grant Agreement RI-261611 SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader.

Slides:



Advertisements
Similar presentations
Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
Advertisements

Developing in CAS. Why? As distributed you edit CAS 3 with Eclipse and build with Maven 2 – Best Practice for Release Engineering – Difficult edit-debug.
IIS 7: The Next Generation Web Application Server Platform Michael Volodarsky Program Manager Web Platform and Tools Team Microsoft Corporation.
Continuous Integration Demonstration. Agenda 1.Continuous Integration Basics 2.Live Demonstration 3.Bamboo Concepts 4.Advantages 5.Version 2.0 Features.
Installing Linux softwares Sirak Kaewjamnong. 2 Software packets  When Linux developers create their software they typically bundle all the executable.
EMI INFSO-RI SA2: Session Summary Alberto Aimar WP Package Leader 1 June 2011, Lund.
Linux Operations and Administration
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
EMI INFSO-RI EMI SA2 Report Quality Assurance Alberto Aimar (CERN) SA2 WP Leader.
AUTOBUILD Build and Deployment Automation Solution.
EMI INFSO-RI EMI Quality Assurance Processes (PS ) Alberto Aimar (CERN) CERN IT-GT-SL Section Leader EMI SA2 QA Activity Leader.
EMI is partially funded by the European Commission under Grant Agreement RI Post EMI Plans and MeDIA Alberto DI MEGLIO, CERN Project Director WLCG.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI SA2 services evolution (after the end of EGI-InSPIRE) Peter Solagna, Michel.
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
A DΙgital Library Infrastructure on Grid EΝabled Technology Release Beta Deployment Testing Plans Pedro Andrade
A DΙgital Library Infrastructure on Grid EΝabled Technology Release Beta Build and Deployment Testing.
European Middleware Initiative (EMI) – Release Process Doina Cristina Aiftimiei (INFN) EGI Technical Forum, Amsterdam 17. Sept.2010.
INFSO-RI SA1 Service Management Alberto AIMAR (CERN) ETICS 2 Final Review Brussels - 11 May 2010.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Quality Assurance Alberto AIMAR (CERN) SA2 Leader EMI Second EC.
March 11, 2008 USCMS Tier-2 Workshop Oh Dear God Alain made a PowerPoint presentation 1.
INFSO-RI Enabling Grids for E-sciencE SCDB C. Loomis / Michel Jouvin (LAL-Orsay) Quattor Tutorial LCG T2 Workshop June 16, 2006.
INFSO-RI NA2 Status Update ETICS2 third AHM Isabel Matranga Engineering Ingegneria Informatica SpA Budapest, June 2009.
EMI is partially funded by the European Commission under Grant Agreement RI Software development, integration and coordination Balázs Kónya, Lund.
EMI INFSO-RI Guidelines and SQA Process Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
EMI INFSO-RI SA2: Quality Assurance Platforms for EMI 2 Andres Abad Rodriguez SA2.4 EMI All Hands Meeting May 30 th -June 1 ST, Lund (Sweden) Platforms.
Installation and Configuration of A-REX Iván Márton (NIIFI) Zsombor Nagy (NIIFI)
EMI INFSO-RI SA1 Session Report Francesco Giacomini (INFN) EMI Kick-off Meeting CERN, May 2010.
EMI INFSO-RI EMIR integration in BDII Maria Alandes Pradillo (CERN) Information System Product Team.
EMI INFSO-RI ARC tools for revision and nightly functional tests Jozef Cernak, Marek Kocan, Eva Cernakova (P. J. Safarik University in Kosice, Kosice,
INFSO-RI SA1 Status Report Status and Progress of the ETICS Services ETICS2 First Review Alberto AIMAR CERN Brussels 3 April 2009.
EMI is partially funded by the European Commission under Grant Agreement RI Project Status and NA1 Alberto Di Meglio, CERN 3 rd EMI All-Hands Meeting.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
EMI INFSO-RI Software Quality Assurance in EMI Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.
® IBM Software Group © 2006 IBM Corporation Rational Asset Manager v7.2 Using Scripting Tutorial for using command line and scripting using Ant Tasks Carlos.
EMI is partially funded by the European Commission under Grant Agreement RI Product Integration (testing) Balázs Kónya, Lund University 3rd EMI.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Grid Technology SL Section Software Lifecycle Duarte Meneses.
INFSO-RI ETICS Local Setup Experiences A Case Study for Installation at Customers Location 4th. All Hands MeetingUwe Müller-Wilm VEGA Bologna, Nov.
EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) EMI First EC Review Brussels, 22 June 2011.
EMI INFSO-RI EMI Documentation Emidio Giorgio (INFN Catania) NA2 Leader 2 nd All Hands Meeting May 31th, Lünd.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
EMI is partially funded by the European Commission under Grant Agreement RI Build and Test Services of the EMI project: Lessons Learned and Perspectives.
EMI is partially funded by the European Commission under Grant Agreement RI Roadmap & Future Work Ricardo Rocha ( on behalf of the DPM team )
EMI is partially funded by the European Commission under Grant Agreement RI EMI SA2 Report Andres ABAD RODRIGUEZ, CERN SA2.4, Task Leader EMI AHM,
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
EMI INFSO-RI SA2: Quality Assurance Status Report Alberto Aimar(SA2) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
INFSOM-RI Elisabetta Ronchieri INFN CNAF ETICS 2 nd EU Review (CERN) 15 February 2008 WP3 - Software Configuration Tools and Methodologies.
INFSOM-RI WP3: WP3: Software configuration tools and methodologies Status Report ETICS All-Hands – 23 May 2007 E. Ronchieri.
INFSO-RI Module 03 Installing the ETICS Client ETICS Online Tutorials.
EMI INFSO-RI EMI 1 (Kebnekaise) Updates C. Aiftimiei (INFN) EMI Release Manager.
EPEL All Hands Meeting, Padova, Mattias Ellert Uppsala University.
Agenda:- DevOps Tools Chef Jenkins Puppet Apache Ant Apache Maven Logstash Docker New Relic Gradle Git.
EMI 1 (Kebnekaise) Updates
SA2: Quality Assurance Status Report
Generator Services planning meeting
EMI 1 (Kebnekaise) release preparation status
Spacewalk and Koji at Fermilab
ETICS Services Management
SL Section Software Lifecycle Duarte Meneses
EMI: dal Produttore al Consumatore
Module 01 ETICS Overview ETICS Online Tutorials
Presentation transcript:

EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader EMI AHM Budapest

EMI INFSO-RI ETICS Status and Progress – Improvements since last AHM ETICS Software ETICS Infrastructure – Work during EMI Year 3 – Next Steps Preparation for Post-EMI – Build from sources – Preparation for EPEL and Debian repositories with ETICS Features and plugins in place – Standard Tools without ETICS Koji, Bamboo, Jenkins – Migration from ETICS to other Tools – Next Steps Outline 229/10/2012EMI AHM Budapest

EMI INFSO-RI New pool control scripts – There is a thread per platform – A complete iteration time for starting nodes has been reduced from 40 minutes to 15 minutes Monitoring system extended – New scripts to mitigate and fix the reliability issues that we have had during the last month Improvements: Infrastructure 329/10/2012EMI AHM Budapest

EMI INFSO-RI ETICS client – Several versions released (from version to current production ) – Debian packaging: Native 3.0 format supported – Plugin execution improved to allow execution in more phases Debian builds – Developed a system to aggregate the different subsystem builds in one single report Improvements: Software (I) 429/10/2012EMI AHM Budapest

EMI INFSO-RI ETICS Web Portal – New filtering options in the Submissions tab – Graphical representation of dependencies (to be included in the next release) Plugins – RPMlint bug fixing – Completed Lintian integration Improvements: Software (II) 529/10/2012EMI AHM Budapest

EMI INFSO-RI Client updates (if new bug are discovered) Lintian plugin tuning Release a new version of the portal with the new graphical representation of dependencies Improve infrastructure reliability Support for EMI-3 and previous versions updates release Next steps 629/10/2012EMI AHM Budapest

EMI INFSO-RI For year 3, every PT should provide their RPM and Debian source packages to be build in ETICS with Mock and Pbuilder You can find more information about what packages are needed and the places to put them here: miSa2PackagingPolicy miSa2PackagingPolicy Build from sources 729/10/2012EMI AHM Budapest

EMI INFSO-RI RPMLint on place to collect information about RPM packages compliance level with EPEL guidelines Lintian on place to collect information about DEB packages compliance level with Debian guidelines More information in the next presentation Preparation for EPEL and Debian 829/10/2012EMI AHM Budapest

EMI INFSO-RI From the survey… 929/10/2012EMI AHM Budapest *Maven is used almost always inside Bamboo or Jenkins

EMI INFSO-RI RPM packaging tool used in Fedora to build its RPMs Input files are spec and src.rpm files Chained builds used to build dependencies The project structure is done using tags (collection of packages) and builds targets (where a package should be built and how it should be tagged afterwards) Scratch builds: build but do not add the result to the release _system _system Fedora Koji 1029/10/2012EMI AHM Budapest

EMI INFSO-RI Structured as plans. A plan is a set of tasks to be executed No security option for distributed builds Several build automatic strategies Extensible by plugins Many standard tools preconfigured: Maven, ant, etc… Possible to set environment variables and properties Remote command line access using REST APIs ew ew Atlassian Bamboo 1129/10/2012EMI AHM Budapest

EMI INFSO-RI More than 400 free plugins available (including an Eclipse plugin) Secure distributed builds using SSH Build time order can be specified but manually Full access to all the files in the build directory There is not a clear project structure as we know it now Testing capabilities using plugins Jenkins (Hudson) 1229/10/2012EMI AHM Budapest

EMI INFSO-RI If it is requested by the PTs, we can agree a format to export the existing ETICS configurations It would be a common template and every PT should create parsers for the build system that they have selected Migration from ETICS 1329/10/2012EMI AHM Budapest

EMI INFSO-RI PTs that are still building with ETICS should move to build from source PTs should have an idea of the tool(s) they are going to use in the post-EMI era If they want to keep the configurations that they currently have on ETICS, they should inform EMT Next steps 1429/10/2012EMI AHM Budapest