Installation and Configuration of A-REX Iván Márton (NIIFI) Zsombor Nagy (NIIFI)

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE Supporting MPI Applications on EGEE Grids Zoltán Farkas MTA SZTAKI.
Advertisements

EMI INFSO-RI The ARC data client in EMI-1 Jon Kerr Nilsen Dept. of Physics, Univ. of Oslo On behalf of the ARC Data PT.
Linux Networking CIS Why Linux/Unix? Configurability ▫Customizable System to satisfy unique needs. Scalability ▫Able to serve an increasing number.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
EMI is partially funded by the European Commission under Grant Agreement RI Recent ARC developments in the EMI project Andrii Salnikov, Ievgen Sliusar.
INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.
1 Automatic Processing Pipelines with XNAT and REDCap Vanderbilt University Benjamin Yvernault, Bennett Landman, Brian Boyd,
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Nadia LAJILI User Interface User Interface 4 Février 2002.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
1 Sergio Maffioletti Grid Computing Competence Center GC3 University of Zurich Swiss Grid School 2012 Develop High Throughput.
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Overview of user client usage: ARC Iván Márton Zsombor Nagy.
Production Tools in ATLAS RWL Jones GridPP EB 24 th June 2003.
Using the EMI testbed ARC middleware Marek Kočan University of P. J. Šafárik, Košice.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Quality Assurance Alberto AIMAR (CERN) SA2 Leader EMI Second EC.
July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.
Condor Project Computer Sciences Department University of Wisconsin-Madison Grids and Condor Barcelona,
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
EMI INFSO-RI Guidelines and SQA Process Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
By : SAG3 Members.  Cross platform client interface for Time recording/capturing  MS Project integration to Time tracker  integration to Time.
EMI is partially funded by the European Commission under Grant Agreement RI SA2 – Development Tools Andres Abad Rodriguez SA2.4 Tools Activity Leader.
EMI INFSO-RI SA2: Quality Assurance Platforms for EMI 2 Andres Abad Rodriguez SA2.4 EMI All Hands Meeting May 30 th -June 1 ST, Lund (Sweden) Platforms.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
EMI INFSO-RI EMIR integration in BDII Maria Alandes Pradillo (CERN) Information System Product Team.
EMI INFSO-RI ARC tools for revision and nightly functional tests Jozef Cernak, Marek Kocan, Eva Cernakova (P. J. Safarik University in Kosice, Kosice,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
EMI is partially funded by the European Commission under Grant Agreement RI Project Status and NA1 Alberto Di Meglio, CERN 3 rd EMI All-Hands Meeting.
EMI INFSO-RI Software Quality Assurance in EMI Maria Alandes Pradillo (CERN) SA2.2 Task Leader.
EMI INFSO-RI Argus The EMI Authorization Service Valery Tschopp (SWITCH) Argus Product Team.
EMI INFSO-RI EMI Quality Assurance Tools Lorenzo Dini (CERN) SA2.4 Task Leader.
Grid Compute Resources and Job Management. 2 Grid middleware - “glues” all pieces together Offers services that couple users with remote resources through.
EMI INFSO-RI Technical Overview Balázs Kónya (Lund University) Technical Director 1 st EMI Periodic Review Brussels, 22 June 2011.
EMI is partially funded by the European Commission under Grant Agreement RI Federated Grid Access Using EMI STS Henri Mikkonen Helsinki Institute.
STAR Scheduling status Gabriele Carcassi 9 September 2002.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Client installation DIRAC Project. DIRAC Client Software  Many operations can be performed through the Web interface  Even more to come  However, certain.
EMI is partially funded by the European Commission under Grant Agreement RI Common Authentication Library Daniel Kouril, for the CaNL PT EGI TF.
EMI is partially funded by the European Commission under Grant Agreement RI Security Token Service (STS) Transforming the Existing User Credentials.
European Middleware Initiative (EMI) – Training Kathryn Cassidy, TCD EMI NA2.
EMI INFSO-RI Cloud Task Force Report Eric Yen (ASGC), Shahbaz Memon (JULICH)
EMI is partially funded by the European Commission under Grant Agreement RI EMI SA2 Report Andres ABAD RODRIGUEZ, CERN SA2.4, Task Leader EMI AHM,
Client installation Beijing, 13-15/11/2013. DIRAC Client Software Beijing, /11/2013 DIRAC Tutorial2  Many operations can be performed through the.
EMI is partially funded by the European Commission under Grant Agreement RI Security Token Service (STS) Simplified Credential Management Henri.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
EMI is partially funded by the European Commission under Grant Agreement RI Common Authentication Library Daniel Kouril, for the CaNL PT EGI CF.
EMI is partially funded by the European Commission under Grant Agreement RI caNl++ caNl++ team University Of Oslo 5th EMI AHM, Budapest.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
EMI INFSO-RI /04/2011What's new in EMI 1: Kebnekaise What’s new in EMI 1 Kathryn Cassidy (TCD)‏ EMI NA2.
Integrating HTCondor with ARC Andrew Lahiff, STFC Rutherford Appleton Laboratory HTCondor/ARC CE Workshop, Barcelona.
EMI is partially funded by the European Commission under Grant Agreement RI Future Proof Storage with DPM Oliver Keeble (on behalf of the CERN IT-GT-DMS.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
EMI INFSO-RI EMI 1 (Kebnekaise) Updates C. Aiftimiei (INFN) EMI Release Manager.
Grid Computing with Debian, Globus and ARC Mattias Ellert, Uppsala Universitet (.se) Steffen Möller, Universität zu Lübeck (.de) Anders Wäänänen, Niels.
EPEL All Hands Meeting, Padova, Mattias Ellert Uppsala University.
Lund All Hands meeting Compute Area Section Massimo Sgaravatto INFN Padova.
UNICORE and Argus integration Krzysztof Benedyczak ICM / UNICORE Security PT.
Reading e-Science Centre
Delegation methods in EMI
Introduction to the Application Hosting Environment
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Usecase Dynamo Moderate Requirements:
EMI 1 (Kebnekaise) release preparation status
EMI 1 (Kebnekaise) Updates
EMI: dal Produttore al Consumatore
SQL Server 2005 Installation
Presentation transcript:

Installation and Configuration of A-REX Iván Márton (NIIFI) Zsombor Nagy (NIIFI)

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 2 Components to be installed GridFTPd Grid Manager / A-REX ARIS

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 3 GridFTPd Receives job description document and proxy-certificate Validates proxy-certificate Accepts the job

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 4 Grid Manager / A-REX Goes through accepted jobs, starts downloaders for requested files Caches files and manages the cache Executes plugins Transforms job description to LRMS-specific shell-scripts Submits job to LRMS (SGE, PBS/Torque, SLURM, LoadLeveler, LSF, Condor) Regularly polls LRMS to see if jobs has completed Finishes jobs, starts uploaders for output-files Writes information for URLogger that reports to SGAS Can provide WS interface to submit and manage jobs and handle related data

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 5 ARIS (Arc Resource Information Service) ARIS is the local information system it contains information about cluster, queues, jobs (started by the ‘grid-infosys’ init script)

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 6 Tutorial environment OS: SL5 (EMI supported) Other supported platforms: – Fedora / Redhat – Debian / Ubuntu – Solaris – Mac OS X – Gentoo – etc.

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 7 Discover your disc! Installed software: /usr/ Configuration files: e.g. /etc/ Log files: e.g. /var/log/arc/ The location of additional files is configurable: e.g. /var/spool/arc – session directory stores working directories – control directory job metadata (states, etc.)

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 8 Clients for testing arcproxy – creating and managing proxy certificates arcsub – communicate with infosys – do brokering – move input files – submit jobs to cluster arcstat – query cluster for job status arccat – print standard output and error of job arcget – get results of a job and clean from cluster

EMI INFSO-RI /04/2011 EMI Tutorial for Resource Administrators 9 Ready… steady… go! Password: NA59::gf8 Survey:

EMI is partially funded by the European Commission under Grant Agreement RI Thank you!