ATLAS Dashboard Recent Developments Ricardo Rocha.

Slides:



Advertisements
Similar presentations
The use of SDMX at the ECB Xavier Sosnovsky European Central Bank Bonn,
Advertisements

Metadata Progress GridPP18 20 March 2007 Mike Kenyon.
LHCbPR V2 Sasha Mazurov, Amine Ben Hammou, Ben Couturier 5th LHCb Computing Workshop
1 TN232921: Differences between Project Configuration settings output in XML from Command Manager versus the Project Configuration Editor in MicroStrategy.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
The ATLAS Production System. The Architecture ATLAS Production Database Eowyn Lexor Lexor-CondorG Oracle SQL queries Dulcinea NorduGrid Panda OSGLCG The.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
Web Publisher. Rinaldo De Paolis General Manager – Qualitem & Connected Systems.
ATLAS : File and Dataset Metadata Collection and Use S Albrand 1, J Fulachier 1, E J Gallas 2, F Lambert 1 1. Introduction The ATLAS dataset search catalogs.
GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.
CERN IT Department CH-1211 Geneva 23 Switzerland t The Experiment Dashboard ISGC th April 2008 Pablo Saiz, Julia Andreeva, Benjamin.
CollectionSpace Service REST-based APIs June 2009 Face-to-face Aron Roberts U.C. Berkeley IST/Data Services.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services GS group meeting Monitoring and Dashboards section Activity.
Enabling Grids for E-sciencE Overview of System Analysis Working Group Julia Andreeva CERN, WLCG Collaboration Workshop, Monitoring BOF session 23 January.
Real Time Monitor of Grid Job Executions Janusz Martyniak Imperial College London.
1 DDM Troubleshooting Console (quick evaluation of splunk for such) Rob Gardner University of Chicago ATLAS DDM Workshop January 26, 2007.
1 What’s the difference between DocuShare 3.1 and 4.0?
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Monitoring in EGEE EGEE/SEEGRID Summer School 2006, Budapest Judit Novak, CERN Piotr Nyczyk, CERN Valentin Vidic, CERN/RBI.
PanDA Monitor Development ATLAS S&C Workshop by V.Fine (BNL)
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
Towards a Global Service Registry for the World-Wide LHC Computing Grid Maria ALANDES, Laurence FIELD, Alessandro DI GIROLAMO CERN IT Department CHEP 2013.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Overview of STEP09 monitoring issues Julia Andreeva, IT/GS STEP09 Postmortem.
Owen SyngeTitle of TalkSlide 1 Storage Management Owen Synge – Developer, Packager, and first line support to System Administrators. Talks Scope –GridPP.
DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
WLCG infrastructure monitoring proposal Pablo Saiz IT/SDC/MI 16 th August 2013.
ATLAS Production System Monitoring John Kennedy LMU München CHEP 07 Victoria BC 06/09/2007.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Ricardo Rocha CERN (IT/GS) EGEE’08, September 2008, Istanbul, TURKEY Experiment.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
OSG Area Coordinator’s Report: Workload Management May14 th, 2009 Maxim Potekhin BNL
Storage dashboard Status report A.Baranovski 12/10/07.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
INFSO-RI Enabling Grids for E-sciencE ATLAS DDM Operations - II Monitoring and Daily Tasks Jiří Chudoba ATLAS meeting, ,
RSV: OSG Grid Fabric Monitoring and Interoperation with WLCG Monitoring Systems Rob Quick, Arvind Gopu, and Soichi Hayashi Computing in High Energy and.
CERN IT Department CH-1211 Geneva 23 Switzerland t A proposal for improving Job Reliability Monitoring GDB 2 nd April 2008.
Julia Andreeva on behalf of the MND section MND review.
Conclusions on Monitoring CERN A. Read ADC Monitoring1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Monitoring of the LHC Computing Activities Key Results from the Services.
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
Global ADC Job Monitoring Laura Sargsyan (YerPhI).
GridView - A Monitoring & Visualization tool for LCG Rajesh Kalmady, Phool Chand, Kislay Bhatt, D. D. Sonvane, Kumar Vaibhav B.A.R.C. BARC-CERN/LCG Meeting.
The ATLAS Strategy for Distributed Analysis on several Grid Infrastructures D. Liko, IT/PSS for the ATLAS Distributed Analysis Community.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
Enabling Grids for E-sciencE Grid monitoring from the VO/User perspective. Dashboard for the LHC experiments Julia Andreeva CERN, IT/PSS.
Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.
Distributed Analysis Tutorial Dietrich Liko. Overview  Three grid flavors in ATLAS EGEE OSG Nordugrid  Distributed Analysis Activities GANGA/LCG PANDA/OSG.
DDM Central Catalogs and Central Database Pedro Salgado.
CERN - IT Department CH-1211 Genève 23 Switzerland t Grid Reliability Pablo Saiz On behalf of the Dashboard team: J. Andreeva, C. Cirstoiu,
The GridPP DIRAC project DIRAC for non-LHC communities.
MND section. Summary of activities Job monitoring In collaboration with GridView and LB teams enabled full chain from LB harvester via MSG to Dashboard.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI OpenSource GeoSpatial Catalogue Platform-as-a-Service Salvatore Pinto Cloud.
ConTZole Tomáš Kubeš, 2010 atlas-tz-monitoring.cern.ch An Interactive ATLAS Tier-0 Monitoring.
CMS Experience with the Common Analysis Framework I. Fisk & M. Girone Experience in CMS with the Common Analysis Framework Ian Fisk & Maria Girone 1.
INFSO-RI Enabling Grids for E-sciencE GOCDB Requirements John Gordon, STFC.
EGEE-II INFSO-RI Enabling Grids for E-sciencE WLCG File Transfer Service Sophie Lemaitre – Gavin Mccance Joint EGEE and OSG Workshop.
RSV: OSG Grid Monitoring and User Customizable Views Rob Quick, Arvind Gopu, and Soichi Hayashi High Performance Distributed Computing Location: Munich,
Job submission overview Marco Mambelli – August OSG Summer Workshop TTU - Lubbock, TX THE UNIVERSITY OF CHICAGO.
CERN IT Department CH-1211 Genève 23 Switzerland t EGEE09 Barcelona ATLAS Distributed Data Management Fernando H. Barreiro Megino on behalf.
GGUS New features and roadmap
Daniele Bonacorsi Andrea Sciabà
Gridpp37 – 31/08/2016 George Ryall David Meredith
ATLAS Grid Information System
Key Activities. MND sections
POW MND section.
FTS Monitoring Ricardo Rocha
New monitoring applications in the dashboard
Lavoisier : a way to integrate heteregeneous monitoring systems.
Monitoring of the infrastructure from the VO perspective
+ Chen Hsong Cloud = Connectivity.
Presentation transcript:

ATLAS Dashboard Recent Developments Ricardo Rocha

ATLAS Data Management Integration with AGIS Collection of OSG scheduled downtimes Notification messages for cloud activity / performance – Delivery using the dashboard messaging API Part of maintenance now given to ATLAS shifters and experts Activities for dataset subscriptions (in development) – Delivery by the end of August – New mandatory ‘activity’ field when issuing subscriptions – Transition to a single instance of the DDM dashboard – new filters by activity instead of multiple instances New statistics in the main display (Lu Feng)

ATLAS Production System Integration with AGIS RSS feed exposing problematic sites / tasks Cloud / site admin display (Lu Feng) Grouping error messages by similarity – Better than proddb error codes which are not always useful Improved shifter’s display Reporting of pilot job details via python API (issuing HTTP requests)

AGIS ATLAS Grid Information System Built using the dashboard framework Collection of site information – From GOCDB for EGEE and OIM for OSG Collection of service information – From the LCG and OSG BDIIs Collection of ATLAS cloud and tier information – From the TiersOfATLAS and Panda database – Stopped after a transition period when update of info directly in AGIS is fully tested Querying available via a python API, command line tools, direct HTTP with multiple output formats (including ToA) Updating via secure HTTP calls Prototype:

ATLAS Tier0 Dashboard Developed in collaboration with the ATLAS T0 team (Guido Negri) T0 data exposed via a dashboard application Prototype display built using HTML canvas elements

Other items / upcoming Usage/evaluation of RDF stores (Markus Huber) Entry-point (frontend) dashboard – Client side only application – Collection and aggregation of summary info from the different dashboards (ddm, prodsys, t0, …) – Single display using GWT