1. GRID enabled remote instrumentation and sensors with distributed control Francesco Lelli Istituto Nazionale di Fisica Nucleare – Laboratori di Legnaro Legnaro (PD), Italy EU FP6 Project

2. F. Lelli, Cairo 09 09 2007 2 www.gridcc.org (EU FP6 Contract 511382) The Grid Technologies to extend the limit of a single computer (center) Grid Technologies User Interface Grid Gateway ComputingElement StorageElement ComputingElement ComputingElement

3. F. Lelli, Cairo 09 09 2007 3 www.gridcc.org (EU FP6 Contract 511382) Extending the Grid Concepts Grid Technologies Satellite views to monitor the volcano Control and Monitor Room To model calculations and disaster predictions Terrestrial probes to monitor The volcano activities Grid Gateway

4. F. Lelli, Cairo 09 09 2007 4 www.gridcc.org (EU FP6 Contract 511382) GridCC Instruments Grid Computational Grid GridCC + Data for Model Calculations Predictions

5. F. Lelli, Cairo 09 09 2007 5 www.gridcc.org (EU FP6 Contract 511382) The GRIDCC project: Goals & Objectives 1. The GRIDCC - Grid Enabled Remote Instrumentation with Distributed Control and Computation – project has the main aim to bring Instruments to the GRID 2. It is a 3-years EU FP6 project started in September 2004 3. Web site: www.gridcc.orgwww.gridcc.org 4. More in particular the project goals are: 1. Definition of a “Instrument Element” allowing a standard remote access to any type of instrumentation 2. Tight integration between instrument grid and classical computational grid 3. Human interaction with Grids via Virtual Control Room (collaborative environment) 4. Enactment of complex workflows

6. F. Lelli, Cairo 09 09 2007 6 www.gridcc.org (EU FP6 Contract 511382) The GRIDCC partners Participant nameCountry Istituto Nazionale di Fisica NucleareItaly Institute Of Accelerating Systems and ApplicationsGreece Brunel UniversityUK Consorzio Interuniversitario per TelecomunicazioniItaly Sincrotrone Trieste S.C.P.AItaly IBM (Haifa Research Lab)Israel Imperial College of Science, Technology & MedicineUK Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche Italy Universita degli Studi di UdineItaly Greek Research and Technology Network S.A.Greece

7. F. Lelli, Cairo 09 09 2007 7 www.gridcc.org (EU FP6 Contract 511382) GridCC: The Basic Idea Storage Elements Storage Elements Computing Element Computing Element Instrument Element Computing Element Storage Element Instrument Element Instrument Element Existing Grid Infrastructures Virtual Control Room Virtual Control Room Execution Service

8. F. Lelli, Cairo 09 09 2007 8 www.gridcc.org (EU FP6 Contract 511382) GRIDCC Architecture Web Service Interface Execution Service WfMS WMS AS Instrument elements (IE) Storage Element (SE) Instrument elements (IE) Storage Element (SE) Instrument Element (IE) Storage Element (SE) Compute element (CE) Compute element (CE) Computing Element (CE) Storage Element (SE) Storage Element (SE) Storage Element (SE) Information System (BDII) Virtual Control Room WMS Work Management System WfMS Work Flow Mng System AS Agreement Service Broker gLite GRID GRIDCC

9. F. Lelli, Cairo 09 09 2007 9 www.gridcc.org (EU FP6 Contract 511382) GridCC PermanentTest Bed VOMS AS, KrbServer VCR, SE, IE, BDII IE, CE/CREAM,SE, LFC WMProxy WfMS VCR, IE

10. F. Lelli, Cairo 09 09 2007 10 www.gridcc.org (EU FP6 Contract 511382) GRIDCC main target areas (Large-scale) scientific experiments High energy particle physics (Radio-) Telescopes Remote process control Accelerator control (Tele-) Biomedicine Robotics Automotive Electronic microscopes Widely Sparse Instrumentation Power Grids Monitoring of the territory Monitoring of the sea Geo-hazard prediction Distributed laboratories Transportation monitoring Sensor network GRIDCC Middleware

11. F. Lelli, Cairo 09 09 2007 11 www.gridcc.org (EU FP6 Contract 511382) GRIDCC pilot applications Power Grid High Energy Physics CMS High Energy Physics CMS Particle Accelerator Device Farm Geohazard Monitoring Meteorology

12. F. Lelli, Cairo 09 09 2007 12 www.gridcc.org (EU FP6 Contract 511382) Instrument Element Requirements Web Services Instrument Element Any Protocol or physical connection Sensor Network Instrument Grid Computing Element ElementStorage Computing InstrumentElement W E F A B C D 1: Provide a uniform access to the physical devices 2: Allow a standard grid access to the instruments 3: Allow the cooperation between different instruments that belong to different VOs

13. F. Lelli, Cairo 09 09 2007 13 www.gridcc.org (EU FP6 Contract 511382) A new 4 channels element to fit the requirements: The Instrument Element (IE) Instrumentation Contorl GRID Access Instruments Access Data/Info Pubblishing Instrument Element Web Service SRM/GRIDFTP Custom (JMS,..... ) Custom I’m here Discovery QoS Advance Reservation

14. F. Lelli, Cairo 09 09 2007 14 www.gridcc.org (EU FP6 Contract 511382) VIGS IMS Proxy Control Manager Data Collector Real Instruments Data Flow Control Flow State Flow Error Flow Monitor Flow The term Instrument Element describes a set of services that provide the needed interface and implementation that enables the remote control and monitoring of physical instruments. Input Manager Event Processor FSM Engine Resource Proxy Control Manager IMS Instrument Element Architecture Resource Service IMS Problem Solver Instrument Manager Instrument Element Data Publisher Access Control Manager SRM/SE GridFTP SE IMS Instrument Protocols

15. F. Lelli, Cairo 09 09 2007 15 www.gridcc.org (EU FP6 Contract 511382) Virtual Control Room (VCR) The VCR is a web portal Based on the Gridsphere framework (portlet technology) and providing general cooperative tools event tools resource tools communicatin tools chat video conf application specific tools instrument control log book log reports data monitor

16. F. Lelli, Cairo 09 09 2007 16 www.gridcc.org (EU FP6 Contract 511382) VCR examples

17. F. Lelli, Cairo 09 09 2007 17 www.gridcc.org (EU FP6 Contract 511382) GRIDCC at Work

18. F. Lelli, Cairo 09 09 2007 18 www.gridcc.org (EU FP6 Contract 511382) Pilot applications: CMS - I The GridCC middleware has been deployed to control the run of the CMS (Compact Muon Solenoid), one of the four high energy experiments in LHC (Large Hadron Collider) at CERN laboratory. CMS Magnet Test and Cosmic Challenge (MTCC) I and II, a milestone in the CMS construction, positively carried out. Top IE CSC IE Tracker IE HCAL IE DAQ IE RPC IE Trigger IE DT IE ECAL IE DAQ IM FBRBFF xdaq DAQ RS DAQ IMS User Interface CMS Control Structure CMS Detector

19. F. Lelli, Cairo 09 09 2007 19 www.gridcc.org (EU FP6 Contract 511382) CMS MTCC phase I and phase II carried out in 2006 Scale MTCC versus CMS FEDs: 20 out of 600 3% EVB RUs: 6 out of 6001% Filter Farm: 14 out of 20000.3% Trigger rate: 100 Hz out of 100 kHz 0.1% Event size: 200 kB out of 1 MB20% IEs15 out of 150 10 % Scale MTCC versus CMS FEDs: 20 out of 600 3% EVB RUs: 6 out of 6001% Filter Farm: 14 out of 20000.3% Trigger rate: 100 Hz out of 100 kHz 0.1% Event size: 200 kB out of 1 MB20% IEs15 out of 150 10 %

20. F. Lelli, Cairo 09 09 2007 20 www.gridcc.org (EU FP6 Contract 511382) Top IM VCR Services Services PSA Chf d’Or EVB Chf d’Or Tracking Chf d’Or Storage IM SlwCtrl IM EVB Sub- System Storage Sub- System PSA Sub-System Tracking Sub-System SlowCtrl Sub- System Maestro Web Services Main Data Flow (Narval Systems) Resource Service Log Collector Error Collector ….. Ancillary IM Ancillary Sub- System Narval Systems IM = Function Manager

21. F. Lelli, Cairo 09 09 2007 21 www.gridcc.org (EU FP6 Contract 511382) Pilot applications: Power grid Instrument Manager Instrument Element... Virtual Control Room Virtual Control Room Gas Solar Panel Power Grid V.O. GRIDCC deployed to monitor: A 50kW generator A 1 kw Photo-Voltaic array

22. F. Lelli, Cairo 09 09 2007 22 www.gridcc.org (EU FP6 Contract 511382) Pilot applications: Remote Operation of an Accelerator Elettra Synchrotron

23. F. Lelli, Cairo 09 09 2007 23 www.gridcc.org (EU FP6 Contract 511382) GRIDCC: other applications Meteorology (Ensemble Limited Area Forecasting)  Weather forecasting system to detect hazardous weather Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories  The Device Farm consists of a pool of Measurement Instruments for Telecommunication Experiments Geo-hazards: Remote Operation of Geophysical Monitoring Network  The monitoring net will be characterized by different levels of activity: stand-by, pre-alert, alert, plus a control modality  An event worth to be monitored is for example the evolution of a “landslip”

24. F. Lelli, Cairo 09 09 2007 24 www.gridcc.org (EU FP6 Contract 511382) Instrument Element: Scalable on embedded systems FPGA PPC 405 Xilink Virtex IV Custom Board Custom Electronics 1 Gbps Ethernet Web Service GridCC IM JavaVM Linux USER INTERFACE Custom Logic Montavista www.montavista.com JamVM http://jamvm.sourceforge.net Standalone Axis IE Instrument Manager

25. F. Lelli, Cairo 09 09 2007 25 www.gridcc.org (EU FP6 Contract 511382) IE technologies Web Service compliant (WS-I) Tomcat + Axis (and Java) and Axis standalone are the main technologies of the IE All the services are deployed on a single or multiple instances of Tomcat, according to the needs of the application Message oriented middleware (Pub/Sub) is based on the Java Messaging System (JMS). The following implementations are used in the project  Sun  Narada Brokering  RMM - JMS (GridCC IBM) MySQL and Oracle are used as Data Base for the RS SRM interface version 2.2 used

26. F. Lelli, Cairo 09 09 2007 26 www.gridcc.org (EU FP6 Contract 511382) Conclusions I The GRIDCC technology (based on web services) is used to have an homogenous backbone to control and monitor geographically widely distributed instrumentation. Data taken from the instrumentation can be directly seen by the european computational and storage GRID CMS experiment is using for its data taken GRIDCC based run control system. The final configuration is target to control O(1000) nodes AGaTA experiment is building its data taken GRIDCC based run control system. The final configuration is target to control O(1000) nodes

27. F. Lelli, Cairo 09 09 2007 27 www.gridcc.org (EU FP6 Contract 511382) Conclusions II GRIDCC is ending this year having reached all the mail milestones foreseen and having, in particular, a production environment (CMS) daily running and serving hundreds of physicists in commanding and controlling either their sub detectors or the full experiment. GRIDCC team is now keen to look for new exploitations of their outcomes in different contexts adding, possibly, new developments and customization of the middleware according to the new needs. The control and monitor of pan European projects like EMSO and KM3NET appears to be very attractive in this sense, as it could be implemented like a new e-infrastructure across Europe dedicated to the remote control of big scientific apparatus. Moreover the online data integration with the computational and storage GRID provides to fill a gap in the existing computational grid and at the same time give a strong added value to the proposal of this new e-infrastructure.

28. F. Lelli, Cairo 09 09 2007 28 www.gridcc.org (EU FP6 Contract 511382) Grid Technologies LambdaNetwork Web 2.0 Tools PervasiveComputing Conclusions III http://sadgw.lnl.infn.it:2002/MapsMonitor

29. F. Lelli, Cairo 09 09 2007 29 www.gridcc.org (EU FP6 Contract 511382) Querring Client Querring Client Discovery Instruments (I) The discovery of the instruments or of the IEs is an issue when the number of elements is high We can have two cases:  Quasi static cases The number of IEs are well defined and the single IE is quite complex with a good hardware support In this case a register based discovery mechanism can be used. GRIDCC tesbed is using the LCG BDII ( Berkely Database Information Index ) based on LDAP The information collected in the BDII follow a GLUE schema and can be used for match making querries IE BDII Local BDII Querring Client

30. F. Lelli, Cairo 09 09 2007 30 www.gridcc.org (EU FP6 Contract 511382) Discovering Instruments (II)  Dynamic cases The number of IEs can change very quickly, they are very simple devices, often with poor hardware support The discovery is just use to know which are the online IEs A new approach has been developed based on Peer to Peer (P2P) protocols See the demo IE M1 M2 Querring Client Querring Client Querring Client

31. F. Lelli, Cairo 09 09 2007 31 www.gridcc.org (EU FP6 Contract 511382) Question? Thx for your time!  The GRIDCC Project. Grid enabled Remote Instrumentation with Distribute Control and Computation. Official Webpage of FP6 European funded project. The GRIDCC Project  Video On-Line Demo. A sample video that shows the GRIDCC service orchestration. Video On-Line Demo  Live Demo. A Peer to Peer Approach for the Geo-Location of a Grid of Instruments Live Demo  GridCC in GRIDToday. Gaetano Maron and Francesco Lelli presented the GRIDCC project in one of the leading online journals. GridCC in GRIDToday  GridCC in Wikipedia GridCC in Wikipedia  Instrument Element Facade Online documentation for Instrument Elements developers. Instrument Element Facade More: