F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Instrument Elements at Work Imperial Brunel Elettra IBM CNIT IASA IMAA GRNet UniUD INFN VCR Monitor GUI Network Information Provider Instrument Element Network Core Machine Francesco Lelli By GRIDCC WP3 Team* * E. Frizziero, M. Gulmini, F. Lelli,G. Maron, P. Molini, A. Petrucci, S. Squizzato, S. Traldi

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 GridCC Project: The Basic Idea Storage Elements Storage Elements Computing Element Computing Element Instrument Element Computing Element Storage Element Instrument Element Instrument Element Existing Grid Infrastructures Web Service Interface Virtual Control Room Virtual Control Room Execution Service Problem Solver Information and Monitor Srvc Security Service

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Instrument Element Requirements Web Services Instrument Element Any Protocol or physical connection Sensor Network Instrument Grid Computing Element ElementStorage Computing InstrumentElement W E F A B C D 1: Provides a uniform access to the physical devices 2: Allows a standard grid access to the instruments 3: Allows the cooperation between different instruments that belong to different VOs 1: 2: 3:

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Instrument Element: a versatile multichannel I/O IE VIGS Instrument Control Fast communication channel The term Instrument Element describes a set of services that provide the needed interface and implementation that enables the remote control and monitoring of physical instruments. Grid Interaction SRM Instruments Our Answers to the Previous Slide: 1)The Virtual Instrument Grid Service (VIGS) provides the a uniform control interface 2)The Information and Monitoring Service (IMS) disseminates the acquired information logs and errors of the instruments. 3)The Storage Resource Management (SRM) provides a standard Grid Interface in order to permit the access by others Grids components like the SE and the CE IE Key Developers: E. Frizziero 1, M. Gulmini 1, F. Lelli 1,2,G. Maron 1, P. Molini 1 A. Petrucci 1, S. Squizzato 1, S. Traldi 1 1 Istituto Nazionale di Fisica Nucleare, Laboratori Nazionali di Legnaro 2 Dipartimento di Informatica, Università Ca’ Foscari di Venezia IMS

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Instrument Element Architecture Virtual Instrument Grid Service (VIGS) Resource Service Inf & Mon Service Problem Solver Instrument Manager Instrument Element Data Mover Control Manager Communication Tools Real Instruments Data Flow Control Flow State Flow Error Flow Monitor Flow Access Control Manager execute() getState() create() destroy() Input Manager Event Processor FSM Engine Resource Proxy Control Manager Data Collector IMS Proxy The term Instrument Element describes a set of services that provide the needed interface and implementation that enables the remote control and monitoring of physical instruments.

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Example of Widely Sparse Instrumentation Power Grids Territory Monitoring Sea Monitoring Distributed Laboratories Transportation Monitoring Sensor Network What we are addressing in this demo We are considering Instruments that are: 1)Large in Number 2)Highly dynamic 3)Widely Distributed 4)In Low Resources/Embedded Systems

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Widely Sparse Instrument Elements at Work Imperial Brunel Elettra IBM CNIT IASA IMAA GRNet UniUD INFN VCR Monitor GUI Network Information Provider Instrument Element Network Core Machine

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 VCR Monitor GUI A B C D 0 M1 M Instrument Elements Index Services Network Core Instrument Element P2P Discovery: a new Approach

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 X Y Z D K 1 Network Core VCR Monitor GUI Ma Mb Index Services Instrument Elements Instrument Element Discovery (2)

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Additional Information Textual List of the Instrument Elements Google Maps geolocation of the Instrument Elements Network Core Machine: Tiny-IE with Web Start: (start an IE in your Machine) Example of Tiny-IE deployed in Legnaro: Used Technology:

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Advantages of a Peer To Peer Approach Instruments, Network Core Machines and Network Information Providers can dynamically join and disappear from the network without affecting others Instruments or requiring additional configuration efforts. Instrument Element network will self-optimize. In other words, if you encounter performance problems, you can simply add a “Network Core Machine” and the machines loads will be redistributed. The scalability outperforms a BDII based system. In systems based only on a Instrument Element network you could avoid the installation of one or more BDIIs. This discovery system can be embedded in IEs that run in FPGA and not in “standard PC”. A particular version Instrument Index Service can talk with the BDII in order to fill the information of a group of “light instruments” that run in embedded systems. The final network topology can not only be Hierarchic but also Power Low or a Hierarchic/Power Low hybrid.

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Instrument Element: IMS Data Publishing Subscribers subscribe to a given Topic/Queue with a subscribe condition Publishers asynchronously publish messages in a Topic/Queue with a given message condition Publishers and subscribers can be part of the same WAN distributed machines or not Web Service performance is inadequate for fast publishing Each Instrument can be a data publisher or a data subscriber Brokered Implementation Broker-less (P2P) Implementation

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 IMS for Monitoring purposes in this Demo Service Oriented Architecture Several different WS-I compliant GUI visualizers: J2EE, Lavbiew etc... Adherence to standards: WS-I compliant web services  Standardized and uniform access to GRIDCC components  Services loosely coupled  High interoperability Publishers Pub / Sub System DataAcquisition Web Service Monitor GUIs

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 IMS Message Rate: one-to-many 32 Dual Xeon 2.4GHz 1.5GB RAM machines, 1 GB Ethernet switch At most 1 publisher, subscriber, or broker- (Sun MQ3.6) per machine No message lost RMM-JMS throughput: Mbytes/sec. (for 5 and more publishers) Subscribers Topic Publisher

F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Thx for your time and attention Acknowledgement: The GridCC project is supported under EU FP6 contract More information: On-line Demo at : On-line Demo at :