© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Current state of art in terms of the integration of the instrumentation with Grid Marcin Płóciennik Marcin Płóciennik

© 2006 Open Grid Forum 2 The main purpose of this research group is to bring together various existing approaches in defining remote access interfaces to sophisticated laboratory equipment, as well as to come up with use cases that can dictate the requirements for integrating scientific instruments with the Grid Special interest in the advances of Grid technologies in areas such as interactivity, visualization and Quality of Service RISGE-RG Main Objective

© 2006 Open Grid Forum 3 Involved projects GRIDCC ( RINGrid ( int.eu.grid ( g-Eclipse( AUGERACCESS( VLab( ( Integrated e-Infrastructure for Facilities ( CIMA EGEE CYCLOPS( DEGREE ( An Open Network for Robotic Telescopes NORIA Network for Ocean Research, Interaction and Application, MBAR Observatory Middleware Framework, MBARI, USA SENSORS: Ocean Observing Network Infrastructure ( ) MBARI, USAhttp:// DORII ( BalticGrid-II ( SpectroGrid - NRC

© 2006 Open Grid Forum 4 Involved communities – overview Representatives of: Remote Instrumentation related user communities (like DORII, AUGERACCESS,NORIA) Remote Instrumentation focused projects (like GRIDCC, RINGrid, VLab, Observatory Middleware Framework, CIMA) Grid middleware projects (like g-Eclipse) Grid infrastructure projects (like int.eu.grid, BalticGrid, EGEE) Geographically: Europe, North America, Australia Asia

© 2006 Open Grid Forum 5 Current activities Work on collectiong and describing use cases Writing document describing collection of common use cases, identify requirements and necessary capabilities Disscusion on Model use case Also: Engaging next projects Collecting basic informations from involved projects Best practices presentations, Preparing input to other workshops

© 2006 Open Grid Forum 6 Overview The area of remote access to distributed instrumentation and laboratories is highly inter-disciplinary. Different technical aspects are of importance when the issues of accessing the instruments in real-time (or near real time) are taken into consideration in e-Infrastructure: among others, Quality of Service (QoS) capabilities provided by the network, secure interactive and collaborative work possibilities

© 2006 Open Grid Forum 7 Integrated e-Infrastructure for Facilities The STFC e-Science Centre was founded with the specific aim of 'Grid enabling' the STFC facilities. This was defined as developing, deploying and running e- Services for experimental, computing and data facilities to further the science carried out at these facilities. Working collaboratively with facilities and their users Enabling users to get rapid access to their current and past data, related experiments, publications etc. Providing an integrated infrastructure for data management and advanced analysis

© 2006 Open Grid Forum 8 Grid Enabled Remote Instrumentation with Distributed Control and Computation GRIDCC was a project funded by the EC, aimed to provide access to and control of distributed complex instrumentation. The goal of GRIDCC was to exploit grid opportunities for the secure and collaborative work of distributed teams, in order to remotely operate and monitor scientific equipment using the grid’s massive memory and computing resources for storing and processing data generated by this kind of equipment.

© 2006 Open Grid Forum 9 VLAB – Virtual Laboratory (NMR integration) Framework for virtual laboratories Definition of dynamic measurement scenarios All accessible remote facilities treated as simple resources in the Grid infrastructure Human factor and interactivity – important issues to be taken into account Done in co-operation with Silicon Graphics, supported by the Polish Ministry of Science and Higher Education

© 2006 Open Grid Forum 10 Network for Ocean Research, Interaction and Application Ocean Observing Initiative Cyberinfrastructure Implementing Organization NORIA creates a blueprint for digital infrastructure that will allow ocean observatories to collect, process and transmit data 24 hours a day, seven days a week. Routine, long-term measurement of episodic oceanic processes is crucial to continued growth in our understanding and predictive modeling of complex natural phenomena that are highly variable and span enormous scales in space and time. The cyberinfrastructure will transport real-time data streams at up to one gigabit per second from a variety of ocean-dwelling sensors and other instruments. The data will be available in real time via dedicated, high-speed Internet links to every researcher, teacher or citizen. Two-way connectivity will also allow scientists to operate robots on the ocean floor interactively—from the relative comfort of their campus laboratories.

© 2006 Open Grid Forum 11 Functional requirements Incl. quality control / validation of data Selection services (scheduling and reservation, also including computational, storage and networking resources) – Optional; Input management (identification, preparation processes) – Optional; Instrument virtualization / Service provider (representation as manageable resource) – Obligatory; Policy decision and enforcement – Optional; Data management of input – Optional, applies to digital input only; Local operator (shore side) – Optional if remote control of instruments is possible. Can be assistive to input management as well; Visualization devices – Optional; Software for post-processing – Optional; Includes ability to merge data (extracted from local instrument storage unit after recovery from remote site) with incomplete/summary data transmitted in real-time from instrument. Workflow management – Optional; Accounting and Monitoring – Obligatory; Instrument representative – Obligatory. Each instrument has an individual tasked with monitoring the data stream and accessing the quality of that data 11

© 2006 Open Grid Forum 12 Non-functional requirements Security considerations The observatory assets and instruments must be protected against damage that could be caused by unauthorized access Each user must be authenticated to allow access to data Some authorized users allowed to access restricted data Some authorized users allowed to control specific instruments or processes Operators must be authenticated to allow additional operations (change parameters, turn instruments on or off, do maintenance, etc.) Performance considerations (incl. real-time properties) Strict QoS requirements on data flow from instruments to shore station under operator control Expectation of near-real-time data delivery from community instruments (expectation varies depending upon the instrument and the platform type [cabled vs coastal moored vs global moored vs underwater autonomous]) 12

© 2006 Open Grid Forum 13 AUGERACCESS Extension of Pierre Auger Observatory EU project in the Sixth Framework Program Improve access to observatory in Argentina Replication of 7 Tbytes of measured data per year Additional much larger monitoring data Upgrade of the communication link Improve management via remote connection Controllable world wide Software for remote control and remote monitoring Authentication and authorization Secure communication

© 2006 Open Grid Forum 14 Functional Requirements Access from world wide to private networks via a dedicated server Access from central campus to telescope buildings Not only remote control – remote data acquisition is needed Storage of measured data on Grid infrastructure Analysis of the measured data on the Grid Near real time properties

© 2006 Open Grid Forum 15 Non-Functional Requirements Authorization and authentication Secure communication Different security levels for different groups Software update of the system (highest) Control and monitor the system (high) Reading measured data (low) All real time properties are handled by the Front-End-Crates

© 2006 Open Grid Forum 16 Summary one of the key point for experimental science is remote execution and control of experiments a number of problems are addressed by using sophisticated equipment, which is often locally unavailable the usage of e-Infrastructure, that allow virtualized and shared access to distributed scientific instruments is essential e-Infrastructure enables collaborative work of distributed teams that is of great importance

© 2006 Open Grid Forum 17 Contacts We are open for collaboration Mailing list: Groupwebspace: Contact: Next RISGE-RG meeting: OGF25 – Catania, March