© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Overview Marcin Płóciennik Munich, OGF 28 Marcin Płóciennik.

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum GHPN-RG Status update co-chairss:Cees de Laat Dimitra Simeonidou GGF22, Boston, February 2008.
Advertisements

© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps OGF 23, June 2008, Barcelona, Spain.
© 2006 Open Grid Forum Network Services Interface OGF30: Connection Services Guy Roberts, 27 th Oct 2010.
© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps: Examples OGF 22, February 2008, Cambridge, MA.
© 2006 Open Grid Forum GridRPC Interoperability Test Response to comments Yusuke Tanimura.
© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
© 2007 Open Grid Forum JSDL-WG Session OGF27 – General Session 10:30-12:00, 14 October 2009 Banff, Canada.
©2010Open Grid Forum OGF28 OGSA-DMI Status Chairs: Mario Antonioletti, EPCC Stephen Crouch, Southampton Shahbaz Memon, FZJ Ravi Madduri, UoC.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2007 Open Grid Forum JSDL-WG Session OGF21 – Activity schema session 17 October 2007 Seattle, U.S.
© 2006 Open Grid Forum 2 nd March 09 Enterprise Grid Requirements Research Group OGF25 EGR-RG Session Group.
Oct 15 th, 2009 OGF 27, Infrastructure Area: Status of FVGA-WG Status of Firewall Virtualization for Grid Applications - Working Group
© 2008 Open Grid Forum Resource Selection Services OGF22 – Boston, Feb
© 2006 Open Grid Forum Network Services Interface OGF29: Working Group Meeting Guy Roberts, 19 th Jun 2010.
Feb OGF22NML-WG: Welcome and Introduction Welcome and Introduction Paola Grosso - UvA Martin Swany - UDelaware.
© 2007 Open Grid Forum JSDL-WG Session 1 OGF25 – General Session 11:00-12:30, 3 March 2009 Catania.
© 2006 Open Grid Forum JSDL Optional Elements OGF 24 Singapore.
© 2007 Open Grid Forum Data/Compute Affinity Focus on Data Caching.
© 2007 Open Grid Forum OGSA-RUS Specification Update, Adoption and WS-RF Profile Discussions (Molly Pitcher) Morris Riedel (Forschungszentrum Jülich –
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources (OGSA Modeling Activities) OGF 21 - Seattle, 16 October 2007.
© 2006 Open Grid Forum Network Services Interface OGF30: Working Group Meeting Guy Roberts, Inder Monga, Tomohiro Kudoh 27 th Oct 2010.
© 2009 Open Grid Forum Usage Record Working Group Alignment and Production Profile.
© 2006 Open Grid Forum Interoperability Requirements for e/Cyber-infrastructure Workshop.
DORII Deployment of Remote Instrumentation Infrastructure Norbert Meyer Poznań Supercomputing and Netwoking Center DORII Workshop,
1 ©2013 Open Grid Forum OGF Working Group Sessions Security Area – FEDSEC Jens Jensen, OGF Security Area.
OGF26 Grid Information Retrieval Research Group May 26, 2008 Chapel Hill.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
© 2007 Open Grid Forum Data Grid Management Systems: Standard API - community development Arun Jagatheesan, San Diego Supercomputer Center & iRODS.org.
© 2006 Open Grid Forum Service Level Terms Andrew Grimshaw.
© 2010 Open Grid Forum Standards All Hands Meeting OGF28, München, March 2010.
© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Current state of art in terms of the integration of the instrumentation with.
OGF DMNR BoF Dynamic Management of Network Resources Documents available at: Guy Roberts, John Vollbrecht.
© 2006 Open Grid Forum Network Services Interface OGF 32, Salt Lake City Guy Roberts, Inder Monga, Tomohiro Kudoh 16 th July 2011.
© 2007 Open Grid Forum Enterprise Best (Community) Practices Workshop OGF 22 - Cambridge Nick Werstiuk February 25, 2007.
© 2010 Open Grid Forum OCCI Status Update Alexander Papaspyrou, Andy Edmonds, Thijs Metsch OGF31.
© 2007 Open Grid Forum JSDL-WG Session OGF22 – General Session (11:15-12:45) 25 February 2008 Boston, U.S.
© 2006 Open Grid Forum FEDSEC-CG Andrew Grimshaw and Jens Jensen.
© 2006 Open Grid Forum Activity Instance Schema Philipp Wieder (with the help of the JSDL-WG) Activity Instance Document Schema BoF Monday, 25 February,
© 2006 Open Grid Forum Network Services Interface OGF 33, Lyon Guy Roberts, Inder Monga, Tomohiro Kudoh 19 th Sept 2011.
© 2015 Open Grid Forum ETSI CSC activities Wolfgang Ziegler Area Director Applications, OGF Fraunhofer Institute SCAI Open Grid Forum 44, May 21-22, 2015.
© 2006 Open Grid Forum HPC Job Delegation Best Practices Grid Scheduling Architecture Research Group (GSA-RG) May 26, 2009, Chapel Hill, NC, US.
© 2006 Open Grid Forum GridRPC Working Group 15 th Meeting GGF22, Cambridge, MA, USA, Feb
© 2006 Open Grid Forum Network Services Interface CS Errata Guy Roberts, Chin Guok, Tomohiro Kudoh 29 Sept 2015.
© 2006 Open Grid Forum OGSA-WG: EGA Reference Model GGF18 Sept. 12, 4-5:30pm, #159A-B.
© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Introduction Marcin Płóciennik Banff, OGF 27 Marcin Płóciennik.
© 2006 Open Grid Forum Grid High-Performance Networking Research Group (GHPN-RG) Dimitra Simeonidou
© 2006 Open Grid Forum NML Progres OGF 28, München.
© 2008 Open Grid Forum PGI - Information Security in the UNICORE Grid Middleware Morris Riedel (FZJ – Jülich Supercomputing Centre & DEISA) PGI Co-Chair.
© 2007 Open Grid Forum OGF Management Area Meeting OGF20 7 May, am-12:30pm Manchester, UK.
© 2006 Open Grid Forum VOMSPROC WG OGF36, Chicago, IL, US.
© 2007 Open Grid Forum OGF20 Levels of the Grid Workflow Interoperability OGSA-WG F2F meeting Adrian Toth University of Miskolc NIIF 11 th May, 2007.
© 2008 Open Grid Forum Production Grid Infrastructure WG State Model Discussions PGI Team.
© 2007 Open Grid Forum JSDL-WG Session OGF26 – General Session 11:00-12:30, 28 May 2009 Chapel Hill, NC.
Network Services Interface
GGF Intellectual Property Policy
Welcome and Introduction
RISGE-RG use case template
GridRPC Working Group 13th Meeting
Grid Resource Allocation Agreement Protocol
OGF session PMA, Florence, 31 Jan 2017.
Network Services Interface
Network Services Interface Working Group
OGSA-Workflow OGSA-WG.
Network Measurements Working Group
WS Naming OGF 19 - Friday Center, NC.
Activity Delegation Kick Off
Network Services Interface Working Group
Introduction to OGF Standards
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Presentation transcript:

© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Overview Marcin Płóciennik Munich, OGF 28 Marcin Płóciennik Munich, OGF 28

© 2006 Open Grid Forum 2 OGF IPR Policies Apply “I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy.” Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the OGF plenary session, any OGF working group or portion thereof, the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, the ADCOM, or any member thereof on behalf of the ADCOM, any OGF mailing list, including any group list, or any other list functioning under OGF auspices, the OGF Editor or the document authoring and review process Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions. Excerpt from Appendix B of GFD-C.1: ”Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non- discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.” OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.

© 2006 Open Grid Forum 3 Outline Remote Instrumentation overview Example research: DORII project RISGE-RG goals RISGE-RG main activities Future plans Open points and questions

© 2006 Open Grid Forum 4 Remote Instrumentation What is it? Remote instrumentation is the method of providing data acquisition and/or control of scientific instruments from remote locations. Why we need it? Impact on the science society: to give the possibility to do experimental science using facilities that are extremely rare or unique. This also open lot of opportunities for scientists from developing countries for sharing very expensive laboratory instruments Impact on the education: to give students access to experiments remotely even on other continent. Remote instrumentation can allow on- line courses on specific instruments Impact on the instrument usage: more efficient use of specialized equipment that might otherwise be idle.

© 2006 Open Grid Forum 5 Buildings: security, safety Roads and bridges Rural/Developing countries health care Automotive Source: Fuji-Keisei USA, Inc. 8 classes 47 types Market logistics Sensor and Instruments

© 2006 Open Grid Forum 6 Instrument taxonomy

© 2006 Open Grid Forum 7 Instruments scale Very Large number of Small and Tiny (Sensor Networks) Rapid evolution Wide range of data types Medium scale (like NMRs, etc) Large number of distributed devices Control, access and workflow is complex Small number of very expensive instruments like synchotron Very complex control Lot of demanding requirements

© 2006 Open Grid Forum 8 Research in Europe DORII, RINGrid, GRIDCC – mentioned next slides AugerAccess - Integrating Auger Observatory and European Research Institutions into a worldwide Grid. AugerAccess is a project dedicated to improving the access capabilities of European research groups working on the Pierre Auger Observatory(Argentina). Design and development of software with the aim of implementing a system of remote monitoring and control of the data taking from the Auger Observatory. OpenTel - An Open Network for Robotic Telescopes -provides the means for interconnecting single robotic telescopes to a global network for sharing observation time, observation programs and data VLAB - The main goal of the VLab was to create a framework for building many different types of laboratory. Another purpose was defining all accessible remote facilities treated as simple resources in the Grid infrastructure. ARGUGRID – project that deals with instruments like satellites/sensors for earth observation OptIPuter Microscopy – project aiming fully duplexed real time Electron Microscopy control

© 2006 Open Grid Forum 9 Grid Enabled Remote Instrumentation with Distributed Control and Computation GRIDCC was a project funded by the EC, aimed to provide access to and control of distributed complex instrumentation. The goal of GRIDCC was to exploit grid opportunities for the secure and collaborative work of distributed teams, in order to remotely operate and monitor scientific equipment using the grid’s massive memory and computing resources for storing and processing data generated by this kind of equipment.

© 2006 Open Grid Forum 10 Remote Instrumentation in Next- generation Grids RINGrid provides an architecture which integrates instrumentations with eInfrastructure. It encompasses the current state of the art and near future technology, delivers a conceptual design of missing architectural ‘piece’ and is supported by the Grid environment. Project objectives were: Identification of instruments and user communities, definition of requirements Synergy between remote instrumentation and next-generation high- speed communications networks and grid infrastructures Trend analysis and recommendations for designing next-generation remote instrumentation services Promoting egalitarian access to European e-Infrastructure opportunities Dissemination of project results to scientific and business groups of users

© 2006 Open Grid Forum 11 Research in US – example (1) CIMA - The Common Instrument Middleware Architecture - project supported by the NSF Middleware Initiative to integrate instruments and sensors as real-time data sources into grid computing environments through a Service Oriented Architecture Remote Instrumentation Collaboration Environment (RICE) software that has functionalities that facilitate reliable and efficient remote instrumentation such as network health awareness to detect network bottleneck periods, and collaboration tools for multiple participants to interact during research and training sessions. Gemini Observatory that is an initiative that uses Internet2 to allow remote users to manipulate their twin telescopes

© 2006 Open Grid Forum 12 NanoManipulator that uses Internet2 to allow remote control and visualization of images from their scanning probe microscopes. NORIA - The cyberinfrastructure that transport real-time data streams at up to one gigabit per second from a variety of ocean- dwelling sensors and other instruments. Two-way connectivity allow scientists to operate robots on the ocean floor interactively—from the relative comfort of their campus laboratories. Observatory Middleware Framework - This project build a working prototype of an Observatory Middleware Framework, designed and implemented to scale to a national or international level and interoperate with other large environmental observatories. It provide a new framework and techniques to access and process both raw and derived data streams from multiple observatories independent of their specific technological implementation. Research in US – example (2)

© 2006 Open Grid Forum 13 Other research Canada – SpectroGrid - software system based on open-source technologies, which was implemented to provide secure access to remote Nuclear Magnetic Resonance (NMR) spectroscopy instruments Japan – research done in National Institute of Materials Science, where remote instrumentation is being put into practice and available to the high school education programs Australia – University of Sydney - extensions to CIMA - development of instrument control via CIMA

© 2006 Open Grid Forum 14

© 2006 Open Grid Forum 15 DORII - introduction DORII - Deployment of Remote Instrumentation Infrastructure EU FP7 project (RI ), Research Infrastructures, in the call of th INFRA – „Deployment of e- Infrastructures for scientific communities” Project started in February 2008 and is planned for 30 months Combination of Collaborative projects & Coordination and support action Partners: IT providers, scientific comunities, SME

© 2006 Open Grid Forum 16 DORII – scientific communities Earthquake community: Network-centric seismic simulations Earthquake early warning system Environment community with selected applications: Oceanographic and coastal observation and modelling Mediterranean Ocean Observing Network Oceanographic and coastal observation and modelling using imaging Experimental science community On-line data analysis - synchrotron and free electron lasers Reference installation mentioned by ESFRI

© 2006 Open Grid Forum 17 Earthquake Community

© 2006 Open Grid Forum m 200 m cm/s cm/s Glider: Data sampling and ground transmission

© 2006 Open Grid Forum 19 Experimental Science: SRF

© 2006 Open Grid Forum 20 DORII Architecture Introduced new components on top of existing software stacks Major features: Hardware virtualisation(makes the approach general, allows fast prototyping) Workflow composition( automate the process of monitoring and controling Interaction (quasi real-time control of the instruments)

© 2006 Open Grid Forum 21 OGF RISGE-RG Open Grid Forum Remote Instrumentation Services in Grid Environment Research Group

© 2006 Open Grid Forum 22 The main purpose of this research group is to bring together various existing approaches in defining remote access interfaces to sophisticated laboratory equipment, to come up with use cases that can dictate the requirements for integrating scientific instruments with the Grid to identify the gaps in available standards related to remote instrumentation integrated with Grid and to establish new Working Groups to standardize the relevant capabilities Our Research Group Main Goal

© 2006 Open Grid Forum 23 Research Group aims To see what activities are done worldwide To profit from other research To promote own solutions To find out the gaps in current soultions To formulate the needs for standards in the area where it is needed To establish new Working Groups to standardize the relevant capabilities

© 2006 Open Grid Forum 24 Facts Chairs – Duane Edgington, Marcin Plociennik Secretary – Michael Sutter Mailing list: Over 90 members GridForge project webspace 26 members Short abstract/links/contacts for each project/research should be provided on wiki Best practises presentations Address: Activity started during OGF 20

© 2006 Open Grid Forum 25 Involved communities – overview Representatives of: Remote Instrumentation related user communities (like DORII, AUGERACCESS,NORIA) Remote Instrumentation focused projects (like GRIDCC, RINGrid,VLab, Observatory Middleware Framework, CIMA, Observatory Middleware Framework ) Grid middleware projects (like g-eclipse) Grid infrastructure projects (like int.eu.grid, BalticGrid, EGEE) Geographically: Europe, North America, Australia

© 2006 Open Grid Forum 26 Involed projects GRIDCC ( RINGrid ( int.eu.grid ( g-Eclipse( AUGERACCESS( VLab( ( Integrated e-Infrastructure for Facilities ( science.stfc.ac.uk/facilities/), science.stfc.ac.uk/facilities/ SENSORS ( OOI-CI ( ), OMF( rk_(OMF) rk_(OMF DORII ( BalticGrid-II ( ARGUGRID, SpectroGrid, CIMA

© 2006 Open Grid Forum 27 RISGE-RG main activities We have released the document describing use cases We have defined and start to work on 8 field of possible standardisation activities: Accessing instruments in a standard way/unique interface Data handling – getting data out of the instruments Near real time/fast data retrieval and transfer of data / streams Service Discovery Information Way of monitoring Instruments Accounting for instruments (and billing?) Scheduling of the instruments Calibration (travelling standards) Basing on the result of current research of the group towards existing standards and possible extensions or implementation of new standards the group will take into account possibility of establishing new WG to standardize the relevant capabilities.

© 2006 Open Grid Forum 28 Accessing instruments in a standard way/unique interface – analisys results The evaluation result show the necessity of establishing new standard to cover all requirements Tomorrow - BoF - Access to Remote Instrumentation in Grid environment focus its efforts on defining concrete services for accessing remote instruments. to standardize approaches in defining remote access interfaces to instruments including sophisticated laboratory equipment (different scale instruments), but also distributed sensor networks,. to simplify implementations (so to have one standard covering different aspect ) Still to be defined but as such, it concerns mostly the services for steering and monitoring instrument resources, granting security and authorization (policy) (based on grid security/sharing instruments), accessing combined or multiple devices, performing a calibration phase(so management part), and also services for acquiring data from instruments and operating on files and streams

© 2006 Open Grid Forum 29 Open points and questions During the evaluation of the field of possible standardisation activities we found out many commonalities and field covered already by OGC like: Service discovery Scheduling of instrument accessing sensors (OGC – SensorML, SWE/SOS ) During next evaluations that is in progress could we count on OGC expertise?

© 2006 Open Grid Forum 30 Full Copyright Notice Copyright (C) Open Grid Forum (applicable years). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees.