Heliophysics Integrated Observatory (HELIO) HELIO The Heliophysics Integrated Observatory Bob Bentley (UCL-MSSL) Andre Csillaghy (FHNW) Jean Abourdarham.

Slides:



Advertisements
Similar presentations
ESWW4, 5-9 th November 2007 Draft Proposal: Space Weather as part of an Optional Space Situational Awareness Programme A.Glover, E. Daly, R. Marsden, A.
Advertisements

Geoscience Information Network Stephen M Richard Arizona Geological Survey National Geothermal Data System.
Standards and Interoperability Forum: Status, Issues & Plans GEO Architecture and Data Committee Kyoto, Japan 9 February 2009 Siri-Jodha Singh Khalsa.
Improving Learning Object Description Mechanisms to Support an Integrated Framework for Ubiquitous Learning Scenarios María Felisa Verdejo Carlos Celorrio.
Configuration management
Heliophysics Integrated Observatory (HELIO) Heliophysics Integrated Observatory HELIO Robert Bentley, UCL-MSSL (UK) Andre Csillaghy, FHNW (CH) Jean Aboudarham,
Heliophysics Integrated Observatory (HELIO) Issues related to designing a VO for Heliophysics Bob Bentley (UCL-MSSL) 13 June 2007 VOiG Conference, Denver.
Heliophysics Integrated Observatory (HELIO) Building a VxO for Heliophysics Bob Bentley (UCL-MSSL) 21 June 2007 IHY General Assembly, Torino, Italy.
Building open regional innovation strategies: New opportunities provided by Smart Specialisation Strategies Claire Nauwelaers Independent STI policy expert.
Curriculum Mapping as a Way To Establish a European Internal Market for Learning and Teaching David Massart, EUN The Hague, NL May 19, 2011.
 DB&A, Knowledge Management Within and Across Projects June 15, 2012 INNOVATION for a better world.
1 A Virtual Observatory for Space Weather? R.D. Bentley (UCL/MSSL) Chris Harvey (CDPP) Second European Space Weather Workshop ESTEC, 18 November 2005.
SCIDIP-ES Components Oct ,Brussels. Basic Preservation Strategies Often stated as: “Emulate or Migrate” OAIS concepts change these to: Add Representation.
Research and Innovation Research and Innovation Introduction 2013 Sprint to Summit (StoS) Barcelona, 16 April 2013 Alan EDWARDS Earth Observation Sector.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Thee-Framework for Education & Research The e-Framework for Education & Research an Overview TEN Competence, Jan 2007 Bill Olivier,
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
SpaceGRID and EGSO Satu Keski-Jaskari Maria Vappula Parallal Computing – Seminar
The Emerging Heliophysics Informatics Infrastructure J. Ireland ADNET Systems, Inc. / NASA-GSFC.
Eye on Earth (EoE), Citizen Science and the Invasive Alien Species project Malene Bruun NRC’s for EIS June 17, 2011.
PV2013 Summary Results Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
By N.Gopinath AP/CSE. Why a Data Warehouse Application – Business Perspectives  There are several reasons why organizations consider Data Warehousing.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geociences.
V. Chandrasekar (CSU), Mike Daniels (NCAR), Sara Graves (UAH), Branko Kerkez (Michigan), Frank Vernon (USCD) Integrating Real-time Data into the EarthCube.
Time Table exchange QSAS / CL / CAA / AMDA CESR, 25/26 feb
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Interoperability ERRA System.
Coordination Action for the integration of Solar System Infrastructures and Science (CASSIS) CASSIS Moving forwards on standards and interoperability R.D.
Institute for Collaborative Research in Education, Assessment, and Teaching Environments for STEM NGSS Resources by CREATE for STEM Institute MSU licensed.
SCI-BUS is supported by the FP7 Capacities Programme under contract RI ER-FLOW is supported by the FP7 Infrastructures under contract RI
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
Chapter 1: Computing with Services Service-Oriented Computing: Semantics, Processes, Agents – Munindar P. Singh and Michael N. Huhns, Wiley, 2005.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
TEMPLATE DESIGN © An increasing world population, industrial development, globalization and changing weather and climate.
Towards a European network for digital preservation Ideas for a proposal Mariella Guercio, University of Urbino.
Meta Tagging / Metadata Lindsay Berard Assisted by: Li Li.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
The Brain Project – Building Research Background Part of JISC Virtual Research Environments (Phase 3) Programme Based at Coventry University with Leeds.
European Grid of Solar Observations EGSO European Grid of Solar Observations Simon Martin Rutherford Appleton Laboratory CDS Users Meeting, NAM 2003.
Chapter 10 Analysis and Design Discipline. 2 Purpose The purpose is to translate the requirements into a specification that describes how to implement.
Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.
W HAT IS I NTEROPERABILITY ? ( AND HOW DO WE MEASURE IT ?) INSPIRE Conference 2011 Edinburgh, UK.
Draft GEO Framework, Chapter 6 “Architecture” Architecture Subgroup / Group on Earth Observations Presented by Ivan DeLoatch (US) Subgroup Co-Chair Earth.
Solar and STP science with AstroGrid Silvia Dalla School of Physics & Astronomy, University of Manchester A PPARC funded project.
Introduction to Earth Science Section 2 Section 2: Science as a Process Preview Key Ideas Behavior of Natural Systems Scientific Methods Scientific Measurements.
How People Learn – Brain, Mind, Experience, and School (Bransford, Brown, & Cocking, 1999) Three core principles 1: If their (students) initial understanding.
CHORUS What is « Search » A functional view Henri Gouraud WP2.
Session Objectives Analyze the key components and process of PBL Evaluate the potential benefits and limitations of using PBL Prepare a draft plan for.
SolarFlows Dr. Gabriele Pierantoni (TCD). Contents What is Heliophysics ? How could workflows help ? Some examples What we are doing...
GEO Standards and Interoperability Forum SIF First Organizational Meeting 27 July 2007 Barcelona, Spain.
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
Report of the Architecture and Data Committee (ADC) R.Shibasaki (ADC, Japan)
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
This work is supported by a National Science Foundation (NSF) collaboration between the Directorates for Education and Human Resources (EHR) and Geociences.
A Perspective on the Electronic Geophysical Year Raymond J. Walker UCLA Presented at eGY General Meeting Boulder, Colorado March 13, 2007.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
Porting workflows for the Heliophysics Community Dr. Gabriele Pierantoni Trinity College Dublin.
ISWG / SIF / GEOSS OOS - August, 2008 GEOSS Interoperability Steven F. Browdy (ISWG, SIF, SCC)
SCI-BUS is supported by the FP7 Capacities Programme under contract RI ER-FLOW is supported by the FP7 Infrastructures under contract RI
HELIO: Discovery and Analysis of Data in Heliophysics Robert Bentley, John Brooke, André Csillaghy, Donal Fellows, Anja Le Blanc, Mauro Messerotti, David.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Heliophysics Integrated Observatory (HELIO) The Heliophysics Integrated Observatory HELIO Robert Bentley, UCL-MSSL (UK) HELIO Project Coordinator
 Continue to develop a common understanding of what STEM education is/could/should be here at Killip.
Virtual Repository Progress Lars Lindberg Christensen (ESA/ESO)
The Heliophysics Integrated Observatory HELIO
Future SWE Missions Workshop ESA SSA/SWE State-of-Play
Archiving of solar data Luis Sanchez Solar and Heliospheric Archive Scientist Research and Scientific Support Department.
Summit 2017 Breakout Group 2: Data Management (DM)
improve the efficiency, collaborative potential, and
Christian Ansorge Arona, 09/04/2014
Presentation transcript:

Heliophysics Integrated Observatory (HELIO) HELIO The Heliophysics Integrated Observatory Bob Bentley (UCL-MSSL) Andre Csillaghy (FHNW) Jean Abourdarham (Obs. Paris) 20 November 2008 European Space Weather Week, Brussels

Heliophysics Integrated Observatory (HELIO) 2 Heliophysics Heliophysics explores the Sun-Solar System Connection Space weather is a subset of Heliophysics – SWx++ A virtual observatory that supports Heliophysics must facilitate access to data from a number of communities Solar, heliospheric, magnetospheric and ionospheric physics, aeronomy… Throughout the solar system – not just Sun-Earth Globally – beyond national or European level Heliophysics sits in the boundary between communities Astrophysics and Planetary sciences (including Earth sciences) A VO for heliophysics must be aware of the need to support the interests of these communities Heliophysics Integrated Observatory (HELIO) Proposal submitted under EC’s FP7

Heliophysics Integrated Observatory (HELIO) 3 Driven by science Desire to solve science problems that span disciplinary boundaries is driving the need to provide integrated access to data across the communities The communities have evolved independently over decades Each has very different ways of describing, storing and exploiting the data from their observations, varying use of standards To facilitate access, we need to find ways to: Tie the data together through searches across all the domains Present any results in a form that does not require a detailed understanding of each discipline U.Alaska

Heliophysics Integrated Observatory (HELIO) 4 HELIO Concept HELIO concept implemented with a service oriented architecture Service to curate and access search metadata Search engine implemented as a service Services to access data repositories Services to extract and process required observations Workflow tool used to bind the services together User interface closely liked with this tool Domain interoperability facilitated by semantic-driven approach Single data model for all domains not practical Service oriented architecture allows a researcher to use components of HELIO as they wish – as a chain or as individual services Chaining of services will provide maximum support for new users and allows a diverse community to study complex science problems in heliophysics Users may only require access to metadata and employ their own search tools or may just wish to use the dataset location capabilities Format of data products can be tailored to meet community needs

Heliophysics Integrated Observatory (HELIO) 5 Issues related to Metadata Metadata are the key to accessing observations Rapidly increasing volumes make good metadata essential There are many issues related to existing metadata Poor quality or missing, lack of interoperability… This affects ability of all users to do science – not just HELIO To resolve the issues requires the re-evaluation of capabilities provided within each community and some corrective action HELIO plans to work closely with the community on this Metadata can be grouped in several ways, one is: Search metadata o Metadata used to identify interesting time intervals and locations Observational metadata o Metadata used to describes the observations, e.g. FITS headers Storage metadata o Metadata that describes how the data are stored and accessed Administrative metadata o Metadata that allows the system to exploit the available resources

Heliophysics Integrated Observatory (HELIO) 6 Data Storage Access to data should be a matter of mechanics and generic Cheap storage and the Internet have greatly enhanced access Well established protocols for access – http, ftp, … How data are stored within a data source can make a lot of difference to their accessibility A variety of file formats should be accommodated EGSO has the concept of resource-rich and resource-poor providers Resource-rich – should provide what is needed in response to simple query Resource-poor – may only be able to make data accessible over Internet Guidelines/standards on ways that data should be organized could improve capabilities of all providers Providing data following simple naming conventions in an ordered directory structure would make them simpler to access Simple catalogue (textual?) might provide additional information Discussed at VOiG in 2007; IAU WG discussion

Heliophysics Integrated Observatory (HELIO) 7 Observational metadata Provides information about how the observation was made Important for exploiting the data; key for HELIO Often quality issues related to the metadata that is provided Parameters sometimes missing, or wrong Inconsistent use of information, “synonyms” for keywords In solar data, space-based observations much better described than their ground-based counterparts o Ground-based observations are only source in some wavelengths and need access to as many observatories as possible Researchers often used to deficiencies in their own domain Difficult for machines to handle if it is not quantified properly Consequence can be that the data are “unusable” Need to encourage all organizations that generate data to adopt and comply with agreed standards Where possible the standards should have generic parts to facilitate interoperability

Heliophysics Integrated Observatory (HELIO) 8 Searches In heliophysics, we are interested in how an event on the solar surface can propagate through the heliosphere and affect planetary environments May also want to work backwards and look for the cause of an effect – what solar event caused this ionospheric activity… Searches should identify interesting time intervals based on a combination of event, features, etc. metadata Light curves and images my also be used to augment the search Location of observer affects whether phenomena seen Each community of some combination of these metadata Differences in how some quantities are expressed, what are included There are concerns about the quality and integrity of these metadata and whether they are adequate to support the searches HELIO would like to undertake

Heliophysics Integrated Observatory (HELIO) 9 Solar search metadata Searches in solar physics are mainly event driven Phenomena occur on or near the solar surface Event data gives time and location of phenomena Feature data provides details of location and size of structures that may be relevant Time information can be expressed in many ways Essentially these are the same, with simple transformations Spatial information can be expressed in terms of: Coordinates in the observing frame – e.g. arcsecs from disc centre Coordinates on the rotating body of the Sun – Carrington coordinates The location of the observer largely ignored o Helio-seismology is an exception In the bigger picture of Heliophysics, also need to include the viewing perspective (c.f. STEREO)

Heliophysics Integrated Observatory (HELIO) 10 Other search data Observation of phenomena in the heliosphere and near/on planets are more complex For in-situ observations in the heliosphere Time is when a phenomena affected (passed) the observer Position of the observer relative to the Sun is key to understanding When the in-situ observations are made on/near a planet Position of the observer relative to the planet is also important Relating events that are defined from in-situ data to those on/near the Sun requires an understanding of how events propagate Details of the velocity structure of CMEs and the solar wind are not easy to determine… HELIO plans to develop a tool that will use even/feature data to refine a model to trace effects forwards from causes, etc.

Heliophysics Integrated Observatory (HELIO) 11 Simple, but not so simple In principle this all seems fairly obvious, but lets look in detail at some common solar event data On 20 January 2005 there was an X7.1 flare that was intensely geo- effective. The flare was associated with particle event and a CME; it was also observed by ground-level neutron monitors – a GLE. Many superlatives were used to describe the event o "The solar energetic particle event of January has been called, by some measures, the most intense in 15 years..." (Mewaldt et al., 2005) o ”The fastest rising SEP event of current cycle [cycle 23]" (Rawat et al., 2006) o ”The most spectacular [solar event] of the Space Age" (Tylka et al., 2006) o ”The largest GLE [GLE 69] in half a century" (Bartol Research Institute) But event is absent from the NOAA SEC list of "Solar Proton Events Affecting the Earth Environment" When you look at the data and how lists are created, you realize that the lists are deficient in several ways Humans and SmFCACs can understand what happened, but It is harder for machines...

Heliophysics Integrated Observatory (HELIO) 12 X7.1 of 20 Jan 2005 The event was one of several from AR Two other X class flares and several M class flares occurred in previous 3 days; others before this

Heliophysics Integrated Observatory (HELIO) 13 X7.1 of 20 Jan 2005

Heliophysics Integrated Observatory (HELIO) 14 X7.1 of 20 Jan 2005 At the time of the event, the proton levels had not returned to normal after previous events The criteria fails to recognize a new event o NOAA lists event on 16 Jan The X-ray data also suffers from problems The end of an event is defined by when the counts drop to 50% o New events can “interrupt” existing events The shape and true duration of the decay phase are lost o NOAA gives start 0636; end 0726 Not all locations are tagged!! Significant brightenings seen on images not declared as flares

Heliophysics Integrated Observatory (HELIO) 15 Some of the problems Automated searches are difficult when major events can be “missed” A search for long duration events would yield spurious results If the locations of all flares are not known (in a timely fashion), it is impossible to know whether they will be geo-effective Instrument flare lists have gaps – nights, off times, etc. – but the reason for a null result is not included

Heliophysics Integrated Observatory (HELIO) 16 Some of the problems Automated searches are difficult when major events can be “missed” A search for long duration events would yield spurious results If the locations of all flares are not known (in a timely fashion), it is impossible to know whether they will be geo-effective Instrument flare lists have gaps – nights, off times, etc. – but the reason for a null result is not included

Heliophysics Integrated Observatory (HELIO) 17 Improving Metadata Existing event lists can give a distorted picture what has occurred Such deficiencies make it difficult for non-experts to use them The community “knowledge” is not written down Need to re-evaluate/regenerate the event data in all domains with the idea that they will be used in a joint search across the domains Ensure events are described more accurately Include information that might explain null results Metadata should comply with agreed standards that have generic components to ensure interoperability The situation has changed with enhancements to technology o Providers need to ensure they are more compliant Virtual observatories should try to handle problems with old metadata o Limits to what can be achieved if metadata is poorly formed Standards need to be developed in collaboration with the community and funding agencies

Heliophysics Integrated Observatory (HELIO) 18 Conclusions We have the technology, but developing a virtual observatory to support heliophysics will not be simple Cooperation of the community is essential if we are to succeed Some of the possible problems have been highlighted The quality of observational metadata needs to be improved We must improve the quality and content of the search metadata These problems affect the Space Weather community in a similar way to the Heliophysics community To address these issues we need to engage the communities in all the domains that constitute heliophysics and develop standards that will facilitate the process HELIO has a large Networking component that is targeted at addressing these issues and fully involving the community

Heliophysics Integrated Observatory (HELIO) 19