SDO Feature Finding Team Alisdair Davey SDO Feature Finding Team Alisdair Davey

Slides:



Advertisements
Similar presentations
Summary of 2008 Science Team Meeting. Collaboration With Dr. Wiegelmann 1. NLFFF extrapolation, leading person: Ju Jing. Objective: adapt codes to BBSO.
Advertisements

Space …. are big. Really big. You just won't believe how vastly, hugely, mindbogglingly big they are. Massive data streams Douglas Adams – Hitchhiker’s.
HMI Data Analysis Software Plan for Phase-D. JSOC - HMI Pipeline HMI Data Analysis Pipeline Doppler Velocity Heliographic Doppler velocity maps Tracked.
Estimating the magnetic energy in solar magnetic configurations Stéphane Régnier Reconnection seminar on Thursday 15 December 2005.
High Altitude Observatory (HAO) – National Center for Atmospheric Research (NCAR) The National Center for Atmospheric Research is operated by the University.
A Multi-Wavelength View of an Active Region Structure around a Filament Channel L. Lundquist, 1 K. Reeves, 1 A. van Ballegooijen, 1 T. Sakao, 2 and the.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 27 September 2006 HELAS Workshop Nice.
000509EISPDR_SciInvGIs.1 EIS Science Goals: The First Three Months…. Louise Harra Mullard Space Science Laboratory University College London.
The Relation between Filament Skew Angle and Magnetic Helicity of Active Regions Masaoki HAGINO, Y.J. MOON (Korea Astronomy and Space Science Institute)
Computer Vision for Solar PhysicsSDO Science Workshop, May 2011 Computer Vision for Solar Physics Piet Martens Montana State University Center for Astrophysics.
Computer Vision for Solar PhysicsSDO Science Workshop, May 2011 A Computer Science Approach to Solar Image Recognition Piet Martens (Physics) & Rafal Angryk.
E. Robbrecht – SIDC- Royal Observatory of Belgium 8 March 2007 The statistical importance of narrow CMEs Open questions to be addressed by SECCHI Eva Robbrecht,
Coronal Boundaries of Active Regions Derived From Soft X-ray Images.
Vincent Surges Advisors: Yingna Su Aad van Ballegooijen Observations and Magnetic Field Modeling of a flare/CME event on 2010 April 8.
Page 1JSOC Peer Review – AIA Science Center – March 17, 2005 AIA Science Data Processing Infrastructure Neal Hurlburt AIA Data Scientist
The Hunt for a Link : Quantitative Connections Between Magnetic Fields and EIT Coronal Wave/CME Properties Prepared by James R. Robertson J.R. In conjunction.
Understanding Magnetic Eruptions on the Sun and their Interplanetary Consequences A Solar and Heliospheric Research grant funded by the DoD MURI program.
The May 1,1998 and May 12, 1997 MURI events George H. Fisher UC Berkeley.
SDO/AIA science plan: prioritization and implementation: Five Objectives in 10 steps [session no.] HMI/AIA science teams meeting; Monterey; Feb
Nonlinear Force-Free Field Modeling AIA/HMI Science Team Meeting Session C2 14 February 2006 Marc DeRosa on behalf of the “NLFFF Consortium” (Karel Schrijver,
[session no.]1 IV: Science investigation Key Observables Flux emergence and transport (both HMI and AIA) Magnetic connections among different areas (coronal.
25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.
HMI Magnetic Products & Pipeline
Advanced Technology Center 1 HMI Rasmus Larsen / Processing Modules Stanford University HMI Team Meeting – May 2003 Processing Module Development Rasmus.
Solar Image Processing at SIDC - Royal Observatory of Belgium J.-F. Hochedez, V. Delouille, S. Gissot, E. Robbrecht, B. Nicula, O. Podladchikova, J. de.
Session C8 Coronal Data Products AIA/HMI Science Team Meeting 16 February 2006 Marc DeRosa.
The May 1997 and May 1998 MURI events George H. Fisher UC Berkeley.
Computer Vision for Solar PhysicsSAO Statistics Workshop February 2012 Content-based Image Retrieval for Solar Physics Piet Martens Montana State University.
Instrumental & Technical Requirements. Science objectives for helioseismology Understanding the interaction of the p-mode oscillations and the solar magnetic.
Science Data Products – HMI Magnetic Field Images Pipeline 45-second Magnetic line-of-sight velocity on full disk Continuum intensity on full disk Vlos.
ESDO Algorithms, Visualization and Data Access Elizabeth Auden 21 September 2006 AHM 2006 Nottingham.
Data Processing and Display Challenges for Solar Dynamics Observatory Using the Heliophysics Event Knowledgebase Ralph Seguin Ankur Somani Lockheed Martin.
Detecting EUV waves Detecting Dimmings www. SolarDemon.oma.be near real-time, Flare, Dimming, and EUV wave Monitoring E. Kraaikamp 1, C. Verbeeck 1, and.
F. I. Suárez-Sol á 1, E. González-Suárez 1, I. González-Hernández 1, A.R. Davey 2,J. Hourcl é 3, VSO Team 1 National Solar Observatory, Tucson AZ – 2 Harvard-Smithsonian.
Fraser Watson, University of Glasgow Lyndsay Fletcher, University of Glasgow Stephen Marshall, University of Strathclyde SIPwork V, Wed September 15th.
Using Solar Dynamics Observatory Data in the Classroom to Do Real Science.
Flares in and their associations with CMEs N.V. Nitta, J.P.Wuelser, M. J. Aschwanden, J. R. Lemen (LMSAL), D. M. Zarro (Adnet, Inc.)
18-April-2006XRT Team1 Initial Science Observations Solar-B XRT Ed DeLuca for the XRT Team.
Newark, Wiegelmann et al.: Coronal magnetic fields1 Solar coronal magnetic fields: Source of Space weather Thomas Wiegelmann, Julia Thalmann,
GONG data and pipelines: Present & future. Present data products 800x800 full-disk images, one per minute, continuous (0.87 average duty cycle) Observables:
1 3D Sun Loop Trace: A Tool for Stereoscopy of Coronal Loops for STEREO Jean Lorre Jeff Hall Paulett Liewer Parth Sheth Eric DeJong Jet Propulsion Laboratory.
Nonlinear force-free coronal magnetic field extrapolation scheme for solar active regions Han He, Huaning Wang, Yihua Yan National Astronomical Observatories,
What’s Inside The Small Box? The Virtual Solar Observatory.
SUB-GROUP 1: Surface Solar Magnetic Fields  The central question: Can we infer the orientation of Bz of an ICME at 1 AU by focusing on the study of the.
1 Machine Learning and Data Mining for Automatic Detection and Interpretation of Solar Events Jie Zhang (Presenting, Co-I, SCS*) Art Poland (PI, SCS*)
VSO Status Update HDMC Meeting 9 June Vision To allow solar physicists to identify and search for data even if they don't know it exists. Make.
SDO-meeting Napa, Wiegelmann et al: Nonlinear force-free fields 1 Nonlinear force-free field modeling for SDO T. Wiegelmann, J.K. Thalmann,
Solar Image Processing at SIDC - Royal Observatory of Belgium J.-F. Hochedez, V. Delouille, S. Gissot, E. Robbrecht, B. Nicula, O. Podladchikova, J. de.
Algorithm Preparation and Data Availability 1. Mullard Space Science Laboratory, University College London. 2. Physics and Astronomy Department, University.
Event and Feature Catalogs in the Virtual Solar Observatory Joseph A. Hourclé and the VSO Team SP54A-07 : 2008 May 30.
1 Stereographic Analysis of Coronal Features for the STEREO Mission Eric De Jong, Paulett Liewer, Jeff Hall, Jean Lorre, Shigeru Suzuki and the SECCHI.
Ganghua Lin Huairou Solar Observating Station,NAO,CAS.
ADNET Systems, Inc. Jack Ireland & Helioviewer Team ADNET Systems, Inc. Helioviewer Discovery for Everyone Everywhere.
SOLAR DEMON DETECTING FLARES, DIMMINGS, AND EUV WAVES IN NEAR REAL-TIME ON SDO/AIA IMAGES Emil Kraaikamp (p), Cis Verbeeck – Royal Observatory of Belgium.
On Using SIFT Descriptors for Image Parameter Evaluation Authors: Patrick M. McInerney 1, Juan M. Banda 1, and Rafal A. Angryk 2 1 Montana State University,
SEC Directed Research Retreat 12–13 February 2004 Science we do now GUIDELINES AND BALANCE Directed Research Retreat Feb
The Virtual Solar Observatory – An Operational Resource for Heliophysics Informatics Frank Hill & The VSO Team.
RMsis – v now with JIRA 5.0 support Simplify Requirement Management for JIRA.
ESDO: UK Access to the Solar Dynamics Observatory 1. Mullard Space Science Laboratory, University College London. Holmbury St. Mary, Dorking, Surrey SM2.
The CME geomagnetic forecast tool (CGFT) M. Dumbović 1, A. Devos 2, L. Rodriguez 2, B. Vršnak 1, E. Kraaikamp 2, B. Bourgoignie 2, J. Čalogović 1 1 Hvar.
HELIO: Discovery and Analysis of Data in Heliophysics Robert Bentley, John Brooke, André Csillaghy, Donal Fellows, Anja Le Blanc, Mauro Messerotti, David.
Helioseismology for HMI Science objectives and tasks* Data analysis plan* Helioseismology working groups and meetings *HMI Concept Study Report, Appendix.
BBSO 2007 Science Planning. Focal Plane Instruments AO (Wenda, Nicolas, Deqing, Patricia and Park) AO (Wenda, Nicolas, Deqing, Patricia and Park) IRIM.
SDO-meeting Napa, Wiegelmann et al: Nonlinear force-free fields 1 A brief summary about nonlinear force-free coronal magnetic field modelling.
JSOC Status at SDO PSR-1 January 21-22, 2009 GSFC
E.C. Auden1, J.L. Culhane1, Y. P. Elsworth2, A. Fludra3, M. Thompson4
Diagnosing kappa distribution in the solar corona with the polarized microwave gyroresonance radiation Alexey A. Kuznetsov1, Gregory D. Fleishman2 1Institute.
HMI Data Analysis Pipeline
HMI Data Analysis Pipeline
N. Nitta1, J.-P. Wuelser1, J. Lemen1, M. Aschwanden1, G. Attrill2
Presentation transcript:

SDO Feature Finding Team Alisdair Davey SDO Feature Finding Team Alisdair Davey

Feature and Event Driven Approach to Data Discovery Scientists will often browse through data looking for events, analyze numbers of these events and sometimes turn them into science catalogs. How about starting with features or events, filtered for your scientific objective and then extracting data cubes for analysis. Heliophysics Event Knowledgebase (HEK)  “The HEK is designed to catalogue interesting solar events and features and to present them to members of the solar physics community in such a way that guides them to the most relevant data for their purposes.”

Team Composition Harvard-Smithsonian: Kasper (PM), Davey* (pipeline, interfaces, hardware), Korreck (documentation, outreach), Wills* (Dimmings, EIT Waves), Attrill (dimmings), Grigis, Testa (flares), Saar, Farid (XRBP’s), Engell* (PILs) MSU: Martens (PI), Angryk, Banda, Atreides (all trainable module) Lockheed-Martin: Timmons (pipeline, interfaces, HEK), Hurlburt Johns Hopkins-APL: Bernasconi (filaments), Raouafi (sigmoids) NASA-Marshall: Cirtain* (pipeline, interfaces, metadata) Boston University: Savcheva (jets) SwRI: DeForest, Lamb* (magnetic feature tracking, sunspots, CMEs) Royal Observatory of Belgium: Hochedez, Delouille, Mampaey, Verbeek (Spoca, ARs and CHs) New Mexico State, Trinity College Dublin: McAteer (oscillations) Academy of Athens: Georgoulis (sigmoids, filaments) Max Planck Lindau: Wiegelmann (full disk NLFFF extrapolations)

FFT Presentations at this Meeting Talk Paolo Grigis: SDO Flare Detective Derek Lamb: Making Sense of the Soup: SWAMIS Magnetic Feature Tracking for SDO Posters Cis Verbeeck: Multi-wavelength analysis of active regions and sunspots by comparison of automatic detection algorithms Alec Engell: Automated polarity inversion line detector and associated properties: Flare/CME likelihood Alisdair Davey: An update on the SDO Feature Finding Team efforts

Modules Flares Coronal Dimmings Magnetic Feature Tracking (from sunspots to micro-pores) Sunspots Active Regions Coronal Holes Filaments (H-alpha data) Sigmoids CMEs (LASCO data) Jets X-ray Bright Points EIT waves Coronal Oscillations Mapping Polarity Inversion Lines Full Disk Non-Linear Force-Free Field Extrapolations Trainable Feature Recognition Module

Module Status Currently running in Event Detection System (EDS) at LMSAL Flares Magnetic Feature Tracking Active Regions Currently running at SAO outside of EDS. Filaments Sigmoids (but not uploading events - needs more work to be pipeline ready) Has run in the EDS but is not currently Coronal Dimmings

Module Status Done but not EDS ready and what should the “Event” be? Mapping Polarity Inversion Lines X-ray Bright Points Still in science development Coronal Holes CMEs Jets EIT Waves Coronal Oscillations Being held up by vector magnetogram issues Full Disk Non-Linear Force-Free Field Extrapolations

Module Status Still in science development, and resulted in a Ph.D thesis Trainable Feature Recognition Module See poster 114 for more details on individual module status

Verification Reproducibility Even if it’s wrong it’s reproducibly wrong! By hand / eye By publication of results - peer review Previous instrument data sets Using HEK / iSolSearch Using to AIA/HMI - throws up interesting problems Modules are not frozen Expect modules to be updated with improvements to code. Code is versioned If results updated, old events not thrown away Codes available to the community

Challenges What’s in an Event? Polarity inversion lines for the full sun and in an active regions

Even really good science code is not ready to run in a pipeline! Failure is not an option! Must recover from all errors. When data flow stops … Image rejection - some done by EDS, but models need to be able to deal with bad images, or in fact good images with exposure changes due to AEC. How about eclipse images? EIT -> AIA or even TRACE -> AIA is a massive change! AIA data is really good!(46 dimming regions). Defining events - how do you make them fit your model but allow others to apply their own different filtering criteria? What’s in an event? Different modes of operation. Trigger mode events useful for space weather. Standard mode and full science mode (Outside of generating HEK events) Challenges to putting modules in EDS

HEK welcomes anyone who wants to create a module to run in the EDS at LMSAL Could also run code at SAO if not suitable for EDS or not time critical or want to look at older time periods. Talk to Alisdair Davey (SAO) and Ryan Timmons (LMSAL) - it will save you a lot of time and anguish. If you want to contribute a module for a feature or event already running in the pipeline, look at the code for that event already running in the EDS. Lot of code you will need to have that is independent of event detection. EDS is a java pipeline - uses JAVA2IDL bridge to run IDL modules. IDL tools in Solarsoft for event creation already there. Most modules written in IDL but not all. SWAMIS written in PDL. Called from IDL wrapper. Read: Event Detection System Interface and API by Ryan Timmons. Describes the API to the EDS and what you need to do in order to create a module suitable for running in the EDS.