Global Helioseismology Pipeline Status 11/5/2007.

Slides:



Advertisements
Similar presentations
Hardware Lesson 3 Inside your computer.
Advertisements

HMI Data Analysis Software Plan for Phase-D. JSOC - HMI Pipeline HMI Data Analysis Pipeline Doppler Velocity Heliographic Doppler velocity maps Tracked.
A New Technique for Bridging the Gap Between Global and Local Helioseismology Edward Rhodes, Sarbani Basu, Rick Bogart, Sasha Kosovichev, Johann Reiter,
Basic Computer Hardware and Software.
11/10/05 H6: Global Helioseismology Techniques & Data Products Questions for Technique Sessions Chair(s): Hill, Schou, Larsen Status: [draft]
200Mm Time-Distance Pipeline Status 11/5/ Mm Time-Distance Lead – Tom Duvall Lead – Tom Duvall Task – From Dopplergrams generate deep-focus synoptic.
Page 1LWS Teams Day JSOC Overview HMI Data Products: Plan and Status.
Implementing interrupt driven IO. Why use interrupt driven IO? Positive points –Allows asynchronous operation of IO events –Good use of resources –Leads.
Time-Distance Pipeline for the Upper 30Mm Convection Zone Status 11/5/2007.
HMI Science Analysis. Primary Goal: Origins of Solar Variability The primary goal of the Helioseismic and Magnetic Imager (HMI) investigation is to study.
HMI Science Analysis Plan Magnetic ShearTachocline Differential Rotation Meridional Circulation Near-Surface Shear LayerActivity ComplexesActive Regions.
25 September 2007eSDO and the VO, ADASS 2007Elizabeth Auden Accessing eSDO Solar Image Processing and Visualisation through AstroGrid Elizabeth Auden ADASS.
Advanced Technology Center 1 HMI Rasmus Larsen / Processing Modules Stanford University HMI Team Meeting – May 2003 Processing Module Development Rasmus.
HMI Science Objectives Convection-zone dynamics and the solar dynamo  Structure and dynamics of the tachocline  Variations in differential rotation 
11/10/05 H6: Global Helioseismology Techniques & Data Products Questions for Technique Sessions Chair(s): Hill, Schou, Larsen Status: [draft]
Current Status and Future Prospects of High-Degree Ridge Fitting Johann Reiter, Edward Rhodes, and Jesper Schou HMI Science Team Meeting Monterey, CA February.
11/10/05 H6: Global Helioseismology Techniques & Data Products Questions for Technique Sessions Chair(s): Hill, Schou, Larsen Status: [draft]
Science Data Products – HMI Magnetic Field Images Pipeline 45-second Magnetic line-of-sight velocity on full disk Continuum intensity on full disk Vlos.
Hardware.  Learn what hardware is  Learn different input and output devices  Learn what the CPU is.
1 Status of Ring-diagram Analysis of MOTH Data Kiran Jain Collaborators: F. Hill, C. Toner.
F. I. Suárez-Sol á 1, E. González-Suárez 1, I. González-Hernández 1, A.R. Davey 2,J. Hourcl é 3, VSO Team 1 National Solar Observatory, Tucson AZ – 2 Harvard-Smithsonian.
Caveman arts By Trevor. Welcome to a world of hard drives and video cards. I am going to teach you how to buy the right parts to make your dream computer.
HARDWARE Lesson 2. Components of a computer: 1)A Processor (or CPU) The brain of the computer 2)Memory To remember the programs and data that it uses.
MAKING BIG FILES SMALL AND SMALL FILES TINY LT Bruce Hill 1.
Inside the Computer Ms. Rocío Acevedo September 2006.
Translate the following message:
MAC OS – Unit A Page: 10-11, Investigating Data Processing Understanding Memory.
Sky Coordinate Image Specs Fully processed: –Merged –10-min cadence –“sky to sky” interpolation –Gaussian temporal filter –Renormalized such that time.
P MODE TRAVEL TIME IN ACTIVE REGIONS USING TIME-DISTANCE METHOD CRAAG, Observatory of Algiers, BP 63 Bouzareah 16340, Algiers, Algeria. (1)
GONG data and pipelines: Present & future. Present data products 800x800 full-disk images, one per minute, continuous (0.87 average duty cycle) Observables:
Inside your computer. Hardware Review Motherboard Processor / CPU Bus Bios chip Memory Hard drive Video Card Sound Card Monitor/printer Ports.
Inside your computer. Hardware Motherboard Processor / CPU Bus Bios chip Memory Hard drive Video Card Sound Card Monitor/printer Ports.
Hardware. Make sure you have paper and pen to hand as you will need to take notes and write down answers and thoughts that you can refer to later on.
1 Chapter 2.1 : Processes Process concept Process concept Process scheduling Process scheduling Interprocess communication Interprocess communication Threads.
Page 1LWS Teams Day JSOC Overview HMI-AIA Joint Science Operations Center Science Data Processing a.k.a. JSOC-SDP Overview.
1 Chapter 4 Processes R. C. Chang. 2 Linux Processes n Each process is represented by a task_struct data structure (task and process are terms that Linux.
Page 1JSOC Overview August 2007 HMI Status HMI is virtually done. –Virtually  similar to but not in fact –Front window issue resolved, flight window now.
Software Development. Software Development Loop Design  Programmers need a solid foundation before they start coding anything  Understand the task.
Concurrency, Processes, and System calls Benefits and issues of concurrency The basic concept of process System calls.
1 GONG Magnetogram Data Products. 2 Sky-coordinate images Single-site or merged? –Single-site requires users to select. –Merge has lower noise, may require.
Velocity on a sphere Velocity depends on -how fast it is spinning,  -distance from rotation axis Rp (where R is the radius of the Earth, and p is the.
Know what a computer is used for Understand the difference between hardware and software Be able to describe the way that data is stored in a computer.
Chapter 8 Lossy Compression Algorithms. Fundamentals of Multimedia, Chapter Introduction Lossless compression algorithms do not deliver compression.
Page 1SDO Teams Meeting, March 2008 Status and Overview of HMI–AIA Joint Science Operations Center (JSOC) Science Data Processing (SDP) P. Scherrer Science.
Time-distance measurements of meridional circulation using pairs of points at equal center-to- limb angle Tom Duvall Deep Chakraborty Tim Larsen.
Basic Computer Hardware and Software. Guilford County SciVis V
Global Rotation Inversions Profile rotation vs latitude and depth Tachocline, Near-Surface Shear … Monitor evolution during solar cycle Zonal Flows, Tachocline.
Basic Computer Hardware and Software.
Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,
Page 1JSOC Review – 17 March 2005 JSOC 17 March 2005 “Peer” Review Stanford SDP Development Plan Philip Scherrer
XRD data analysis software development. Outline  Background  Reasons for change  Conversion challenges  Status 2.
Helioseismology for HMI Science objectives and tasks* Data analysis plan* Helioseismology working groups and meetings *HMI Concept Study Report, Appendix.
MHD model in HMI pipeline HMI/AIA science team meeting Sep , 2009 Stanford, CA HMI/AIA science team meeting Sep , 2009 Stanford, CA.
Computer Hardware Introduction What’s inside that box?
Lecture 3 – MapReduce: Implementation CSE 490h – Introduction to Distributed Computing, Spring 2009 Except as otherwise noted, the content of this presentation.
Basic Computer Hardware and Software.
Software Development.
Memory Management.
E.C. Auden1, J.L. Culhane1, Y. P. Elsworth2, A. Fludra3, M. Thompson4
Observables codes: written by Richard, Jesper, and Sebastien
Basic Computer Hardware and Software.
Drill Translate the following message:
Basic Computer Hardware and Software.
Computer System Basics- The Pieces & Parts
HMI Data Analysis Pipeline
Status and Overview of HMI–AIA Joint Science Operations Center (JSOC) Science Data Processing (SDP) April 22, 2008 P. Scherrer.
Instrument Performance Requirements
HMI Data Analysis Pipeline
To get b, triple a and subtract a unit
CS 111 – Sept Beyond the CPU and memory
Presentation transcript:

Global Helioseismology Pipeline Status 11/5/2007

Global Helioseismology Lead – Jesper Schou Lead – Jesper Schou Task Task Remap Dopplergrams to heliographic coords. Remap Dopplergrams to heliographic coords. Project heliographic images onto spherical harmonics Project heliographic images onto spherical harmonics Detrend, gapfill, FFT, and peak-bag/ridge-fit spherical-harmonics time series to yield mode parameters/frequencies Detrend, gapfill, FFT, and peak-bag/ridge-fit spherical-harmonics time series to yield mode parameters/frequencies Run inversion code to yield internal sound-speed and internal rotation Run inversion code to yield internal sound-speed and internal rotation

Global Helioseismology (cont’d.) Input – Dopplergrams (dataseries hmi.???) Input – Dopplergrams (dataseries hmi.???) Level 2 Output Level 2 Output Spherical-harmonics time-series Spherical-harmonics time-series With gaps, drifting – data saved in hmi.???, cadence is 72 d., size is 832 GB With gaps, drifting – data saved in hmi.???, cadence is 72 d., size is 832 GB Gap-filled, detrended – data saved in hmi.???, cadence is 72 d., size is 832 GB Gap-filled, detrended – data saved in hmi.???, cadence is 72 d., size is 832 GB Mode parameters/frequencies – data saved in hmi.???, cadence is 72 d., size of 3 files is 2.5 MB Mode parameters/frequencies – data saved in hmi.???, cadence is 72 d., size of 3 files is 2.5 MB Internal rotation(r, lat.) – data saved in hmi.???, cadence is 72 d., size is ~25 KB ea. file (number of files not known) Internal rotation(r, lat.) – data saved in hmi.???, cadence is 72 d., size is ~25 KB ea. file (number of files not known) Internal Sound speed(r, lat.) – data saved in hmi.???, cadence is 72 d., size is ??? Internal Sound speed(r, lat.) – data saved in hmi.???, cadence is 72 d., size is ???

Global Helioseismology (cont’d.) Code Code “v2helio” (Keh-Cheng, Art) – remap Dopplergrams to heliographic coordinates “v2helio” (Keh-Cheng, Art) – remap Dopplergrams to heliographic coordinates “helio2mlat” (???) – remap heliographic coordinates to ??? “helio2mlat” (???) – remap heliographic coordinates to ??? “qdotprod” (???) – project onto basis vector “qdotprod” (???) – project onto basis vector “retile” (???) – rearrange data in chunks “retile” (???) – rearrange data in chunks (Tim) – fill gaps and detrend time series (Tim) – fill gaps and detrend time series (Jesper) – for low to med l, peak bag (Jesper) – for low to med l, peak bag (???) – for high l, ridge fit (???) – for high l, ridge fit (???) – inversion for internal sound speed (???) – inversion for internal sound speed (Schou) – inversion for internal rotation (Schou) – inversion for internal rotation

Global Helioseismology (cont’d.) Processors Processors 72 – Code that remaps, projects, retiles (1 h. ea. processor) 72 – Code that remaps, projects, retiles (1 h. ea. processor) 72 – gap fill/detrend (2+ h. ea. processor) 72 – gap fill/detrend (2+ h. ea. processor) 72 – peak bag/ridge fit (2 h. ea. processor) 72 – peak bag/ridge fit (2 h. ea. processor) 1 – Internal rotation inversion (~2 min. ea. processor) 1 – Internal rotation inversion (~2 min. ea. processor) ??? – sound-speed inversion ??? – sound-speed inversion Status Status All code ready to port, except peak-bagging which needs some improvements; remapping (v2helio) mostly ported All code ready to port, except peak-bagging which needs some improvements; remapping (v2helio) mostly ported Plan/Issues Plan/Issues Need a schedule Need a schedule Not sure which harmonics time-series to save, gap-filled/detrended, or with gaps/drifting Not sure which harmonics time-series to save, gap-filled/detrended, or with gaps/drifting At what resolutions will sound speed be created? At what resolutions will sound speed be created? Is cadence remaining at 72 days? Is cadence remaining at 72 days? Would like to use keywords to automate gap identification Would like to use keywords to automate gap identification Big CPU requirements? Big CPU requirements?