Page 1 of 46SONG4, Charleston, Sep. 16, 2011 Can the Experience From Helioseismology Help us With SONG? Jesper Schou Stanford University

Slides:



Advertisements
Similar presentations
SPM 2002 C1C2C3 X =  C1 C2 Xb L C1 L C2  C1 C2 Xb L C1  L C2 Y Xb e Space of X C1 C2 Xb Space X C1 C2 C1  C3 P C1C2  Xb Xb Space of X C1 C2 C1 
Advertisements

Lecture 15 Orthogonal Functions Fourier Series. LGA mean daily temperature time series is there a global warming signal?
All about noisy time series analysis in which features exist and long term behavior is present; finite boundary conditions are always an issue.
Accuracy and Precision in the Lab. Precision and Accuracy Errors in Scientific Measurements Precision - Refers to reproducibility or “How close the measurements.
HMI OBSERVATIONS OF TRANSIENT PHENOMENA Juan Carlos Martínez Oliveros Space Sciences Laboratory, UC Berkeley Charles Lindsey, Hugh Hudson, S. Couvidat,
Copyright © 2009 Pearson Education, Inc. Chapter 29 Multiple Regression.
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Visual Recognition Tutorial
Copyright © 2010, 2007, 2004 Pearson Education, Inc. *Chapter 29 Multiple Regression.
Economics Prof. Buckles1 Time Series Data y t =  0 +  1 x t  k x tk + u t 1. Basic Analysis.
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Economics 20 - Prof. Anderson1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 6. Heteroskedasticity.
2008/10/21 J. Fontenla, M Haberreiter LASP – Univ. of Colorado NADIR MURI Focus Area.
Multi-Scale Analysis for Network Traffic Prediction and Anomaly Detection Ling Huang Joint work with Anthony Joseph and Nina Taft January, 2005.
Evaluating Hypotheses
Solar cycle variation in the peak asymmetry: solar or artefact? S. J. Jiménez-Reyes IAC 13-sept-2004.
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of scientific research When you know the system: Estimation.
Economics 20 - Prof. Anderson
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of a scientific research When you know the system: Estimation.
1Prof. Dr. Rainer Stachuletz Time Series Data y t =  0 +  1 x t  k x tk + u t 1. Basic Analysis.
Economics Prof. Buckles
Current Status and Future Prospects of High-Degree Ridge Fitting Johann Reiter, Edward Rhodes, and Jesper Schou HMI Science Team Meeting Monterey, CA February.
Introduction to Regression with Measurement Error STA431: Spring 2013.
Two and a half problems in homogenization of climate series concluding remarks to Daily Stew Ralf Lindau.
ElectroScience Lab IGARSS 2011 Vancouver Jul 26th, 2011 Chun-Sik Chae and Joel T. Johnson ElectroScience Laboratory Department of Electrical and Computer.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Hypothesis Testing. Distribution of Estimator To see the impact of the sample on estimates, try different samples Plot histogram of answers –Is it “normal”
Handling Data and Figures of Merit Data comes in different formats time Histograms Lists But…. Can contain the same information about quality What is meant.
Sociology 5811: Lecture 7: Samples, Populations, The Sampling Distribution Copyright © 2005 by Evan Schofer Do not copy or distribute without permission.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
Future of asteroseismology II Jørgen Christensen-Dalsgaard Institut for Fysik og Astronomi, Aarhus Universitet Dansk AsteroSeismologisk Center.
Fundamentals of Data Analysis Lecture 10 Management of data sets and improving the precision of measurement pt. 2.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
Asteroseismological determination of stellar rotation axes: Feasibility study (COROT AP+CP) L. Gizon(1), G. Vauclair(2), S. Solanki(1), S. Dreizler(3)
1 Statistical Distribution Fitting Dr. Jason Merrick.
VI. Evaluate Model Fit Basic questions that modelers must address are: How well does the model fit the data? Do changes to a model, such as reparameterization,
SPM short course – Oct Linear Models and Contrasts Jean-Baptiste Poline Neurospin, I2BM, CEA Saclay, France.
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 9: Ways of speeding up the learning and preventing overfitting Geoffrey Hinton.
MGS3100_04.ppt/Sep 29, 2015/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Regression Sep 29 and 30, 2015.
Rabello-Soares, Bogart & Scherrer (2013): Comparison of a quiet tile with a nearby active region (5 o to 8 o away) with a quiet tile with no nearby.
A tool to simulate COROT light-curves R. Samadi 1 & F. Baudin 2 1 : LESIA, Observatory of Paris/Meudon 2 : IAS, Orsay.
Intrinsic Short Term Variability in W3-OH and W49N Hydroxyl Masers W.M. Goss National Radio Astronomy Observatory Socorro, New Mexico, USA A.A. Deshpande,
Artificial ‘Physics-light’ Ring Data Rachel Howe, Irene Gonzalez-Hernandez, and Frank Hill.
1 Global Helioseismology 2: Results Rachel Howe, NSO.
Basic Time Series Analyzing variable star data for the amateur astronomer.
Reserve Uncertainty 1999 CLRS by Roger M. Hayne, FCAS, MAAA Milliman & Robertson, Inc.
MOS Data Reduction Michael Balogh University of Durham.
Correlation & Regression Analysis
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
Week 6. Statistics etc. GRS LX 865 Topics in Linguistics.
Bob Livezey NWS Climate Services Seminar February 13, 2013.
Dynamic Models, Autocorrelation and Forecasting ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
Lecture 8 Source detection NASSP Masters 5003S - Computational Astronomy
Options and generalisations. Outline Dimensionality Many inputs and/or many outputs GP structure Mean and variance functions Prior information Multi-output,
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Travel Time Measurements Markus Roth 1, Laurent Gizon 1, John G. Beck 2 1 Max-Planck-Institut für Sonnensystemforschung 2 Stanford University HELAS Workshop.
Jin Huang M.I.T. For Transversity Collaboration Meeting Jan 29, JLab.
Economics 20 - Prof. Anderson1 Time Series Data y t =  0 +  1 x t  k x tk + u t 1. Basic Analysis.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
STAR SVT Self Alignment V. Perevoztchikov Brookhaven National Laboratory,USA.
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
Central limit theorem - go to web applet. Correlation maps vs. regression maps PNA is a time series of fluctuations in 500 mb heights PNA = 0.25 *
In the past two years, after the first three lectures, the topics of “fundamental constants”, “basic physical concepts”, “random and system errors”, “error.
Why Model? Make predictions or forecasts where we don’t have data.
SUR-2250 Error Theory.
The general linear model and Statistical Parametric Mapping
Synopsis “The Matrix”: polarisation and pulsar timing
NanoBPM Status and Multibunch Mark Slater, Cambridge University
Survey Networks Theory, Design and Testing
Presentation transcript:

Page 1 of 46SONG4, Charleston, Sep. 16, 2011 Can the Experience From Helioseismology Help us With SONG? Jesper Schou Stanford University

Page 2 of 46SONG4, Charleston, Sep. 16, 2011 Overview Motivation Observations Data Analysis Politics Conclusion

Page 3 of 46SONG4, Charleston, Sep. 16, 2011 Motivation Why am I here? –Got invited! But why? –Not clear Some theories –Tricking me into doing more asteroseismology –Share experiences from helioseismology –Data dump before being made redundant –Share good ideas (cause trouble) –Cause real trouble –Something else?

Page 4 of 46SONG4, Charleston, Sep. 16, 2011 Who is This Character? Used to analyze ground based single site data (Fourier Tach) Worked on MDI testing MDI data analysis –Also found first clear p-modes in other Sun-like star (alpha Cen) HMI instrument scientist –Calibration, testing, meetings, … –Minimal Kepler work HMI operations HMI data analysis I am totally out of the loop in asteroseismology I am not a Real Stanford Person ™ –Stanford restricts what non-real people can do

Page 5 of 46SONG4, Charleston, Sep. 16, 2011 Helioseismic Observations Used to do single site observations –Had sidelobes –Low duty cycle degrades S/N –Got systematic errors for modes where sidelobe spacing equals mode spacing Then got GONG and MDI –No significant sidelobes. –Got rid of many systematics But still have some –Got more modes and lower errors Use 72d for MDI/HMI and 108d for GONG –Modes are rapidly lost for length<lifetime Various analysis algorithms are used –Power spectrum versus Fourier transform fitting –One (n,l,m) at a time one (n,l) at a time and global fitting used We have resolved observations –So lots of issues not relevant to asteroseismology at this time

Page 6 of 46SONG4, Charleston, Sep. 16, 2011 Modes With Error Bars Overall scale measured to one part in 51e6.

Page 7 of 46SONG4, Charleston, Sep. 16, 2011 Asteroseismic Observations So what to do for SONG? Avoid peaks in window function in inconvenient places –Some scheduling flexibility with fixed resource use (total observing time) –May need to reconsider certain stars Quality almost always beats quantity! –An extra few modes may go a long way towards eliminating ambiguities –Modes are rapidly lost for length<lifetime Essential to observe for critical length of time –Variable quality can create a lot of noise and artifacts But if S/N is high then sigma depends weakly on S/N –See Libbrecht (1992, ApJ, 387, 712) –So low duty cycle may not be that bad Dangerous? Consider calculating information content –SVD techniques should work (see work by Brown and others) Do some sort of optimizination

Page 8 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – Basic Reduction Use all information in the spectra –Doppler velocity is not the only observable! And it depends on wavelength and height in the atmosphere (position in line) –May also want to look at continuum, linedepth and/or equivalent width –Consider exploiting line and wavelength dependence Fit a good model of the spectra –You must know your instrument! –Physics must be correct –Statistics must be correct Use proper distribution Use correct noise –Understand your residuals –Understand your trends

Page 9 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – Modeling of Temporal Spectra Model the data carefully –Leakage matrix (aka sensitivity to different modes) is non-trivial to calculate Limb darkening profile depends on wavelength, temperature, g, composition, etc. Not all lines are created equally – use proper average –Amplitudes and linewidths as a function of frequency are non-trivial Don’t be fooled by the Sun Neither need be smooth near avoided crossings Amplitude profile not simple Gaussian or some such! –Line profiles are not Lorentzian We see significant asymmetries for the Sun Asymmetry depends on frequency and observable (Doppler, intensity, …) –Background Sum of power laws? Implies global fit Watch the low frequencies. Detrending causes artifacts Watch high frequencies. Aliasing makes power law poor approximation

Page 10 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – Fitting of Temporal Spectra Use proper statistics –See Anderson et al., (1990, ApJ, 364, 699) –Small improvements may seem small but are important Sqrt(T) grows slowly!

Page 11 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – More Statistics Assuming 100% duty cycle and standard physics: –Different frequency points in Fourier transform are independent –Real and imaginary parts are normally distributed with equal variance –Assumptions include stochastically excited damped oscillator model And/or others –Follows that power spectra are exponentially distributed There is no information in the phase But assumptions do not hold –At low duty cycle different frequency points are not independent –Phases are not random –May be worth investigating/exploiting With more than one variable phase is also important

Page 12 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – Fitting of Temporal Spectra Fitting strategy –Single mode fits Traditional method in helioseismology Fairly unbiased But modes are often lost –Multi mode fits Parameterize variation of mode parameters Linewidths and amplitudes vary slowly with frequency oBut watch out for avoided crossings –Global fits Fit asymptotics directly oVery poor approximation. oSubstantial loss of information Linearize around reference model oSee work by Vorontsov and Jefferies oShould work well if you believe that inversions work well oHard to test for quality of fit –Check your residuals! –Do independent analysis and encourage competition

Page 13 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – Fitting of Temporal Spectra Gaps in time-series need to be considered –Not filling means sidelobes But filling may not be possible –Auto-regressive gap filler is likely the way to go Need detrending oCauses loss of low frequency power Time series must be uniform (eg. sites must be consistent) Only works well for spiky spectra –Gaps mean that points in power spectra are no longer independent Whether gaps are filled or not! Maximum likelihood estimator becomes complicated Errors become unreliable and correlated if careless

Page 14 of 46SONG4, Charleston, Sep. 16, 2011 Data Analysis – Other Issues Fit of multiple variables –Best for simultaneous observations Eg. two observables from the same observations –Learn about mode physics –Identify modes –Constrain geometry better Time variations –Fit all epochs simultaneously Mean frequencies plus parameterized time variation Testing is important –Many of these issues raised can be addressed using Monte Carlo methods Best done as hare and hounds But such methods are no better than the physics put in

Page 15 of 46SONG4, Charleston, Sep. 16, 2011 What Happens if you Don’t pay Attention

Page 16 of 46SONG4, Charleston, Sep. 16, 2011 What Happens if you Don’t pay Attention

Page 17 of 46SONG4, Charleston, Sep. 16, 2011 RLS Trade-off Curve

Page 18 of 46SONG4, Charleston, Sep. 16, 2011 RLS Trade-off Curve - Continued

Page 19 of 46SONG4, Charleston, Sep. 16, 2011 More bad Things

Page 20 of 46SONG4, Charleston, Sep. 16, 2011 Politics Data sharing –All MDI and HMI observables freely available –Must give proper credit Instrument paper Intermediate results papers (eg. frequencies) –Must send us copies of papers But only for accounting Most people forget –This has served us extremely well! Make sure to allow/encourage the independent/untraditional researcher! –Sometimes crazy ideas do work out Think solar far side imaging

Page 21 of 46SONG4, Charleston, Sep. 16, 2011 Politics Group vs. individual science (non instrument) publications –We have generally gone with voluntary collaborations We have no requirement for co-authorship or review Do encourage contacting PI team Less immediate credit to PI team oBut more long term (Scherrer et al has >1000 citations in ADS) Encourages the bold, untraditional, creative, etc. researchers This is the approach most closely aligned with the Scientific Method ™ –Forced group publications (eg. KASC) have some advantages Gets people focused so some short term advantage But likely leads to damage in medium term oPapers tend to be compromises oNo space for adequate details, so can’t tell what is really done oNo truly independent review possible Leads to fewer overall publications and thus less overall impact Against the rules of journals and various societies oForced credit to people who have contributed little or nothing to the intellectual content

Page 22 of 46SONG4, Charleston, Sep. 16, 2011 Politics While tedious and boring to write it is essential to provide good documentation –Instrument paper –Calibration procedures –Analysis procedures –Well organized website Easy data access Documentation on calibration and analysis List of important events Known problems –Permanent data repository Good metadata. Use standard, if possible PR and Public Outreach is important –Somebody paid for this and want something in return –Improves funding –It is the right thing to do

Page 23 of 46SONG4, Charleston, Sep. 16, 2011 Conclusion The future looks bright for asteroseismology! Much work to do Watch systematics! Think carefully about the political issues Do as I say, not as I do!