Time-Series Analysis of Astronomical Data

Slides:



Advertisements
Similar presentations
Data Analysis Do it yourself!. What to do with your data? Report it to professionals (e.g., AAVSO) –Excellent! A real service to science; dont neglect.
Advertisements

Mining the MACHO dataset Markus Hegland, Mathematical Sciences Institute, ANU Margaret Kahn, ANU Supercomputer Facility.
DCSP-12 Jianfeng Feng
DCSP-13 Jianfeng Feng
DCSP-13 Jianfeng Feng Department of Computer Science Warwick Univ., UK
Definitions Periodic Function: f(t +T) = f(t)t, (Period T)(1) Ex: f(t) = A sin(2Πωt + )(2) has period T = (1/ω) and ω is said to be the frequency (angular),
Design of Experiments Lecture I
Ch 3 Analysis and Transmission of Signals
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Periodograms Bartlett Windows Data Windowing Blackman-Tukey Resources:
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Lecture 15 Orthogonal Functions Fourier Series. LGA mean daily temperature time series is there a global warming signal?
Searching for Periodic Signals in Time Series Data
DFT/FFT and Wavelets ● Additive Synthesis demonstration (wave addition) ● Standard Definitions ● Computing the DFT and FFT ● Sine and cosine wave multiplication.
Introduction The aim the project is to analyse non real time EEG (Electroencephalogram) signal using different mathematical models in Matlab to predict.
1 BIS APPLICATION MANAGEMENT INFORMATION SYSTEM Advance forecasting Forecasting by identifying patterns in the past data Chapter outline: 1.Extrapolation.
Problem: Ground Clutter Clutter: There is always clutter in signals and it distorts the purposeful component of the signal. Getting rid of clutter, or.
Variable Phenomena Nyquist Sampling Harry Nyquist (1889 – 1976)
Discrete Fourier Transform(2) Prof. Siripong Potisuk.
Correlation and spectral analysis Objective: –investigation of correlation structure of time series –identification of major harmonic components in time.
R. Werner Solar Terrestrial Influences Institute - BAS Time Series Analysis by descriptive statistic.
Introduction To Signal Processing & Data Analysis
1 Simple Linear Regression 1. review of least squares procedure 2. inference for least squares lines.
Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 3 Ravi Ramamoorthi
Goals For This Class Quickly review of the main results from last class Convolution and Cross-correlation Discrete Fourier Analysis: Important Considerations.
Ni.com Data Analysis: Time and Frequency Domain. ni.com Typical Data Acquisition System.
Where we’re going Speed, Storage Issues Frequency Space.
ElectroScience Lab IGARSS 2011 Vancouver Jul 26th, 2011 Chun-Sik Chae and Joel T. Johnson ElectroScience Laboratory Department of Electrical and Computer.
The Story of Wavelets.
Periodicities in variable stars: a few issues Chris Koen Dept. Statistics University of the Western Cape.
Time Series Spectral Representation Z(t) = {Z 1, Z 2, Z 3, … Z n } Any mathematical function has a representation in terms of sin and cos functions.
THE MANAGEMENT AND CONTROL OF QUALITY, 5e, © 2002 South-Western/Thomson Learning TM 1 Chapter 9 Statistical Thinking and Applications.
HD This star is found periodic. The possible period is days. We present the phase curve with this period. HD This star is not variable.
Time Series Analysis. A number of fields in astronomy require finding periodic signals in a time series of data: 1.Periods in pulsating stars (e.g. Cepheids)
Variation This presentation should be read by students at home to be able to solve problems.
Sampling Error.  When we take a sample, our results will not exactly equal the correct results for the whole population. That is, our results will be.
CHEE825 Fall 2005J. McLellan1 Spectral Analysis and Input Signal Design.
Chapter 6 Spectrum Estimation § 6.1 Time and Frequency Domain Analysis § 6.2 Fourier Transform in Discrete Form § 6.3 Spectrum Estimator § 6.4 Practical.
Part 4 Chapter 16 Fourier Analysis PowerPoints organized by Prof. Steve Chapra, University All images copyright © The McGraw-Hill Companies, Inc. Permission.
Astronomical Data Analysis I
Basic Time Series Analyzing variable star data for the amateur astronomer.
Vibrationdata 1 Unit 6a The Fourier Transform. Vibrationdata 2 Courtesy of Professor Alan M. Nathan, University of Illinois at Urbana-Champaign.
Lecture#10 Spectrum Estimation
GG313 Lecture 24 11/17/05 Power Spectrum, Phase Spectrum, and Aliasing.
Z bigniew Leonowicz, Wroclaw University of Technology Z bigniew Leonowicz, Wroclaw University of Technology, Poland XXIX  IC-SPETO.
Fourier and Wavelet Transformations Michael J. Watts
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Changes of light curve parameters of LPVs and classification of Miras and semiregular variables KOLOS-2015 V.I. Marsakova, Odessa National University.
Geology 6600/7600 Signal Analysis 05 Oct 2015 © A.R. Lowry 2015 Last time: Assignment for Oct 23: GPS time series correlation Given a discrete function.
Fourier Analyses Time series Sampling interval Total period Question: How perturbations with different frequencies contribute to the turbulent kinetic.
Learning from the Past, Looking to the Future James R. (Jim) Beaty, PhD - NASA Langley Research Center Vehicle Analysis Branch, Systems Analysis & Concepts.
BUSINESS MATHEMATICS & STATISTICS. Module 6 Correlation ( Lecture 28-29) Line Fitting ( Lectures 30-31) Time Series and Exponential Smoothing ( Lectures.
Period Determination Study of Selected RV Tauri Stars Mark Kelly, Dr. Pamela Gay (Advisor) Centre for Astrophysics and Supercomputing Swinburne University.
Data statistics and transformation revision Michael J. Watts
Advanced Computer Graphics
k is the frequency index
SUR-2250 Error Theory.
National Mathematics Day
Time Series Spectral Representation
Part 5 - Chapter
CS 591 S1 – Computational Audio
Part 5 - Chapter 17.
Part 4 Chapter 16 Fourier Analysis
Fourier Analyses Time series Sampling interval Total period
Fourier and Wavelet Transformations
Time domain & frequency domain
Part 5 - Chapter 17.
k is the frequency index
Fourier Analyses Time series Sampling interval Total period
Lecture 2: Frequency & Time Domains presented by David Shires
Presentation transcript:

Time-Series Analysis of Astronomical Data Workshop on Photometric Databases and Data Analysis Techniques 92nd Meeting of the AAVSO Tucson, Arizona April 26, 2003 Matthew Templeton (AAVSO)

What is time-series analysis? Applying mathematical and statistical tests to data, to quantify and understand the nature of time-varying phenomena Gain physical understanding of the system Be able to predict future behavior Has relevance to fields far beyond just astronomy and astrophysics!

Discussion Outline Statistics Fourier Analysis Wavelet analysis Statistical time-series and autocorrelation Resources

Preliminaries: Elementary Statistics Mean: Arithmetic mean or average of a data set Variance & standard deviation: How much do the data vary about the mean?

Example: Averaging Random Numbers 1 sigma: 68% confidence level 3 sigma: 99.7% confidence level

Error Analysis of Variable Star Data Measurement of Mean and Variance are not so simple! Mean varies: Linear trends? Fading? Variance is a combination of: Intrinsic scatter Systematic error (e.g. chart errors) Real variability!

Statistics: Summary Random errors always present in your data, regardless of how high the quality Be aware of non-random, systematic trends (fading, chart errors, observer differences) Understand your data before you analyze it!

Methods of Time-Series Analysis Fourier Transforms Wavelet Analysis Autocorrelation analysis Other methods Use the right tool for the right job!

Fourier Analsysis: Basics Fourier analysis attempts to fit a series of sine curves with different periods, amplitudes, and phases to a set of data. Algorithms which do this perform mathematical transforms from the time “domain” to the period (or frequency) domain. f (time)  F (period)

F () =  f(t) exp(i2t) dt The Fourier Transform For a given frequency  (where =(1/period)) the Fourier transform is given by F () =  f(t) exp(i2t) dt Recall Euler’s formula: exp(ix) = cos(x) + isin(x)

Fourier Analysis: Basics 2 Your data place limits on: Period resolution Period range If you have a short span of data, both the period resolution and range will be lower than if you have a longer span

Period Range & Sampling Suppose you have a data set spanning 5000 days, with a sampling rate of 10/day. What are the formal, optimal values of… P(max) = 5000 days (but 2500 is better) P(min) = 0.2 days (sort of…) dP = P2 / [5000 d] (d = n/(N), n=-N/2:N/2)

Effect of time span on FT R CVn: P (gcvs) = 328.53 d

Nyquist frequency/aliasing FTs can recover periods much shorter than the sampling rate, but the transform will suffer from aliasing!

Fourier Algorithms Discrete Fourier Transform: the classic algorithm (DFT) Fast Fourier Transform: very good for lots of evenly-spaced data (FFT) Date-Compensated DFT: unevenly sampled data with lots of gaps (TS) Periodogram (Lomb-Scargle): similar to DFT

Fourier Transforms: Applications Multiperiodic data “Red noise” spectral measurements Period, amplitude evolution Light curve “shape” estimation via Fourier harmonics

Application: Light Curve Shape of AW Per m(t) = mean + aicos(it + i)

Wavelet Analysis Analyzing the power spectrum as a function of time Excellent for changing periods, “mode switching”

Wavelet Analysis: Applications Many long period stars have changing periods, including Miras with “stable” pulsations (M, SR, RV, L) “Mode switching” (e.g. Z Aurigae) CVs can have transient periods (e.g. superhumps) WWZ is ideal for all of these!

Wavelet Analysis of AAVSO Data Long data strings are ideal, particularly with no (or short) gaps Be careful in selecting the window width – the smaller the window, the worse the period resolution (but the larger the window, the worse the time resolution!)

Wavelet Analysis: Z Aurigae How to choose a window size?

Statistical Methods for Time-Series Analysis Correlation/Autocorrelation – how does the star at time (t) differ from the star at time (t+)? Analysis of Variance/ANOVA – what period foldings minimize the variance of the dataset?

Autocorrelation For a range of “periods” (), compare each data point m(t) to a point m(t+) The value of the correlation function at each  is a function of the average difference between the points If the data is variable with period , the autocorrelation function has a peak at 

Autocorrelation: Applications Excellent for stars with amplitude variations, transient periods Strictly periodic stars Not good for multiperiodic stars (unless Pn= n P1)

Autocorrelation: R Scuti

SUMMARY Many time-series analysis methods exist Choose the method which best suits your data and your analysis goals Be aware of the limits (and strengths!) of your data

Computer Programs for Time-Series Analysis AAVSO: TS 1.1 & WWZ (now available for linux/unix) http://www.aavso.org/data/software/ PERIOD98: designed for multiperiodic stars http://www.univie.ac.at/tops/Period04/ Statistics code index @ Penn State Astro Dept. http://www.astro.psu.edu/statcodes/ Astrolab: autocorrelation (J. Percy, U. Toronto) http://www.astro.utoronto.ca/~percy/analysis.html