Locating a Shift in the Mean of a Time Series Melvin J. Hinich Applied Research Laboratories University of Texas at Austin

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
Chapter 3. Noise Husheng Li The University of Tennessee.
1. INTRODUCTION In order to transmit digital information over * bandpass channels, we have to transfer the information to a carrier wave of.appropriate.
Filtering Filtering is one of the most widely used complex signal processing operations The system implementing this operation is called a filter A filter.
OPTIMUM FILTERING.
Itay Ben-Lulu & Uri Goldfeld Instructor : Dr. Yizhar Lavner Spring /9/2004.
Simple Linear Regression
Review of Frequency Domain
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Lecture 4 Measurement Accuracy and Statistical Variation.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Lecture 16 Random Signals and Noise (III) Fall 2008 NCTU EE Tzu-Hsien Sang.
Matched Filters By: Andy Wang.
Introduction to Spectral Estimation
Echivalarea sistemelor analogice cu sisteme digitale Prof.dr.ing. Ioan NAFORNITA.
Discrete-Time and System (A Review)
ELE 488 F06 ELE 488 Fall 2006 Image Processing and Transmission ( ) Wiener Filtering Derivation Comments Re-sampling and Re-sizing 1D  2D 10/5/06.
© by Yu Hen Hu 1 ECE533 Digital Image Processing Image Restoration.
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
Review for Exam I ECE460 Spring, 2012.
Random Processes ECE460 Spring, Power Spectral Density Generalities : Example: 2.
1 Part 5 Response of Linear Systems 6.Linear Filtering of a Random Signals 7.Power Spectrum Analysis 8.Linear Estimation and Prediction Filters 9.Mean-Square.
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Review Resources: Wiki: Superheterodyne Receivers RE: Superheterodyne.
Quadrature Amplitude Modulation (QAM) Transmitter
Signals CY2G2/SE2A2 Information Theory and Signals Aims: To discuss further concepts in information theory and to introduce signal theory. Outcomes:
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Definitions Random Signal Analysis (Review) Discrete Random Signals Random.
Detection and estimation of abrupt changes in Gaussian random processes with unknown parameters By Sai Si Thu Min Oleg V. Chernoyarov National Research.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
1 Chapter 9 Detection of Spread-Spectrum Signals.
HYPOTHESIS TESTING Distributions(continued); Maximum Likelihood; Parametric hypothesis tests (chi-squared goodness of fit, t-test, F-test) LECTURE 2 Supplementary.
ECE 8443 – Pattern Recognition ECE 3163 – Signals and Systems Objectives: Demultiplexing and Demodulation Superheterodyne Receivers Review Resources: Wiki:
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
EE445S Real-Time Digital Signal Processing Lab Spring 2014 Lecture 16 Quadrature Amplitude Modulation (QAM) Receiver Prof. Brian L. Evans Dept. of Electrical.
revision Transfer function. Frequency Response
Chapter 1 Random Process
Technological Educational Institute Of Crete Department Of Applied Informatics and Multimedia Neural Networks Laboratory Slide 1 FOURIER TRANSFORMATION.
Machine Learning 5. Parametric Methods.
Discrete-time Random Signals
Chapter 5 Image Restoration.
Baseband Receiver Receiver Design: Demodulation Matched Filter Correlator Receiver Detection Max. Likelihood Detector Probability of Error.
Geology 6600/7600 Signal Analysis 28 Sep 2015 © A.R. Lowry 2015 Last time: Energy Spectral Density; Linear Systems given (deterministic) finite-energy.
Lecture 12: Parametric Signal Modeling XILIANG LUO 2014/11 1.
Random Processes Gaussian and Gauss-Markov processes Power spectrum of random processes and white processes.
1 “Figures and images used in these lecture notes by permission, copyright 1997 by Alan V. Oppenheim and Alan S. Willsky” Signals and Systems Spring 2003.
Week 21 Order Statistics The order statistics of a set of random variables X 1, X 2,…, X n are the same random variables arranged in increasing order.
Performance of Digital Communications System
1 Randomly Modulated Periodic Signals Melvin J. Hinich Applied Research Laboratories University of Texas at Austin
Falsifying Generalized Wiener Processes Melvin J. Hinich Applied Research Laboratories University of Texas at Austin
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
Geology 6600/7600 Signal Analysis 26 Oct 2015 © A.R. Lowry 2015 Last time: Wiener Filtering Digital Wiener Filtering seeks to design a filter h for a linear.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Presentation : “ Maximum Likelihood Estimation” Presented By : Jesu Kiran Spurgen Date :
Probability Theory and Parameter Estimation I
Ch3: Model Building through Regression
Lecture 1.30 Structure of the optimal receiver deterministic signals.
The General Linear Model
Chapter 3 Sampling.
Image Analysis Image Restoration.
Outline Linear Shift-invariant system Linear filters
The General Linear Model (GLM)
Sampling Distribution
Sampling Distribution
Advanced Digital Signal Processing
10701 / Machine Learning Today: - Cross validation,
The General Linear Model (GLM)
Chapter 2 – Linear Filters
The General Linear Model
Uncertainty Propagation
Presentation transcript:

Locating a Shift in the Mean of a Time Series Melvin J. Hinich Applied Research Laboratories University of Texas at Austin

Localizing a Single Change in the Mean A statistical uncertainty principle for the localization of a single change in the The smallest mean squared error for any estimate of the time of change of a bandlimited stationary random process mean GOAL

Discrete-Time Sampling It is common in time series analysis to begin Then decimate the filtered output with a discrete-time sample of the time series to obtain the discrete-time sample Apply a linear bandlimited filter to the signal

Linear Bandlimited Filter The filter is linear and causal The filter smoothes the input since the filter removed frequency components of the input for. The filter impulse response function is

Mean Shift If the mean of the signal has an abrupt shift from at an unknown time The shift in the mean of the output is

Integrated Impulse Response

Ideal Bandpass Filter Impulse response of the ideal filter - sinc function

Meanshift The shift in the mean of x(t n ) is We will now derive the least squares estimate of the location of the shift for

Maximum Likelihood Estimate - the least squares estimate of i.i.d. gaussian variates with variance is the value that maximizes the statistic

Least Squares Estimate The least squares estimate of  o is the value that maximizes The standard deviation of the estimate is approximately

Asymptotic Standard Deviation E - the total energy of the white noise Area under its bandlimited white noise spectrum

Hinich Test for a Changing Slope Parameter