“Real-time” Transient Detection Algorithms Dr. Kang Hyeun Ji, Thomas Herring MIT.

Slides:



Advertisements
Similar presentations
Anomaly Detection in Problematic GPS Time Series Data and Modeling Dafna Avraham, Yehuda Bock Institute of Geophysics and Planetary Physics, Scripps Institution.
Advertisements

Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room A;
Noise & Data Reduction. Paired Sample t Test Data Transformation - Overview From Covariance Matrix to PCA and Dimension Reduction Fourier Analysis - Spectrum.
2006 AGU Fall Meeting. 14 Dec. 2006, San Francisco – Poster #G43A-0985 Jim Ray (NOAA/NGS), Tonie van Dam (U. Luxembourg), Zuheir Altamimi (IGN), Xavier.
Air Force Technical Applications Center 1 Subspace Based Three- Component Array Processing Gregory Wagner Nuclear Treaty Monitoring Geophysics Division.
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | A | Cambridge MA V F.
SPM 2002 C1C2C3 X =  C1 C2 Xb L C1 L C2  C1 C2 Xb L C1  L C2 Y Xb e Space of X C1 C2 Xb Space X C1 C2 C1  C3 P C1C2  Xb Xb Space of X C1 C2 C1 
Factor Analysis Continued
04/22/02EGS G STABILITY OF GLOBAL GEODETIC RESULTS Prof. Thomas Herring Room ;
Spatial Filtering (Chapter 3)
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
1/44 1. ZAHRA NAGHSH JULY 2009 BEAM-FORMING 2/44 2.
1 In-Network PCA and Anomaly Detection Ling Huang* XuanLong Nguyen* Minos Garofalakis § Michael Jordan* Anthony Joseph* Nina Taft § *UC Berkeley § Intel.
Pattern Recognition Topic 1: Principle Component Analysis Shapiro chap
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
Face Recognition Using Eigenfaces
SOPAC's Instantaneous Global Plate Motion Model: Yehuda Bock, Linette Prawirodirdjo, Peng Fang, Paul Jamason, Shimon Wdowinski (TAU, UMiami) Scripps Orbit.
A Regression Model for Ensemble Forecasts David Unger Climate Prediction Center.
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
Principles of the Global Positioning System Lecture 11 Prof. Thomas Herring Room A;
Constant process Separate signal & noise Smooth the data: Backward smoother: At any give T, replace the observation yt by a combination of observations.
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Statistical Arbitrage Ying Chen, Leonardo Bachega Yandong Guo, Xing Liu March, 2010.
Summarized by Soo-Jin Kim
Principal Components Analysis BMTRY 726 3/27/14. Uses Goal: Explain the variability of a set of variables using a “small” set of linear combinations of.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Satellite Tracking Example of SNC and DMC ASEN.
Computational Methods of Scientific Programming Lecturers Thomas A Herring, Room A, Chris Hill, Room ,
Chapter 8: The future geodetic reference frames Thomas Herring, Hans-Peter Plag, Jim Ray, Zuheir Altamimi.
Digital Imaging and Remote Sensing Laboratory NAPC 1 Noise Adjusted Principal Component Transform (NAPC) Data are first preprocessed to remove system bias.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
GPS: “Where goeth thou” Thomas Herring With results from Jen Alltop: Geosystems Thesis Katy Quinn: Almost graduated Ph.D
SNARF: Theory and Practice, and Implications Thomas Herring Department of Earth Atmospheric and Planetary Sciences, MIT
Disputable non-DC components of several strong earthquakes Petra Adamová Jan Šílený.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
Statistical Arbitrage Ying Chen, Leonardo Bachega Yandong Guo, Xing Liu February, 2010.
Principles of the Global Positioning System Lecture 24 Prof. Thomas Herring Room ;
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Dealing with earthquakes and other non-linear motions T. A. Herring R. W. King M. A. Floyd Massachusetts Institute of Technology GPS Data Processing and.
Sparse Signals Reconstruction Via Adaptive Iterative Greedy Algorithm Ahmed Aziz, Ahmed Salim, Walid Osamy Presenter : 張庭豪 International Journal of Computer.
AIRS Radiance and Geophysical Products: Methodology and Validation Mitch Goldberg, Larry McMillin NOAA/NESDIS Walter Wolf, Lihang Zhou, Yanni Qu and M.
Principal Components Analysis. Principal Components Analysis (PCA) A multivariate technique with the central aim of reducing the dimensionality of a multivariate.
Issues in GPS Error Analysis What are the sources of the errors ? How much of the error can we remove by better modeling ? Do we have enough information.
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room ;
Autonomous Robots Vision © Manfred Huber 2014.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
PBO Frame Definition using SNARF Version 1.0 Tom Herring MIT.
Error Modeling Thomas Herring Room ;
5/18/2994G21D-04 Spring AGU Realization of a Stable North America Reference Frame Thomas Herring Department of Earth Atmospheric and Planetary, Sciences,
Are thermal effects responsible for micron-level motions recorded at deep- and shallow-braced monuments in a short-baseline network at Yucca Mountain,
Principles of the Global Positioning System Lecture 09 Prof. Thomas Herring Room A;
12/12/01Fall AGU Vertical Reference Frames for Sea Level Monitoring Thomas Herring Department of Earth, Atmosphere and Planetary Sciences
Université d’Ottawa / University of Ottawa 2001 Bio 8100s Applied Multivariate Biostatistics L11.1 Lecture 11: Canonical correlation analysis (CANCOR)
16 th CAA Cross-Calibration Workshop IRAP, Toulouse, 6-9 November20121 Removing strong solar array disturbances and telemetry errors from DC magnetic field.
Non-linear filtering Example: Median filter Replaces pixel value by median value over neighborhood Generates no new gray levels.
Martina Uray Heinz Mayer Joanneum Research Graz Institute of Digital Image Processing Horst Bischof Graz University of Technology Institute for Computer.
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
11/25/03 3D Model Acquisition by Tracking 2D Wireframes Presenter: Jing Han Shiau M. Brown, T. Drummond and R. Cipolla Department of Engineering University.
Descriptive Statistics The means for all but the C 3 features exhibit a significant difference between both classes. On the other hand, the variances for.
Last update on June 15, 2010 Doug Young Suh
Principal Component Analysis (PCA)
Dimension Reduction via PCA (Principal Component Analysis)
Techniques for studying correlation and covariance structure
AN ANALYSIS OF TWO COMMON REFERENCE POINTS FOR EEGS
Principles of the Global Positioning System Lecture 11
GOES DCC Deseasonalization & AHI DCC Calibration
Volume 49, Issue 3, Pages (February 2006)
Fig. 2 Comparison of the observed DRs and the estimates by the VR model and FL. Comparison of the observed DRs and the estimates by the VR model and FL.
Presentation transcript:

“Real-time” Transient Detection Algorithms Dr. Kang Hyeun Ji, Thomas Herring MIT

Algorithms The transient detection methods developed at MIT are a combination of state estimation and principal component analysis (PCA). The process noise states from a smoothing Kalman filter are used in PCA to compute eigenvalues that tell us the amount of power in a component and eigenvectors that tell us the spatial pattern of the component. Two approaches are possible for near real-time implementation of this type of algorithm: – A moving window approach where new data are added and old data removed and PCA recomputed. – Using the eigenvalue patterns from previously seen events to see if these events are re-occurring. We will examine this approach in this presentation.

Eigenvector Method Basic approach is to simply multiply the eigenvector of a selected candidate transient event by the daily updated time series residuals of the sites in the eigenvector. Site residuals are computed by detrending based on earlier data. Since most transients involve less than 50 sites, this calculation can be done very fast (basically dot- product of two component vectors (NE or NEU). Standard deviation of the result can be computed using conventional propagation of errors methods. Since “real-time” data will be missing sites at times, the eigenvector needs to be normalized to account for missing data. If all sites have equal weight, this normalization is by the amplitude squared of the eigenvector elements of the sites being used (when all sites present amplitude is 1). Simple product can be appended to on-going results each day. Estimate of standard deviation allow measure of significance of changes.

Examples We show three examples of applying this method: – Akutan volcano inflation event seen in Are there other events of this type in the PBO analyses of these data? – Cascadia slow slip events: Are the small event detectable with this method? – San Gabriel Valley 2005 water event. Can we detect more of these events and can this be used as a monitoring method for fluid injection and removal?

Akutan Volcano Inflation events Inflation event seen on Akutan Volcano in early (Black vectors PCA, Red Mogi model) Using the black vector spatial pattern, we compute the product with the time series of the sites as we would in a “real- time” approach. As a function of time we determine the amplitude of the spatial pattern

“Real-time application to Akutan (PBO time series) Blue is original smoothed state vector solution. Red dots are eigenvector product when all data are available. Black are times when some sites are missing and eigenvector is normalized. There is an indication of a weak inflation event starting in 2011 that had not been seen before.

Cascadia slow slip events Here we look for the pattern of the Jan 2007 event which is one of the largest ones since PBO GPS data analysis used for these tests. May 2008, 2009 and August 2010 have similar spatial pattern.

“Real-time” time series Blue is the full PCA analysis. Red are when all sites are available. Black values have some sites missing. NOTE: There is a small event associated with low levels of tremor in late 2007 which can be seen here (and is clearly seen with the full PCA analysis). Small ETS event

San Gabriel Valley 2005 rain event Heavy rains in 2005 caused a clear anomalous transient signal in the GPS sites around the San Gabriel Valley. Red Vectors here are the horizontal pattern and time series. Blue vectors are the height component. Apply red-eigenvectors to complete NE time series of the sites from the SCEC transient real data set.

Detrended time series of San Gabriel sites 2005 event 2005 event clearly seen, but are there other signals presents? Apply 2005 horizontal eigenvectors to SCEC time- series.

Blue is water level change at well in the center of the basin (arbitrary scale) event is not the only one that can now be seen in the horizontal motions of the GPS sites.

Same results with red 30-day averages of GPS results and water level “scaled” to GPS amplitude (0.4 mm/foot of water) with rate 1.4 mm/yr - Leakage of tectonic signal?). Correlation coefficient 0.92; 0.94 when water leads GPS by 2 months).

Summary The algorithm using eigenvectors from previous events works well and has shown some unexpected results already. Eigenvectors can be obtained from sources other than principal component analysis of transient events. Fast events and models are other possible sources. Algorithm is fast and simple. It could be implemented in csh/awk script or in a scripting language such as Python. We are working on eigenvector normalization when there are missing data and data with large uncertainties. For implementation, SCEC will probably need to handle update of new time series values (e.g. PBO generates rapids every day but sometime several days will be posted at nearly the same time. Similarly final (IGS final orbit) solutions are released in weekly batches so these releases need to be monitored to see which new data are available for inclusion in the algorithm.