The “ ” Paige in Kalman Filtering K. E. Schubert.

Slides:



Advertisements
Similar presentations
State Space Models. Let { x t :t T} and { y t :t T} denote two vector valued time series that satisfy the system of equations: y t = A t x t + v t (The.
Advertisements

Mobile Robot Localization and Mapping using the Kalman Filter
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Extended Kalman Filter (EKF) And some other useful Kalman stuff!
Dimension reduction (1)
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Newton’s Method Application to LMS Recursive Least Squares Exponentially-Weighted.
Observers and Kalman Filters
Visual Recognition Tutorial
Kalman’s Beautiful Filter (an introduction) George Kantor presented to Sensor Based Planning Lab Carnegie Mellon University December 8, 2000.
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
Mobile Intelligent Systems 2004 Course Responsibility: Ola Bengtsson.
SYSTEMS Identification
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
Prepared By: Kevin Meier Alok Desai
7. Least squares 7.1 Method of least squares K. Desch – Statistical methods of data analysis SS10 Another important method to estimate parameters Connection.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Course AE4-T40 Lecture 5: Control Apllication
Digital Control Systems STATE OBSERVERS. State Observers.
Kalman Filtering Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics TexPoint fonts used in EMF. Read.
Study of Sparse Online Gaussian Process for Regression EE645 Final Project May 2005 Eric Saint Georges.
Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;
1 Formation et Analyse d’Images Session 7 Daniela Hall 7 November 2005.
Principles of the Global Positioning System Lecture 11 Prof. Thomas Herring Room A;
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Lecture 11: Kalman Filters CS 344R: Robotics Benjamin Kuipers.
Kalman filtering techniques for parameter estimation Jared Barber Department of Mathematics, University of Pittsburgh Work with Ivan Yotov and Mark Tronzo.
Computer vision: models, learning and inference Chapter 19 Temporal models.
The Kalman Filter ECE 7251: Spring 2004 Lecture 17 2/16/04
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
2 Introduction to Kalman Filters Michael Williams 5 June 2003.
University of Colorado Boulder ASEN 5070 Statistical Orbit determination I Fall 2012 Professor George H. Born Professor Jeffrey S. Parker Lecture 11: Batch.
Pg 1 of 10 AGI Sherman’s Theorem Fundamental Technology for ODTK Jim Wright.
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
ECE-7000: Nonlinear Dynamical Systems Overfitting and model costs Overfitting  The more free parameters a model has, the better it can be adapted.
An Introduction to Kalman Filtering by Arthur Pece
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
Dept. E.E./ESAT-STADIUS, KU Leuven
An Introduction To The Kalman Filter By, Santhosh Kumar.
Introducing Error Co-variances in the ARM Variational Analysis Minghua Zhang (Stony Brook University/SUNY) and Shaocheng Xie (Lawrence Livermore National.
Using Kalman Filter to Track Particles Saša Fratina advisor: Samo Korpar
Nonlinear State Estimation
Cameron Rowe.  Introduction  Purpose  Implementation  Simple Example Problem  Extended Kalman Filters  Conclusion  Real World Examples.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
Regularization of energy-based representations Minimize total energy E p (u) + (1- )E d (u,d) E p (u) : Stabilizing function - a smoothness constraint.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
Robust Localization Kalman Filter & LADAR Scans
DSP-CIS Part-III : Optimal & Adaptive Filters Chapter-9 : Kalman Filters Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
Least Squares Measurement model Weighted LSQ  Optimal estimates  Linear  Unbiased  Minimum variance.
Probabilistic Robotics Bayes Filter Implementations Gaussian filters.
Biointelligence Laboratory, Seoul National University
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
Probability Theory and Parameter Estimation I
STATISTICAL ORBIT DETERMINATION Coordinate Systems and Time Kalman Filtering ASEN 5070 LECTURE 21 10/16/09.
PSG College of Technology
Kalman’s Beautiful Filter (an introduction)
Unscented Kalman Filter
Probabilistic Robotics
Kalman Filtering: Control with Limited/Noisy Measurements
Lecture 10: Observers and Kalman Filters
Filtering and State Estimation: Basic Concepts
Unscented Kalman Filter
Bayes and Kalman Filter
State Space Models.
Principles of the Global Positioning System Lecture 11
Principles of the Global Positioning System Lecture 13
NONLINEAR AND ADAPTIVE SIGNAL ESTIMATION
Kalman Filter: Bayes Interpretation
16. Mean Square Estimation
NONLINEAR AND ADAPTIVE SIGNAL ESTIMATION
Presentation transcript:

The “ ” Paige in Kalman Filtering K. E. Schubert

Kalman’s Interest State Space (Matrix Representation) Discrete Time (difference equations) Optimal Control Starting at x 0  Go to x G Minimize or maximize some quantity (time, energy, etc.)

Why Filtering? State (x i ) is not directly known Must observe through minimum measurements Observer Equation Want to reconstruct the state vector

Random Variables Process and observation noise Independent, white Gaussian noise y=ax+b

Complete Problem Control and estimation are independent Concerned only with observer Obtain estimate:

Predictor-Corrector Measurements Predict (Time Update) Correct (Measurement Update)

To Err Is Kalman! How accurate is the estimate? What is its distribution?

Predictor-Corrector Measurements Predict (Time Update) Correct (Measurement Update)

Predict No random variable You don’t know it Eigenvalues must be <1 (For convergence) Distribution does effect error covariance

Correct Kalman Gain Innovations (What’s New) Oblique Projection

System 1 (Basic Example) X  2, Companion Form Nice but not perfect numerics and stability

System 1

System 1 (Again) X  2, Companion Form Nice but not perfect numerics and stability

System 1

System 2 (Stiffness) X  2, Large Eigenvalue Spread Condition number around 10 9 Large sampling time (big steps)

System 2

Trouble in Paradise Inversion in the Kalman gain is slow and generally not stable A is usually in companion form numerically unstable (Laub) Covariance are symmetric positive definite Calculation cause P to become unsymmetric then lose positivity

Square Root Filters Kailath suggested propegating the square root rather than the whole covariance Not really square root, actually Choleski Factor r T r=R Use on R w, R v, P

Our Square Roots

State Error

Observations

Measurement Equation

Measurement Update Then, by definition

Updating for Free?

Error Part 2

Time Updating

Paige’s Filter

System 3 (Fun Problem) X  20, Known difficult matrix that was scaled to be stable

System 3

Conclusions Called Paige’s filter but really Paige and Saunders developed O(n 3 ) and about 60% faster than regular square root Current interests: faster, special structures, robustness