Geology 5670/6670 Inverse Theory 18 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1; Constrained optimization for nonlinear problems.

Slides:



Advertisements
Similar presentations
Factorial Mixture of Gaussians and the Marginal Independence Model Ricardo Silva Joint work-in-progress with Zoubin Ghahramani.
Advertisements

Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory 123 “True” Constrained Minimization.
1 Low-Dose Dual-Energy CT for PET Attenuation Correction with Statistical Sinogram Restoration Joonki Noh, Jeffrey A. Fessler EECS Department, The University.
Computer vision: models, learning and inference Chapter 8 Regression.
CSCI 347 / CS 4206: Data Mining Module 07: Implementations Topic 03: Linear Models.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
Graph Laplacian Regularization for Large-Scale Semidefinite Programming Kilian Weinberger et al. NIPS 2006 presented by Aggeliki Tsoli.
The loss function, the normal equation,
Visual Recognition Tutorial
Lecture 5 A Priori Information and Weighted Least Squared.
Inverse Problems in Geophysics
458 Interlude (Optimization and other Numerical Methods) Fish 458, Lecture 8.
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Maximum likelihood (ML) and likelihood ratio (LR) test
Lecture 8 The Principle of Maximum Likelihood. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
Lecture 11 Vector Spaces and Singular Value Decomposition.
Martin Burger Total Variation 1 Cetraro, September 2008 Numerical Schemes Wrap up approximate formulations of subgradient relation.
Linear Discriminant Functions Chapter 5 (Duda et al.)
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
More About Inverse Problems: Another Example Inverting for density.
Geology 5670/6670 Inverse Theory 26 Jan 2015 © A.R. Lowry 2015 Read for Wed 28 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares (   Statistics)
GEO7600 Inverse Theory 09 Sep 2008 Inverse Theory: Goals are to (1) Solve for parameters from observational data; (2) Know something about the range of.
Computer vision: models, learning and inference Chapter 19 Temporal models.
Linear(-ized) Inverse Problems
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
Fitting a line to N data points – 1 If we use then a, b are not independent. To make a, b independent, compute: Then use: Intercept = optimally weighted.
Discriminant Functions
Probabilistic Robotics Bayes Filter Implementations.
MA/CS 375 Fall MA/CS 375 Fall 2002 Lecture 31.
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
ECE 8443 – Pattern Recognition LECTURE 10: HETEROSCEDASTIC LINEAR DISCRIMINANT ANALYSIS AND INDEPENDENT COMPONENT ANALYSIS Objectives: Generalization of.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION ASEN 5070 LECTURE 11 9/16,18/09.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION The Minimum Variance Estimate ASEN 5070 LECTURE.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Linear Models for Classification
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
The chi-squared statistic  2 N Measures “goodness of fit” Used for model fitting and hypothesis testing e.g. fitting a function C(p 1,p 2,...p M ; x)
An Introduction to Optimal Estimation Theory Chris O´Dell AT652 Fall 2013.
Inverse Problems in Geophysics
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 12: Advanced Discriminant Analysis Objectives:
Introducing Error Co-variances in the ARM Variational Analysis Minghua Zhang (Stony Brook University/SUNY) and Shaocheng Xie (Lawrence Livermore National.
Gradient Methods In Optimization
Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 ( ) Last time: Nonlinear Inversion Solution appraisal.
Geology 5670/6670 Inverse Theory 27 Feb 2015 © A.R. Lowry 2015 Read for Wed 25 Feb: Menke Ch 9 ( ) Last time: The Sensitivity Matrix (Revisited)
Geology 5670/6670 Inverse Theory 28 Jan 2015 © A.R. Lowry 2015 Read for Fri 30 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares: Uncertainty The.
Geology 5670/6670 Inverse Theory 16 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1 Expect Assignment 2 on Wed or Fri of this week!
Geology 5660/6660 Applied Geophysics 27 Jan 2016 © A.R. Lowry 2016 Read for Fri 29 Jan: Burger (Ch 3-3.2) Last time: Seismic Amplitude depends on.
Statistical Models of Appearance for Computer Vision 主講人:虞台文.
CWR 6536 Stochastic Subsurface Hydrology
Dario Grana and Tapan Mukerji Sequential approach to Bayesian linear inverse problems in reservoir modeling using Gaussian mixture models SCRF Annual Meeting,
Numerical Analysis – Data Fitting Hanyang University Jong-Il Park.
Using Neumann Series to Solve Inverse Problems in Imaging Christopher Kumar Anand.
Earth models for early exploration stages PETROLEUM ENGINEERING ÂNGELA PEREIRA Introduction Frontier basins and unexplored.
Geology 5670/6670 Inverse Theory 6 Feb 2015 © A.R. Lowry 2015 Read for Mon 9 Feb: Menke Ch 5 (89-114) Last time: The Generalized Inverse; Damped LS The.
Geology 5670/6670 Inverse Theory 20 Mar 2015 © A.R. Lowry 2015 Last time: Cooperative/Joint Inversion Cooperative or Joint Inversion uses two different.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
Linear Discriminant Functions Chapter 5 (Duda et al.) CS479/679 Pattern Recognition Dr. George Bebis.
Bounded Nonlinear Optimization to Fit a Model of Acoustic Foams
LECTURE 11: Advanced Discriminant Analysis
Latent Variables, Mixture Models and EM
CS5321 Numerical Optimization
High Resolution AVO NMO
Nonlinear Fitting.
Bayesian Classification
The loss function, the normal equation,
Mathematical Foundations of BME Reza Shadmehr
Presentation transcript:

Geology 5670/6670 Inverse Theory 18 Mar 2015 © A.R. Lowry 2015 Last time: Review of Inverse Assignment 1; Constrained optimization for nonlinear problems Quadratic & linear programming approaches are not applicable to iterative inversion of nonlinear problems Instead, may use Constrained Optimization approaches including:  Projection (“reflection”) at a bound (nonlinear programming)  Penalty functions added to the objective function:  Parameter transformations (Positivity constraints using log(m) or Bounds using the erf function)

Can we use stochastic inversion in the context of nonlinear inversion? Recall that linear stochastic inversion solves for the difference in model parameters from an a priori expected value,, given a model parameter covariance matrix and using the generalized inverse: One could do this also with e.g. a gradient search algorithm, using a starting model, but since both SI and the Taylor series nonlinear inversion calculate a model parameter perturbation  m, this would take the gradient search from an iterative algorithm to a one-step approach… Unless either the model expected values or covariance matrix was updated after each iteration!

Cooperative Inversion: (Also called “ Joint Inversion ”) Suppose we have two very different sets of data that can describe overlapping sets of model parameters. Geophysical example: A cylindrical body with known radius 10 m, from both gravity and magnetic data: Gravity: Magnetics: Then we create a new objective function: z x ,k,k

The trick lies in appropriately weighting the two pieces of the objective function. (The two contributions must be weighted somehow, because the relative “scaling” of the measurements inevitably is “arbitrary” unless the expected value and variance of each measurement is somehow independently known). Ideally the measurement variance is known, in which case we should use: If measurement errors are not known a priori, then have to define the weight-scheme empirically (i.e., trial & error)…

E.g. joint inversion of seismic P and S reflections: Synthetic seismograms from well logs using Zoeppritz’ equations Margrave et al., Leading Edge, 2001

E.g. joint inversion of seismic P and S reflections: Inverted P-wave impedance at top of a producing channel: