Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction.

Slides:



Advertisements
Similar presentations
Introduction to Stock Synthesis
Advertisements

Introduction to Monte Carlo Markov chain (MCMC) methods
MCMC estimation in MlwiN
1 -Classification: Internal Uncertainty in petroleum reservoirs.
INTRODUCTION TO MACHINE LEARNING Bayesian Estimation.
Bayesian inference of normal distribution
Pattern Recognition and Machine Learning
Probability and Statistics Basic concepts II (from a physicist point of view) Benoit CLEMENT – Université J. Fourier / LPSC
Lecture 2: Parameter Estimation and Evaluation of Support.
Uncertainty and confidence intervals Statistical estimation methods, Finse Friday , 12.45–14.05 Andreas Lindén.
1 Parametric Sensitivity Analysis For Cancer Survival Models Using Large- Sample Normal Approximations To The Bayesian Posterior Distribution Gordon B.
Chapter 4: Linear Models for Classification
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
Bayesian statistics – MCMC techniques
SPREADSHEETS IN EDUCATION OF LOGISTICS MANAGERS AT FACULTY OF ORGANIZATIONAL SCIENCES: AN EXAMPLE OF INVENTORY DYNAMICS SIMULATION L. Djordjevic, D. Vasiljevic.
Computing the Posterior Probability The posterior probability distribution contains the complete information concerning the parameters, but need often.
Making rating curves - the Bayesian approach. Rating curves – what is wanted? A best estimate of the relationship between stage and discharge at a given.
Computational challenges in assessment of marine resources Hans Julius skaug Talk given at Inst. of Informatics, UiB Nov. 28, 2002.
Data Analytics and Dynamic Languages Lee E. Edlefsen, Ph.D. VP of Engineering 1.
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
USE OF LAPLACE APPROXIMATIONS TO SIGNIFICANTLY IMPROVE THE EFFICIENCY
Linear Regression Models Based on Chapter 3 of Hastie, Tibshirani and Friedman Slides by David Madigan.
Machine Learning CMPT 726 Simon Fraser University
End of Chapter 8 Neil Weisenfeld March 28, 2005.
Introduction to template model builder, an improved tool for maximum likelihood and mixed-effects models in R James Thorson.
Rao-Cramer-Frechet (RCF) bound of minimum variance (w/o proof) Variance of an estimator of single parameter is limited as: is called “efficient” when the.
Robert M. Saltzman © DS 851: 4 Main Components 1.Applications The more you see, the better 2.Probability & Statistics Computer does most of the work.
Empirical Financial Economics 2. The Efficient Markets Hypothesis - Generalized Method of Moments Stephen Brown NYU Stern School of Business UNSW PhD Seminar,
Department of Geography, Florida State University
Bayes Factor Based on Han and Carlin (2001, JASA).
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
The BioAnalytics Group LLC Global Optimization Toolkit Project First Prototype Delivery.
Model Inference and Averaging
Introduction to MCMC and BUGS. Computational problems More parameters -> even more parameter combinations Exact computation and grid approximation become.
Sparse Gaussian Process Classification With Multiple Classes Matthias W. Seeger Michael I. Jordan University of California, Berkeley
Comparison of Bayesian Neural Networks with TMVA classifiers Richa Sharma, Vipin Bhatnagar Panjab University, Chandigarh India-CMS March, 2009 Meeting,
Overview of Supervised Learning Overview of Supervised Learning2 Outline Linear Regression and Nearest Neighbors method Statistical Decision.
Mean Field Variational Bayesian Data Assimilation EGU 2012, Vienna Michail Vrettas 1, Dan Cornford 1, Manfred Opper 2 1 NCRG, Computer Science, Aston University,
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Multilevel Modeling Software Wayne Osgood Crime, Law & Justice Program Department of Sociology.
17 May 2007RSS Kent Local Group1 Quantifying uncertainty in the UK carbon flux Tony O’Hagan CTCD, Sheffield.
An Efficient Sequential Design for Sensitivity Experiments Yubin Tian School of Science, Beijing Institute of Technology.
PROCESS MODELLING AND MODEL ANALYSIS © CAPE Centre, The University of Queensland Hungarian Academy of Sciences Statistical Model Calibration and Validation.
Texas A&M University, Department of Aerospace Engineering AN EMBEDDED FUNCTION TOOL FOR MODELING AND SIMULATING ESTIMATION PROBLEMS IN AEROSPACE ENGINEERING.
Bayesian Approach For Clinical Trials Mark Chang, Ph.D. Executive Director Biostatistics and Data management AMAG Pharmaceuticals Inc.
Lecture 2: Statistical learning primer for biologists
Semi-mechanistic modelling in Nonlinear Regression: a case study by Katarina Domijan 1, Murray Jorgensen 2 and Jeff Reid 3 1 AgResearch Ruakura 2 University.
Multilevel and multifrailty models. Overview  Multifrailty versus multilevel Only one cluster, two frailties in cluster e.g., prognostic index (PI) analysis,
CS Statistical Machine learning Lecture 12 Yuan (Alan) Qi Purdue CS Oct
Stochastic Loss Reserving with the Collective Risk Model Glenn Meyers ISO Innovative Analytics Casualty Loss Reserving Seminar September 18, 2008.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Matrix Models for Population Management & Conservation March 2014 Lecture 10 Uncertainty, Process Variance, and Retrospective Perturbation Analysis.
Parameter Estimation. Statistics Probability specified inferred Steam engine pump “prediction” “estimation”
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Estimating Uncertainty. Estimating Uncertainty in ADMB Model parameters and derived quantities Normal approximation Profile likelihood Bayesian MCMC Bootstrap.
A framework for multiple imputation & clustering -Mainly basic idea for imputation- Tokei Benkyokai 2013/10/28 T. Kawaguchi 1.
Density Estimation in R Ha Le and Nikolaos Sarafianos COSC 7362 – Advanced Machine Learning Professor: Dr. Christoph F. Eick 1.
Jump to first page Bayesian Approach FOR MIXED MODEL Bioep740 Final Paper Presentation By Qiang Ling.
Introduction to emulators Tony O’Hagan University of Sheffield.
Institute of Statistics and Decision Sciences In Defense of a Dissertation Submitted for the Degree of Doctor of Philosophy 26 July 2005 Regression Model.
Probability and Likelihood. Likelihood needed for many of ADMB’s features Standard deviation Variance-covariance matrix Profile likelihood Bayesian MCMC.
Introduction We consider the data of ~1800 phenotype measurements Each mouse has a given probability distribution of descending from one of 8 possible.
An Introduction to AD Model Builder PFRP
Markov Chain Monte Carlo in R
ICS 280 Learning in Graphical Models
Model Inference and Averaging
Jon Brodziak1, Teresa A’mar2 , Matthew Supernaw2,
Unfolding Problem: A Machine Learning Approach
Uncertainty Propagation
Presentation transcript:

Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction to AD Model Builder

What is AD Model Builder Tool for developing nonlinear models Efficient estimation of model parameters C++ libraries Template

Simplifying the development of models Removes the need to manage the interface between the model parameters and function minimizer. The template makes it easy to input and output data from the model, set up the parameters to estimate, and set up objective function to optimize (minimize). Adding additional estimable parameters or converting fixed parameters into estimable parameters is a simple process. ADMB is very flexible because model code is in C++ Can create your own libraries

Efficient and stable function minimizer Analytical derivatives –Adjoint code –Chain rule More efficient and stable than other packages that use finite difference approximation. Stepwise process to sequentially estimate the parameters Bounds on all estimated parameters that restrict the range of possible parameter values.

MCMC algorithm for Bayesian integration Starts at the mode of the posterior reduces the burn-in time. Jumping rules based on the variance- covariance estimates at the mode of the posterior distribution

Automated likelihood profiles Normal approximation of confidence intervals based on the Hessian matrix and derived quantities using the delta method Automatically calculate likelihood profiles for model parameters and derived quantities producing asymmetrical confidence intervals

Random effects parameters Random effects parameters implemented using Laplace’s approximation (and importance sampling) Automatic analytical second derivatives. Use for process error, state space models, meta analysis

Matrix algebra Matrix algebra with associated precompiled adjoint code for derivative calculations Can greatly reduce computation time and memory usage compared to loops

Other features non-linear programming solver numerical integration routine random number generation high dimensional and ragged arrays estimation of the variance-covariance matrix dynamic link libraries with other software products (e.g. s- plus, Excel, Visual Basic) safe mode compiling for bounds checking ability to make ADMB C++ libraries. Parallel processing

What its good for: Highly parameterize nonlinear models Thousands of parameters Combining many data sets or analyses General Models

What its good for: Numerous optimizations of the objective function Simulation analysis Likelihood profiles Bootstrap/cross validation Model testing/sensitivity analysis Management strategy evaluation

What its good for: Nonlinear mixed effects models Crossed random effects Nonlinear state-space models.

Outline Overview 9:00-10:30 Introduction, installation, and simple example Modeling and likelihood Example: Least squares regression Exercise: Create your own simple example: estimate the mean and variance using a likelihood function Uncertainty 11:00-12:30 Delta method, Profile likelihood, and MCMC Example: Beverton-Holt recruitment model Exercise: Beverton-Holt recruitment model comparing sequential Bayesian versus integrated analyses. Input, output, and model control Data input, parameter control, and outputting results Example: Plankton sampler Exercise: Adding an additional covariate to the model Random effects (hierarchical) models: Frequentist and Bayesian :00 Laplace approximation in ADMB. Example: State-space model with Poisson observations. Exercise: Convert a WinBUGS example to ADMB

Instalation Who has successfully installed ADMB