Impacts of Systematic Error Reduction on CAM3.1 Sensitivity to CO2 Forcing Charles Jackson (1) Yi Deng (1) Gabriel Huerta (2) Mrinal Sen (1) (1)Institute.

Slides:



Advertisements
Similar presentations
1 Uncertainty in rainfall-runoff simulations An introduction and review of different techniques M. Shafii, Dept. Of Hydrology, Feb
Advertisements

CSCE643: Computer Vision Bayesian Tracking & Particle Filtering Jinxiang Chai Some slides from Stephen Roth.
Uncertainty Quantification & the PSUADE Software
Ordinal Optimization. Copyright by Yu-Chi Ho2 Some Additional Issues F Design dependent estimation noises vs. observation noise F Goal Softening to increase.
Februar 2003 Workshop Kopenhagen1 Assessing the uncertainties in regional climate predictions of the 20 th and 21 th century Andreas Hense Meteorologisches.
Bayesian Estimation in MARK
TNO orbit computation: analysing the observed population Jenni Virtanen Observatory, University of Helsinki Workshop on Transneptunian objects - Dynamical.
Approaches to Data Acquisition The LCA depends upon data acquisition Qualitative vs. Quantitative –While some quantitative analysis is appropriate, inappropriate.
Aerosol radiative effects from satellites Gareth Thomas Nicky Chalmers, Caroline Poulsen, Ellie Highwood, Don Grainger Gareth Thomas - NCEO/CEOI-ST Joint.
Sérgio Pequito Phd Student
YODEN Shigeo Dept. of Geophysics, Kyoto Univ., JAPAN March 3-4, 2005: SPARC Temperature Trend Meeting at University of Reading 1.Introduction 2.Statistical.
Today Introduction to MCMC Particle filters and MCMC
End of Chapter 8 Neil Weisenfeld March 28, 2005.
Probabilistic Robotics Bayes Filter Implementations Particle filters.
The importance of clouds. The Global Climate System
Extreme Value Analysis, August 15-19, Bayesian analysis of extremes in hydrology A powerful tool for knowledge integration and uncertainties assessment.
Lecture II-2: Probability Review
Indian Ocean warming – its extent, and impact on the monsoon and marine productivity Roxy M. K. 1, K. Ritika 1, A. Modi 1, P. Terray 2, R. Murtugudde 3,
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
WSEAS AIKED, Cambridge, Feature Importance in Bayesian Assessment of Newborn Brain Maturity from EEG Livia Jakaite, Vitaly Schetinin and Carsten.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Short (Few-day) Simulations for Efficient Model Evaluation, Tuning and Calibration: Strategy, Framework and Early Results Atmosphere Group, Short Simulations.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
WWOSC 2014, Aug 16 – 21, Montreal 1 Impact of initial ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model.
Assimilation of HF Radar Data into Coastal Wave Models NERC-funded PhD work also supervised by Clive W Anderson (University of Sheffield) Judith Wolf (Proudman.
1 Estimation From Sample Data Chapter 08. Chapter 8 - Learning Objectives Explain the difference between a point and an interval estimate. Construct and.
Computer Science, Software Engineering & Robotics Workshop, FGCU, April 27-28, 2012 Fault Prediction with Particle Filters by David Hatfield mentors: Dr.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Markov Random Fields Probabilistic Models for Images
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
Ben Kirtman University of Miami-RSMAS Disentangling the Link Between Weather and Climate.
CAMELS CCDAS A Bayesian approach and Metropolis Monte Carlo method to estimate parameters and uncertainties in ecosystem models from eddy-covariance data.
1 A Comparison of Information Management using Imprecise Probabilities and Precise Bayesian Updating of Reliability Estimates Jason Matthew Aughenbaugh,
Application of the MCMC Method for the Calibration of DSMC Parameters James S. Strand and David B. Goldstein The University of Texas at Austin Sponsored.
MCMC reconstruction of the 2 HE cascade events Dmitry Chirkin, UW Madison.
Advanced uncertainty evaluation of climate models and their future climate projections H Järvinen, P Räisänen, M Laine, J Tamminen, P Ollinaho Finnish.
Bayesian Travel Time Reliability
J. Jasche, Bayesian LSS Inference Jens Jasche La Thuile, 11 March 2012 Bayesian Large Scale Structure inference.
Uncertainty Quantification in Climate Prediction Charles Jackson (1) Mrinal Sen (1) Gabriel Huerta (2) Yi Deng (1) Ken Bowman (3) (1)Institute for Geophysics,
G. Cowan Lectures on Statistical Data Analysis Lecture 8 page 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem 2Random variables and.
Robert W. Pinder, Alice B. Gilliland, Robert C. Gilliam, K. Wyat Appel Atmospheric Modeling Division, NOAA Air Resources Laboratory, in partnership with.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Estimating climate variability over the next 1-25 years Dr Scott Power Dr Scott Power IOCI, August 2005 IOCI, August 2005.
Hybrid Bayesian Linearized Acoustic Inversion Methodology PhD in Petroleum Engineering Fernando Bordignon Introduction Seismic inversion.
Introduction to emulators Tony O’Hagan University of Sheffield.
Institute of Statistics and Decision Sciences In Defense of a Dissertation Submitted for the Degree of Doctor of Philosophy 26 July 2005 Regression Model.
Monte Carlo Sampling to Inverse Problems Wojciech Dębski Inst. Geophys. Polish Acad. Sci. 1 st Orfeus workshop: Waveform inversion.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Markov Chain Monte Carlo in R
Reducing Photometric Redshift Uncertainties Through Galaxy Clustering
GEOGG121: Methods Monte Carlo methods, revision
Emission metrics inferred from regional aerosol perturbations
How Good is a Model? How much information does AIC give us?
Ch3: Model Building through Regression
Overview G. Jogesh Babu.
Special Topics In Scientific Computing
Predictive distributions
Asha Vijayeta & Dietmar Dommenget
Filtering and State Estimation: Basic Concepts
Lecture 2 – Monte Carlo method in finance
POINT ESTIMATOR OF PARAMETERS
Ch13 Empirical Methods.
Biointelligence Laboratory, Seoul National University
Graduate School of Information Sciences, Tohoku University
Opinionated Lessons #39 MCMC and Gibbs Sampling in Statistics
VQMC J. Planelles.
Presentation transcript:

Impacts of Systematic Error Reduction on CAM3.1 Sensitivity to CO2 Forcing Charles Jackson (1) Yi Deng (1) Gabriel Huerta (2) Mrinal Sen (1) (1)Institute for Geophysics, The University of Texas at Austin (2) Department of Statistics, University of New Mexico

In some cases, reducing systematic errors may not be better. There may exist multiple “solutions” –Non-linearities –Compensating errors –Trade-offs

Observed

Nino 3 IndexHistogram observation WWSH SWDH WWDH Var = 0.65 Skew = 0.72 Kurt = 4.0 Var = 0.61 Skew=0.92 Kur=3.3 Var =0.74 Skew= 0.92 Kurt = 4.1 Var=0.65 Skew=0.20 Kurt=3.2 cost = cost = cost = 0.057

Skewness Variance Period WWSH WWDHSWDH Thermocline depth Zonal Wind Strength

Mean thermocline depth (m) Strength of Mean Wind 2D Marginal PPD  (day)  H (m) noisewinds WWSH WWDH SWDH Subsurface Sensitivity Strength of Noise

(IPCC 2001)

Bayesian Stochastic Inversion Bayes’ Theorem Ф, parameters; Х, observations; P(Ф|Х), probability of Ф given X. Likelihood Jackson, C., M. K. Sen, and P. L. Stoffa, 2004, J. Climate, 17, BSI provides a way to sample wide regions of parameter space and to summarize the results in terms of a relative probability. P(Х|Ф) = exp(- cost) small cost ↔ large likelihood

Methods to estimate multi- dimensional probability distributions Grid Search Monte Carlo (random sampling) Metropolis/Gibbs’ Sampler (MCMC) Bayesian Stochastic Inversion using multiple Very Fast Simulated Annealing (Sen and Stoffa, 1996).

Probability density functions for 3 parameters: VFSA Metropolis VFSA Metropolis Grid Search (Jackson et al., JCL 2004)

Definition of cost function

Definition of model-observational data mismatch (Mu et al., JGR 2004)

Status Considering 6 free parameters important to clouds and (deep) convection T42 CAM3.1, forced by observed SST March 1990 to February ~250 experiments have been completed. Of these, ~95 got cost values lower than the default case. Average improvement in cost value is 7%.

DefaultLine 1, gen 48 Line 2, gen 31 Line 3, gen 34 Line 4, gen 43 Line 5, gen 31 Line 6, gen 35 Total~ CLDLOW CLDMED CLDHGH FSDS FSNT FLNT BALANCE TREFHT SHFLX LHFLX RELHUM T U PSL PRECT

climateprediction.net 27,000 experiments completed in past year on 10,000 personal computers

(Stainforth et al., Nature 2005)

(Deng et al., GRL, in press)

Review of results BSI was able to identify multiple model configurations that improved CAM3.1 skill scores by 7%. (Experiments ongoing, only ¼ way through to completion.) IPCC reports suggest large uncertainties are not going away…(fundamental?) –We found surprisingly little spread among models that explored parameters thought to be sources of uncertainty. Despite agreement at a global scale, parametric uncertainties lead to significant scatter in predictions of regional climates. Although higher order statistics were not included in cost function, there were substantial improvements in predictions of heavy rainfall rates.