Fuzzy arithmetic is not a conservative way to do risk analysis Scott Ferson and Lev Ginzburg Applied Biomathematics

Slides:



Advertisements
Similar presentations
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. A PowerPoint Presentation Package to Accompany Applied Statistics.
Advertisements

Lecture 2 ANALYSIS OF VARIANCE: AN INTRODUCTION
Chapter 4 Inference About Process Quality
Estimation of Means and Proportions
Assessing Uncertainty when Predicting Extreme Flood Processes.
SE503 Advanced Project Management Dr. Ahmed Sameh, Ph.D. Professor, CS & IS Project Uncertainty Management.
Sensitivity Analysis In deterministic analysis, single fixed values (typically, mean values) of representative samples or strength parameters or slope.
Hypothesis Testing IV Chi Square.
BAYESIAN POSTERIOR DISTRIBUTIONS FOR PROBABILISTIC SENSITIVITY ANALYSIS Gordon B. Hazen and Min Huang, IEMS Department, Northwestern University, Evanston.
Sensitivity and Scenario Analysis
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 19 Confidence Intervals for Proportions.
Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?
Chapter 8 Estimating Single Population Parameters
GG 313 Lecture 7 Chapter 2: Hypothesis Testing Sept. 13, 2005.
Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.
Projecting uncertainty through nonlinear ODEs Youdong Lin 1, Mark Stadherr 1, George Corliss 2, Scott Ferson 3 1 University of Notre Dame 2 Marquette University.
Copyright © 2014, 2013, 2010 and 2007 Pearson Education, Inc. Chapter Hypothesis Tests Regarding a Parameter 10.
Statistical Treatment of Data Significant Figures : number of digits know with certainty + the first in doubt. Rounding off: use the same number of significant.
Ch. 9 Fundamental of Hypothesis Testing
Lecture II-2: Probability Review
Monte Carlo Schedule Analysis The Concept, Benefits and Limitations Intaver Institute Inc. 303, 6707, Elbow Drive S.W, Calgary, AB, Canada Tel: +1(403)
1 Assessment of Imprecise Reliability Using Efficient Probabilistic Reanalysis Farizal Efstratios Nikolaidis SAE 2007 World Congress.
Quantitative Methods – Week 7: Inductive Statistics II: Hypothesis Testing Roman Studer Nuffield College
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
AM Recitation 2/10/11.
Jeopardy Hypothesis Testing T-test Basics T for Indep. Samples Z-scores Probability $100 $200$200 $300 $500 $400 $300 $400 $300 $400 $500 $400.
Example 16.1 Ordering calendars at Walton Bookstore
Untangling equations involving uncertainty Scott Ferson, Applied Biomathematics Vladik Kreinovich, University of Texas at El Paso W. Troy Tucker, Applied.
Psy B07 Chapter 4Slide 1 SAMPLING DISTRIBUTIONS AND HYPOTHESIS TESTING.
1 Chapter 18 Sampling Distribution Models. 2 Suppose we had a barrel of jelly beans … this barrel has 75% red jelly beans and 25% blue jelly beans.
Properties of OLS How Reliable is OLS?. Learning Objectives 1.Review of the idea that the OLS estimator is a random variable 2.How do we judge the quality.
5.1 Chapter 5 Inference in the Simple Regression Model In this chapter we study how to construct confidence intervals and how to conduct hypothesis tests.
Calculating Risk of Cost Using Monte Carlo Simulation with Fuzzy Parameters in Civil Engineering Michał Bętkowski Andrzej Pownuk Silesian University of.
VI. Regression Analysis A. Simple Linear Regression 1. Scatter Plots Regression analysis is best taught via an example. Pencil lead is a ceramic material.
Uncertainty Management in Rule-based Expert Systems
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
Chapter 12 Confidence Intervals and Hypothesis Tests for Means © 2010 Pearson Education 1.
1 / 12 Michael Beer, Vladik Kreinovich COMPARING INTERVALS AND MOMENTS FOR THE QUANTIFICATION OF COARSE INFORMATION M. Beer University of Liverpool V.
© Copyright McGraw-Hill 2004
“Principles of Soft Computing, 2 nd Edition” by S.N. Sivanandam & SN Deepa Copyright  2011 Wiley India Pvt. Ltd. All rights reserved. CHAPTER 11 FUZZY.
Copyright © Cengage Learning. All rights reserved. 5 Joint Probability Distributions and Random Samples.
In Bayesian theory, a test statistics can be defined by taking the ratio of the Bayes factors for the two hypotheses: The ratio measures the probability.
+ Chapter 8 Estimating with Confidence 8.1Confidence Intervals: The Basics 8.2Estimating a Population Proportion 8.3Estimating a Population Mean.
© 2010 Pearson Prentice Hall. All rights reserved Chapter Hypothesis Tests Regarding a Parameter 10.
Chapter 10 Confidence Intervals for Proportions © 2010 Pearson Education 1.
Chapter 8: Estimating with Confidence
Uncertainty Analysis in Emission Inventories
Prepared by Lloyd R. Jaisingh
Unit 3 Hypothesis.
Uncertainty Analysis in Emission Inventories
Chapter 8: Estimating with Confidence
Morgan Bruns1, Chris Paredis1, and Scott Ferson2
Statistics Review ChE 477 Winter 2018 Dr. Harding.
Lecture 2 – Monte Carlo method in finance
Chapter 8: Estimating with Confidence
Counting Statistics and Error Prediction
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Tutorial 10: Limit Theorems
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
2/5/ Estimating a Population Mean.
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Distribution-free Monte Carlo for population viability analysis
Untangling equations involving uncertainty
Chapter 8: Estimating with Confidence
Dr. Arslan Ornek MATHEMATICAL MODELS
Presentation transcript:

Fuzzy arithmetic is not a conservative way to do risk analysis Scott Ferson and Lev Ginzburg Applied Biomathematics

Abstract The three chief disadvantages of Monte Carlo methods are computational burden, sensitivity to uncertainty about input distribution shapes and the need to assume correlations among all inputs. Fuzzy arithmetic, which is computationally simple, robust to moderate changes in the shapes on input distributions and does not require the analyst to assume particular correlations among inputs, might therefore be considered a prime alternative calculus for propagating uncertainty in risk assessments. Theorists suggest that fuzzy measures are upper bounds on probability measures. By selecting fuzzy inputs that enclose the analogous probability distributions, one might therefore expect to be able to obtain a conservative (bounding) analysis more cheaply, conveniently and reliably than is possible with Monte Carlo methods. With a simple counterexample, however, we show that fuzzy arithmetic is not conservative to uncertainty about input shapes or correlations. While it may have uses in specialized analyses, fuzzy arithmetic may not be appropriate for routine use in risk assessments concerned primarily with variability and incertitude (measurement error).

Monte Carlo Used to propagate uncertainty and variability through risk assessments But you have to specify –precise input distributions –particular correlation and dependency assumptions If you’re not sure about these, the assessment could be wrong

Fuzzy arithmetic might be useful Distributions don’t have to be precise Requires no assumption about correlations Fuzzy measures are upper bounds on probability Fuzzy arithmetic might be a conservative way to do risk assessments that is more reliable and less demanding than Monte Carlo

Fuzzy numbers and their arithmetic Fuzzy numbers –Fuzzy sets of the real line –Unimodal –Reach possibility level one Fuzzy arithmetic –Interval arithmetic at each possibility level Possibility

Level-wise interval arithmetic a b a+b Possibility +=

Features of fuzzy arithmetic Fully developed arithmetic and logic –Plus, minus, times, divide, min, max, –Log, exp, sqrt, abs, powers, and, or, not –Backcalculation, updating, mixtures, etc. Very fast calculation and convenient software Very easy to explain Distributional answers (not just worst case) Results robust to choice about shape

How does shape of X affect aX+b? a = (d * e) / (h + g) b =  f *e where d = [0.3, 1.7, 3] e = [ 0.4, 1, 1.5] f = [ 0.8, 6, 10] g = [ 0.2, 2, 5] h = [ 0.6, 3, 6] 0246 a Possibility 0 1 a b Possibility 0 1 b

Robustness of the answer Different choices for the fuzzy number X all yield very similar distributions for aX + b aX + b Possibility

Fuzzy seems to bound probability A fuzzy number F is said to “enclose” a probability distribution P iff –the left side of F is larger than P(x) for each x, –the right side of F is larger than 1  P(x) for each x For every event X < x and x < X, possibility is larger than than the probability, so it is an upper bound

F encloses P Probability 0 Possibility Prob(X > x) Poss(X > x) 1 x Prob(X < x) Poss(X < x) Probability 0 1 Possibility x P Prob. density F 0 1 Possibility x

The lazy risk analyst conjecture If F and G enclose P and Q resp., F+G encloses P+Q, where F, G are fuzzy numbers, P, Q are probability distributions, F+G is obtained by fuzzy arithmetic, and P+Q is obtained by probabilistic convolution such as Monte Carlo simulation.

It’d be nice If the lazy risk analyst conjecture were true, we could do risk assessments by –getting fuzzy numbers that enclose each probability distribution –using fuzzy arithmetic to obtain results that bound the probabilistic answer Easy to get inputs, easy to get answers Results conservative (but not hyperconservative)

Counterexample CCDF, Possibility CCDF, Possibility A, B A+B Distributions (in red) for the sum A+B under different correlations and dependencies are not enclosed by the (blue) sum of fuzzy numbers The red parallelogram is the tightest region that encloses all of the possible distributions for A+B that could arise under different dependencies between A and B. A and B are identically distributed; their distribution is in red above (they are not independent)

Conclusion Like many ideas that would be really cool, the lazy risk analyst conjecture is false. Fuzzy arithmetic does not seem to allow us to conveniently and conservatively estimate risks from bounded probabilities