VARIANCE REDUCTION.

Slides:



Advertisements
Similar presentations
+ Validation of Simulation Model. Important but neglected The question is How accurately does a simulation model (or, for that matter, any kind of model)
Advertisements

Regression and correlation methods
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
NOTATION & ASSUMPTIONS 2 Y i =  1 +  2 X 2i +  3 X 3i + U i Zero mean value of U i No serial correlation Homoscedasticity Zero covariance between U.
Variance reduction techniques. 2 Introduction Simulation models should be coded such that they are efficient. Efficiency in terms of programming ensures.
1 Def: Let and be random variables of the discrete type with the joint p.m.f. on the space S. (1) is called the mean of (2) is called the variance of (3)
GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
Simulation Modeling and Analysis Session 12 Comparing Alternative System Designs.
Multivariate Probability Distributions. Multivariate Random Variables In many settings, we are interested in 2 or more characteristics observed in experiments.
Ordinary Least Squares
Lecture 5 Correlation and Regression
Structural Equation Modeling Continued: Lecture 2 Psy 524 Ainsworth.
1 Multivariate Analysis (Source: W.G Zikmund, B.J Babin, J.C Carr and M. Griffin, Business Research Methods, 8th Edition, U.S, South-Western Cengage Learning,
Module 1: Statistical Issues in Micro simulation Paul Sousa.
BIOL 582 Lecture Set 11 Bivariate Data Correlation Regression.
Statistical Comparison of Two or More Systems The most relevant of all the Basic Theory Lectures. No Holidays.
Chapter 9: Correlation and Regression Analysis. Correlation Correlation is a numerical way to measure the strength and direction of a linear association.
Review Lecture 51 Tue, Dec 13, Chapter 1 Sections 1.1 – 1.4. Sections 1.1 – 1.4. Be familiar with the language and principles of hypothesis testing.
Variance Reduction Techniques
© Buddy Freeman, 2015 Let X and Y be two normally distributed random variables satisfying the equality of variance assumption both ways. For clarity let.
Chapter 5 Joint Probability Distributions and Random Samples  Jointly Distributed Random Variables.2 - Expected Values, Covariance, and Correlation.3.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
Section 1.6 Fitting Linear Functions to Data. Consider the set of points {(3,1), (4,3), (6,6), (8,12)} Plot these points on a graph –This is called a.
Chapter 11 Linear Regression and Correlation. Explanatory and Response Variables are Numeric Relationship between the mean of the response variable and.
AUTOCORRELATED DATA. CALCULATIONS ON VARIANCES: SOME BASICS Let X and Y be random variables COV=0 if X and Y are independent.
Variance reduction techniques Mat Simulation
Inference about the slope parameter and correlation
Summarizing Descriptive Relationships
Chapter 11: Linear Regression and Correlation
EXCEL: Multiple Regression
Regression Analysis AGEC 784.
Engineering Probability and Statistics - SE-205 -Chap 4
REGRESSION (R2).
Correlation and Regression
PRODUCT MOMENTS OF BIVARIATE RANDOM VARIABLES
Evgeniya Anatolievna Kolomak, Professor
Fundamentals of regression analysis
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
Multiple Regression Analysis
Chapter 7: Sampling Distributions
Math 4030 – 12a Correlation.
Quantitative Methods Simple Regression.
Overview of Supervised Learning
Simple Linear Regression
Slope of the regression line:
Probability and Statistics for Computer Scientists Second Edition, By: Michael Baron Section 11.1: Least squares estimation CIS Computational.
Multivariate Probability Distributions
Ratio and regression estimation STAT262, Fall 2017
Inference about the Slope and Intercept
Chapter 3: Getting the Hang of Statistics
MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF ESTIMATION
Chapter 14 – Correlation and Simple Regression
Sampling Distribution
Sampling Distribution
STA 282 – Regression Analysis
Inference about the Slope and Intercept
Simple Linear Regression
CHAPTER 14 MULTIPLE REGRESSION
Introduction to Probability & Statistics Joint Expectations
Linear Regression and Correlation
Chapter 3: Getting the Hang of Statistics
Linear Regression and Correlation
Linear Regression and Correlation
More Monte Carlo Methods
Financial Econometrics Fin. 505
Principal Component Analysis
Chapter 9 Estimation: Additional Topics
Introduction to Regression
Chapter 4. Supplementary Questions
Summarizing Descriptive Relationships
Presentation transcript:

VARIANCE REDUCTION

CALCULATIONS ON VARIANCES: SOME BASICS Let X and Y be random variables COV=0 if X and Y are independent.

COMMON RANDOM NUMBERS Built for distinguishing among two systems di = yi – xi Variance reduced by COV(X, Y) Streaming induces MORE Covariance

STREAMING Zi=aZi-1 mod m Segregate the random number generation task into streams connected to phenomena Zi=aZi-1 mod m seed1 seed2 Inter-arrival times Service times 1. Change features of the service. 2. Use exact same arrival stream for comparing each service setting.

ANTITHETIC VARIATES Use Uniforms U1, U2, ... to generate a sample Use Uniforms 1-U1, 1-U2, ... to generate a second sample Combine the samples Extreme values get canceled out Depends on... effective streaming straightforward F-1(U) method of variate generation

spreadsheet...

CONTROL VARIATES X is your output variable Y is a random variable You seek the Expected Value of X Y is a random variable Y is one of the variables that we are generating We know the Expected Value of Y Example X is the total waiting time of a customer Y is the inter-arrival time before he entered service

...more CONTROL VARIATES Xc is a random variable with less Variance and the same Expected Value pick b to minimize VAR(Xc)

OPTIMAL CONTROL

IMPORTANT CALCULATIONS Fusing many results in statistics

ALSO KNOWN AS... We are regressing X vs. Y b* is the parameter that a regression package would calculate r = SQRT[COV(X,Y)2/VAR(X)VAR(Y)] is the correlation coefficient of X and Y r =1 or -1 implies Y completely explains X and VAR(Xc)=0