Chapter 4 – Modeling Basic Operations and Inputs  Structural modeling: what we’ve done so far ◦ Logical aspects – entities, resources, paths, etc. 

Slides:



Advertisements
Similar presentations
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. A PowerPoint Presentation Package to Accompany Applied Statistics.
Advertisements

Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Evaluating Classifiers
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Outline input analysis input analyzer of ARENA parameter estimation
Eastern Mediterranean University Department of Industrial Engineering IENG461 Modeling and Simulation Systems Computer Lab 2 nd session ARENA (Input Analysis)
Chapter 5 Statistical Models in Simulation
Simulation with ArenaAppendix C – A Refresher on Probability and StatisticsSlide 1 of 33 A Refresher on Probability and Statistics Appendix C.
Simulation with ArenaChapter 4 – Modeling Basic Operations and InputsSlide 1 of 58 Schedules Vary Capacity (number of units) of a resource over time In.
1 The Output Analyzer Separate application, also accessible via Tools menu in Arena Reads binary files saved by Arena Various kinds of output-data display,
 1  Outline  Model  problem statement  detailed ARENA model  model technique  Output Analysis.
STAT 497 APPLIED TIME SERIES ANALYSIS
Probability Distributions and Stochastic Budgeting AEC 851 – Agribusiness Operations Management Spring, 2006.
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
Random-Variate Generation. Need for Random-Variates We, usually, model uncertainty and unpredictability with statistical distributions Thereby, in order.
A Review of Probability and Statistics
Simple Linear Regression
Simulation Modeling and Analysis
Chapter 6 Continuous Random Variables and Probability Distributions
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Analysis of Simulation Input.. Simulation Machine n Simulation can be considered as an Engine with input and output as follows: Simulation Engine Input.
Chapter 5 Continuous Random Variables and Probability Distributions
Inferences About Process Quality
Probability Distribution
Chapter 4 Continuous Random Variables and Probability Distributions
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
A Review of Probability Models
Analysis of Simulation Results Andy Wang CIS Computer Systems Performance Analysis.
Chapter 5 Modeling & Analyzing Inputs
Graduate Program in Engineering and Technology Management
 1  Outline  stages and topics in simulation  generation of random variates.
1 CS 475/575 Slide Set 6 M. Overstreet Spring 2005.
Traffic Modeling.
Random Sampling, Point Estimation and Maximum Likelihood.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
Chapter Twelve Census: Population canvass - not really a “sample” Asking the entire population Budget Available: A valid factor – how much can we.
Estimating parameters in a statistical model Likelihood and Maximum likelihood estimation Bayesian point estimates Maximum a posteriori point.
2 Input models provide the driving force for a simulation model. The quality of the output is no better than the quality of inputs. We will discuss the.
1 Statistical Distribution Fitting Dr. Jason Merrick.
Discrete Distributions The values generated for a random variable must be from a finite distinct set of individual values. For example, based on past observations,
1 Chapter 19 Monte Carlo Valuation. 2 Simulation of future stock prices and using these simulated prices to compute the discounted expected payoff of.
קורס סימולציה ד " ר אמנון גונן 1 ההתפלגויות ב ARENA Summary of Arena’s Probability Distributions Distribution Parameter Values Beta BETA Beta, Alpha Continuous.
Fast Simulators for Assessment and Propagation of Model Uncertainty* Jim Berger, M.J. Bayarri, German Molina June 20, 2001 SAMO 2001, Madrid *Project of.
ETM 607 – Input Modeling General Idea of Input Modeling Data Collection Identifying Distributions Parameter estimation Goodness of Fit tests Selecting.
Lecture 2 Review Probabilities Probability Distributions Normal probability distributions Sampling distributions and estimation.
Selecting Input Probability Distribution. Simulation Machine Simulation can be considered as an Engine with input and output as follows: Simulation Engine.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Simulation and Analysis of Entrance to Dahlgren Naval Base Jennifer Burke MSIM 752 Final Project December 7, 2007.
Chapter 10 Verification and Validation of Simulation Models
ECE 466/658: Performance Evaluation and Simulation Introduction Instructor: Christos Panayiotou.
1 OUTPUT ANALYSIS FOR SIMULATIONS. 2 Introduction Analysis of One System Terminating vs. Steady-State Simulations Analysis of Terminating Simulations.
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
Learning Simio Chapter 10 Analyzing Input Data
Chapter 19 Monte Carlo Valuation. Copyright © 2006 Pearson Addison-Wesley. All rights reserved Monte Carlo Valuation Simulation of future stock.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Probability and Distributions. Deterministic vs. Random Processes In deterministic processes, the outcome can be predicted exactly in advance Eg. Force.
Communications Range Analysis Simulation Set Up –Single Biological Threat placed in Soldier Field –Communication range varied from meters –Sensor.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Selecting Input Probability Distributions. 2 Introduction Part of modeling—what input probability distributions to use as input to simulation for: –Interarrival.
Modeling and Simulation CS 313
Advanced Quantitative Techniques
OPERATING SYSTEMS CS 3502 Fall 2017
Prepared by Lloyd R. Jaisingh
Modeling and Simulation CS 313
Modeling Basic Operations and Inputs
Chapter 7: Sampling Distributions
Chapter 10 Verification and Validation of Simulation Models
Discrete Event Simulation - 4
Chapter 4 – Modeling Basic Operations and Inputs
Presentation transcript:

Chapter 4 – Modeling Basic Operations and Inputs  Structural modeling: what we’ve done so far ◦ Logical aspects – entities, resources, paths, etc.  Quantitative modeling ◦ Numerical, distributional specifications ◦ Like structural modeling, need to observe system’s operation, take data if possible

Chapter 4 – Modeling Basic Operations and Inputs  Deterministic: nonrandom, fixed values ◦ Number of units of a resource ◦ Entity transfer time (?) ◦ Interarrival, processing times (?)  Random (a.k.a. stochastic): model as a distribution, “draw” or “generate” values from to drive simulation ◦ Transfer, Interarrival, Processing times ◦ What distribution? What distributional parameters? ◦ Causes simulation output to be random, too  Don’t just assume randomness away – validity

Chapter 4 – Modeling Basic Operations and Inputs  Generally hard, expensive, frustrating, boring ◦ System might not exist ◦ Data available on the wrong things – might have to change model according to what’s available ◦ Incomplete, “dirty” data ◦ Too much data (!)  Sensitivity of outputs to uncertainty in inputs  Match model detail to quality of data  Cost – should be budgeted in project  Capture variability in data – model validity  Garbage In, Garbage Out (GIGO)

Chapter 4 – Modeling Basic Operations and Inputs  Use data “directly” in simulation ◦ Read actual observed values to drive the model inputs (interarrivals, service times, part types, …)  Arena ReadWrite module... see Model 10-2 ◦ All values will be “legal” and realistic ◦ But can never go outside your observed data ◦ May not have enough data for long or many runs ◦ Computationally slow (reading disk files)  Or, fit probability distribution to data ◦ “Draw” or “generate” synthetic observations from this distribution to drive the model inputs ◦ We’ve done it this way so far ◦ Can go beyond observed data (good and bad) ◦ May not get a good “fit” to data – validity?

Chapter 4 – Modeling Basic Operations and Inputs  Assume: ◦ Have sample data: Independent and Identically Distributed (IID) list of observed values from the actual physical system ◦ Want to select or fit a probability distribution for use in generating inputs for the simulation model  Arena Input Analyzer ◦ Separate application, also via Tools menu in Arena ◦ Fits distributions, gives valid Arena expression for generation to paste directly into simulation model

Chapter 4 – Modeling Basic Operations and Inputs  Fitting = deciding on distribution form (exponential, gamma, empirical, etc.) and estimating its parameters ◦ Several different methods (Maximum likelihood, moment matching, least squares, …) ◦ Assess goodness of fit via hypothesis tests  H 0 : fitted distribution adequately represents the data  Get p value for test (small = poor fit)  Fitted “theoretical” vs. empirical distribution  Continuous vs. discrete data, distribution  “Best” fit from among several distributions

Chapter 4 – Modeling Basic Operations and Inputs  Not an exact science – no “right” answer  Consider theoretical vs. empirical  Consider range of distribution ◦ Infinite both ways (e.g., normal) ◦ Positive (e.g., exponential, gamma) ◦ Bounded (e.g., beta, uniform)  Consider ease of parameter manipulation to affect means, variances  Simulation model sensitivity analysis  Outliers, multimodal data ◦ Maybe split data set (details in text)

Chapter 4 – Modeling Basic Operations and Inputs  Happens more often than you’d like  No good solution; some (bad) options: ◦ Interview “experts”  Min, Max: Uniform  Avg., % error or absolute error: Uniform  Min, Mode, Max: Triangular  Mode can be different from Mean – allows asymmetry ◦ Interarrivals – independent, stationary  Exponential – still need some value for mean ◦ Number of “random” events in an interval: Poisson ◦ Sum of independent “pieces”: normal (heed left tail...) ◦ Product of independent “pieces”: lognormal

Chapter 4 – Modeling Basic Operations and Inputs  Probably most familiar distribution – normal “bell curve” used widely in statistical inference  But it has infinite tails in both directions … in particular, has an infinite left tail so can always (theoretically) generate negative values ◦ Many simulation input quantities (e.g., time durations) must be positive to make sense – Arena truncates negatives to 0  If mean  is big relative to standard deviation , then P(negative) value is small … one in a million ◦ But in simulation, one in a million can happen ◦ See text, Model 4-5  Moral – probably avoid normal as input distrib.

Chapter 4 – Modeling Basic Operations and Inputs  Events (often arrivals), rate varies over time ◦ Lunchtime at fast-food restaurants ◦ Rush-hour traffic in cities ◦ Telephone call centers ◦ Seasonal demands for a manufactured product  It can be critical to model nonstationarity for model validity ◦ Ignoring peaks, valleys can mask important behavior ◦ Can miss rush hours, etc.  Good model: Nonstationary Poisson process

Chapter 4 – Modeling Basic Operations and Inputs  Two issues: ◦ How to specify/estimate the rate function ◦ How to generate from it properly during the simulation  Several ways to estimate rate function – we’ll just do the piecewise-constant method ◦ Divide time frame of simulation into subintervals of time over which you think rate is fairly flat ◦ Compute observed rate within each subinterval ◦ In Arena, must convert to expected number of arrivals per hour on subintervals that need not be of one-hour length  Want expected 45 arrivals in a half hour; specify rate = 90 per hour  Example: Model 5-2 in Chapter 5

Chapter 4 – Modeling Basic Operations and Inputs  Usually assume all generated random observations in a simulation are independent (though from possibly different distributions)  Sometimes not true: ◦ A “difficult” part requires long processing in both the Prep and Sealer operations ◦ This is positive correlation  Ignoring such relations can invalidate model  See text for ideas, references