14: Analysis of Test Data Testing leads to failure, and failure leads to understanding."

Slides:



Advertisements
Similar presentations
Slide 1 The basic problem Working Age t PDF f(t) Failures do not happen at fixed times. They occur randomly based on a distribution. Probabilty Density.
Advertisements

Example 8.12 Controlling Confidence Interval Length.
Reliability McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
Lecture 14 chi-square test, P-value Measurement error (review from lecture 13) Null hypothesis; alternative hypothesis Evidence against null hypothesis.
Review bootstrap and permutation
Estimation of Means and Proportions
Module 16: One-sample t-tests and Confidence Intervals
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Chi-Square Tests Chapter 12.
Hypothesis Testing. To define a statistical Test we 1.Choose a statistic (called the test statistic) 2.Divide the range of possible values for the test.
Statistical Inference Statistical Inference is the process of making judgments about a population based on properties of the sample Statistical Inference.
Reliability Engineering (Rekayasa Keandalan)
1 Chapter 12 Inference About One Population Introduction In this chapter we utilize the approach developed before to describe a population.In.
SMJ 4812 Project Mgmt and Maintenance Eng.
1 The Chi squared table provides critical value for various right hand tail probabilities ‘A’. The form of the probabilities that appear in the Chi-Squared.
1 The t table provides critical value for various probabilities of interest. The form of the probabilities that appear in Appendix B are: P(t > t A, d.f.
Software Testing and QA Theory and Practice (Chapter 15: Software Reliability) © Naik & Tripathy 1 Software Testing and Quality Assurance Theory and Practice.
Logistic Regression In logistic regression the outcome variable is binary, and the purpose of the analysis is to assess the effects of multiple explanatory.
Handouts Software Testing and Quality Assurance Theory and Practice Chapter 15 Software Reliability
1 Math 10 Part 5 Slides Confidence Intervals © Maurice Geraghty, 2009.
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
CHAPTER 18: Inference about a Population Mean
Chapter 9: Non-parametric Tests n Parametric vs Non-parametric n Chi-Square –1 way –2 way.
© 2002 Eaton Corporation. All rights reserved. Designing for System Reliability Dave Loucks, P.E. Eaton Corporation.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics S eventh Edition By Brase and Brase Prepared by: Lynn Smith.
Manijeh Keshtgary Chapter 13.  How to report the performance as a single number? Is specifying the mean the correct way?  How to report the variability.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Hypothesis Testing.
Fitting probability models to frequency data. Review - proportions Data: discrete nominal variable with two states (“success” and “failure”) You can do.
Shanghai Jiao Tong University 1 ME250: Statistics & Probability ME 250: Design & Manufacturing I School of Mechanical Engineering.
Reliability Failure rates Reliability
CHAPTER SIX Confidence Intervals.
CPE 619 Comparing Systems Using Sample Data Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of.
© Copyright McGraw-Hill 2004
BASIC STATISTICAL CONCEPTS Statistical Moments & Probability Density Functions Ocean is not “stationary” “Stationary” - statistical properties remain constant.
2007 MIT BAE Systems Fall Conference: October Software Reliability Methods and Experience Dave Dwyer USA – E&IS baesystems.com.
Estimating a Population Variance
Section 7-5 Estimating a Population Variance. MAIN OBJECTIIVES 1.Given sample values, estimate the population standard deviation σ or the population variance.
MEGN 537 – Probabilistic Biomechanics Ch.5 – Determining Distributions and Parameters from Observed Data Anthony J Petrella, PhD.
Confidence Intervals. Point Estimate u A specific numerical value estimate of a parameter. u The best point estimate for the population mean is the sample.
Dr.Theingi Community Medicine
Applied Statistics and Probability for Engineers
Chapter 7 Confidence Interval Estimation
Chapter 9 Hypothesis Testing.
Chapter 9: Non-parametric Tests
Chapter 12 Analysis of count data.
10 Chapter Chi-Square Tests and the F-Distribution Chapter 10
Point and interval estimations of parameters of the normally up-diffused sign. Concept of statistical evaluation.
Activity networks – Example 1
What is a χ2 (Chi-square) test used for?
8-1 of 23.
Unit 5: Hypothesis Testing
Hypothesis Testing Review
John Loucks St. Edward’s University . SLIDES . BY.
Chapter 12: Inference about a Population Lecture 6b
Testing Goodness of Fit
F - Ratio Table Degrees of Freedom for the Factor
CONCEPTS OF ESTIMATION
Inferential Statistics and Probability a Holistic Approach
Chapter 9 Hypothesis Testing.
Reliability Failure rates Reliability
Chapter 7 Estimation: Single Population
Ten things about Inference
CHAPTER 18: Inference about a Population Mean
Unit 5: Hypothesis Testing
Unit 5: Hypothesis Testing
Chapter 7 Lecture 3 Section: 7.5.
CHAPTER 18: Inference about a Population Mean
CHAPTER 18: Inference about a Population Mean
Chapter 6 Confidence Intervals.
Chapter 7 Lecture 3 Section: 7.5.
MATH 2311 Section 8.5.
Presentation transcript:

14: Analysis of Test Data Testing leads to failure, and failure leads to understanding."

Definitions Failure rate = the number of failures per million hours of operation λ =1/MTBF Failure: the state of inability of an item to perform its required function Reliability = the probability that an item will perform a required function, under specified conditions, for a specified period of time, at a desired confidence level. (MTBF or Failure rate, λ) Minimum life = time to first failure

Definitions, Continued Confidence level = probability that a given statement is correct Confidence limits = the extremes of a confidence interval within which the unknown has a designated probability of being included The minimum life of a device = the time of occurrence of the first failure. Pareto analysis = plot of individual failures versus the frequency of the failures.

Example 1: MTBF An EEG machine has a MTBF of 4380 hours. What is the failure rate? λ = 1/MTBF λ = 1/4380 failures per hour λ = failures per hour λ = 228 failures per million hours

Example 2: MTBF 10 power supplies are put on test, to be terminated after each has completed 1000 hours of operation. Two power supplies fail, one at 420 hours and the other at 665 hours. What is the failure rate of the power supplies? Eight units completed 1000 hours. Total test time = 8(1000) = 9085 hours λ = number of failures/total test time λ = 2/9085 = failures per hour λ = 220 failures per million hours

General MTBF Tests in practice: Time terminated, failed parts replaced Time terminated, no replacement (last…) Failure terminated, failed parts replaced Failure terminated, no replacement (easy) No failures observed during the test …SOME EXAMPLES FOLLOW

Time terminated, failed parts replaced: MTBF = N(td)/r where N = number of units tested td = test duration r = number of failures

…continued The performance of ten pressure monitors is monitored while operating for a period of 1200 hours. The test results are listed below. Every failed unit is replaced immediately. What is the MTBF? Unit NumberTime of Failure (hours)#failures and and No Failure No Failure and

finished … N = 10 sets of tests r = 11 failues td = 1200 hours (test duration) MTBF = N(td)/r = 10(1200)/11 = 1091 hours

Failure Terminated, Failed Parts Replaced Six TENS units were placed on test until all units failed, the last occurring at 850 hours. The test results are listed below. Every failed unit, except the last one, is replaced immediately. What is the MTBF? Unit NumberTime of Failure (hours) Failures and MTBF = N(td)/r = 6(850)/7 = 729 hours

No failures observed during the test For the case where no failures are observed, an MTBF value cannot be calculated. A lower one sided confidence limit must be calculated and the MTBF stated to be greater than that value. ml = 2(Ta)/Χ 2 α;2 where ml = lower one sided confidence limit Ta = total test time Χ 2 α;2 = the chi square value from the table in Appendix 1, where α is the risk level and 2 is the # of degrees of freedom

continued … 10 ventilators are tested for 1000 hours without failure. What is the MTBF at a 90% confidence level? N = 10 test units td = 1000 = test duration r = 0 = failures 1 % = 0.90 = confidence level % = 0.10 = risk level Ta = N(td) = 10(1000) = = total test time ml = 2(Ta)/Χ 2 α;2 = 2(10000)/Χ 2 10;2 = 20000/4.605 = 4343 hours = lower 1 sided confidence limit… We can then state that the MTBF > 4343 hours, with 90% confidence.

Reliability Reliability = exp( λt) = exp ( t/MTBF) Example: test time =3200 hours, λ = 220 failures/ million hours Reliability = exp(-3200*220/ ) = exp(-.704) =.495 or ~ half will fail in 3200 hours….

Confidence Limits Time Terminated Confidence Limits mL = 2(Ta)/Χ 2 α/2;2r+2 where mL = lower confidence limit Ta = total test time Χ 2 α/2;2r+2 = Chi square value from Appendix 1 for α risk level α and 2r+2 degrees of freedom mU = 2(Ta)/Χ 2 1-α/2;2r

Confidence Limits, continued mL = 2(Ta)/Χ 2 α/2;2r and mU = 2(Ta)/Χ 2 1-α/2;2r … left to the reader -

Pareto Analysis

Field Data Plots:

Final comments The data examples given are for estimate purposes only, most of the reliability estimates will likely be slightly on the low side, which can be a good thing…