1. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 1 MER301: Engineering Reliability LECTURE 14: Chapter 7: Design of Engineering Experiments

2. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 2 Summary of Topics  Design of Engineering Experiments DOE and Engineering Design Coded Variables Optimization  Factorial Experiments Main Effects Interactions Statistical Analysis

3. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 3 Design of Experiments and Engineering Design  Applications of Designed Experiments Evaluation and comparison of design configurations Establish Production Process Parameters Evaluation of mechanical properties of materials/comparison of different materials Selection of ranges of values of independent variables in a design (Robust Design) Determination of Vital x’s (Significant Few versus the Trivial Many…..)

4. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 4 Design of Engineering Experiments  Objectives of engineering experiments include acquiring data that can be used to generate an analytical model for Y in terms of the dependent variables X i  The model may be linear or non-linear in the X i ’s and it defines a Response Surface of Y as a function of the X i ’s  The model can be used to generate statistical parameters(means, std dev) for use in product design, as in DFSS

5. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 5 Factorial Experiments  Factorial Experiments are used to establish Main Effects and Interactions  Levels of each factor are chosen to bound the expected range of each Xi

6. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 6 DOE Glossary  Model- quantitative relationship ; also called Transfer Function  DOE- systematic variation of X i ’s to acquire data to generate Transfer Function  Factorial Experiment-all possible combinations of X i ’s are tested Main Effects – change in Y due to change in X i. Interactions – joint effects of two or more X i ’s Replicates and Center Points  Response Surface- surface of Y generated by the Transfer Function Optimum Response- local max/min of Y  Partial Factorial Experiments- can run fewer points if can neglect higher order interactions

7. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 7 Coded Variables  Coded Variables.. Each x typically has some (dimensional) range in which it is expected to vary…. In Designed Experiments the lower value of each x is often assigned a value of –1 and the upper value of x a value of +1  Coded Variables have two advantages First, discrete variables( eg, “yes/no”, Operator A/ Operator B) can be included in the experiment Second, the magnitude of the regression coefficients is a direct measure of the importance of each x variable  Coded Variables have the disadvantage that an equation that can be directly used for engineering design is not specifically produced

8. L Berkley Davis Copyright 2009 DOE Process Map 8

9. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 9 Example 14.1- Text Example 7-1  Two level factorial design applied to a process for integrated circuit manufacturing Y= epitaxial growth layer thickness A= deposition time( ),levels are long(+1) or short(-1) B= arsenic flow rate( ), levels are 59%(+1) or 55%(-1)  Experiment run with 4 replicates at each combination of A and B

10. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 10

11. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 11 Example 14.1( con’t)  What are the questions we need to answer? What is the quantitative effect of changes in A on the value of Y, ie the response of Y? What is the response of Y to changes in B? What is the interaction effect on Y when both A and B are changing, if any? Are there values of A and B such that Y is at an optimum level?

12. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 12 Example 14.1(con’t) Two level factorial design applied to integrated circuit manufacturing Y= epitaxial growth layer thickness A= deposition time( X1),levels are long(+1) or short(-1) B= arsenic flow rate( X2), levels are 59%(+1) or 55%(-1) Experiment run with 4 replicates at each combination of A and B How do we answer these Questions? What is the form of Experimental Design ? What is the quantitative effect of changes in A on the value of Y? What is the effect of changes in B on Y? What is the interaction effect on Y when both A and B are changing, if any? Are there values of A and B such that Y is at an optimum level?

13. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 13 Factorial Design  factorial design is used when each factor has two levels Establish both main effects/interactions Assumes linearity of response Smallest number of runs to test all combinations of x’s  Factor(X i ) levels often described as “+ or –” Called geometric or coded notation 7-8 Factors A B

14. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 14 Response of Y to A and B: Interaction/No Interaction  In Fig 7-1, response of Y to change in A is independent of B level; there is No Interaction between A and B  In Fig 7-2, the response of Y to change in A is shown with a different slope to illustrate an interaction between A and B

15. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 15 Interaction/ No Interaction Interactions change the shape of the response surface significantly Experimental design must identify interactions and allow their impact to be quantified 7-3 7-4

16. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 16 Main Effects  Main Effect term captures the change in the response variable due to change in level of a specific factor

17. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 17 AB Interactions  Interaction terms show the effects of changes in one variable at different levels of the other variables For Eq 7-3, this would give the effects of A at different levels of B(or vice versa)

18. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 18 Example 14.1: Data Set  Two level factorial design applied to integrated circuit manufacturing Y= epitaxial growth layer thickness A= deposition time(x 1 ),levels are long(+1) or short(-1) B= arsenic flow rate(x 2 ), levels are 59%(+1) or 55%(-1)  Experiment run with 4 replicates at each combination of A and B

19. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 19 Example 14.1: Effect Values

20. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 20 Coded Least Squares Model  The Regression Equation is of the Form  The Coded Least Squares Model is of the Form X1 and X2 are coded variables and range from –1 to +1 is the average of all observations and the coefficients are

21. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 21 Relationship between Regression Coefficients and the DOE Effects  The Regression Equation is  The Coded Least Squares Model is so that

22. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 22 Relationship between Regression Coefficients and the DOE Effects  The Regression Equation is of the Form  The Coded Least Squares Model is of the Form For k=2

23. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 23 Example 14.1(con’t) Regression Analysis

24. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 24 Example 14.1 Excel Regression Analysis

25. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 25 Example 14.1:Regression Equation  Effects are calculated as A=0.836, B=-0.067, and AB=0.032 Large effect of deposition rate A Small effect of arsenic level B and interaction AB  Sample Variance(, pooled data set)=0.02079  Sample Mean( ) = 14.3889

26. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 26 Example 14.1(con’t) Two level factorial design applied to integrated circuit manufacturing Y= epitaxial growth layer thickness A= deposition time( X1),levels are long(+1) or short(-1) B= arsenic flow rate( X2), levels are 59%(+1) or 55%(-1) Experiment run with 4 replicates at each combination of A and B How do we answer these Questions? What is the form of Experimental Design ? What is the quantitative effect of changes in A on the value of Y? What is the effect of changes in B on Y? What is the interaction effect on Y when both A and B are changing, if any? Are there values of A and B such that Y is at an optimum level?

27. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 27 One Factor at a Time Optimization  The One Factor at a Time method of conducting experiments is intuitively appealing to many engineers 7-57-6

28. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 28 One Factor at a Time Optimization  One Factor at a Time will frequently fail to identify effects of interactions Learning to use DOE factorial experiments often difficult for new engineers to accept DOE’s however are the most efficient and reliable method of experimentation 7-7

29. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 29 Optimization  Screening tests establish factors (vital ’s) that affect Y  Range of ’s is a critical choice in the experimental design  Optimization will require multiple experiments 7-7a

30. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 30 Example 14.1:Regression Equation Optimization  Take partial derivatives wrt X1 and X2 Set equal to zero and solve for X1 and X2 X1~2 and X2~-26 No Optimum of Y in Range of X’s -1<=X,=1

31. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 31 Example 14-1:Statistical Analysis of the Regression Model-  There are three ways of conducting a statistical analysis of the regression model- and all will lead to the same conclusion Standard Error of the Effects calculated from Sample Data Sum of Squares based on Mean and Interaction Effects ANOVA/Significance Analysis of the Regression Equation  All of these methods are based on analysis of the single data set generated in the DOE.

32. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 32 Example 14-1:Statistical Analysis of the Regression Model-  There are three ways of conducting a statistical analysis of the regression model- and all will lead to the same conclusion Standard Error of the Effects calculated from Sample Data Sum of Squares based on Mean and Interaction Effects ANOVA/Significance Analysis of the Regression Equation  All of these methods are based on analysis of the single data set generated in the DOE.

33. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 33 Standard Error of the Effects calculated from Sample Data  The magnitude/importance of each effect can be judged by comparing each effect to its Estimated Standard Error.  The first step in the analysis is to calculate the means and variances at each of the i factorial run conditions using data from the n replicates. For the variances  The second step is to calculate an overall(pooled) variance estimate for the factorial run conditions

34. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 34 Calculation of Variance  The variances for the i factorial runs are  The overall(pooled) variance estimate for the 2 k =4 factorial run conditions is

35. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 35 Standard Error of the Effects calculated from Sample Data (con’t)…..  Given the overall variance, the effect variance is calculated as follows The Effect Estimate is a difference between two means, each of which is calculated from half of the N measurements. Thus the Effect Variance is where  The Standard Error of each Effect is then

36. L Berkley Davis Copyright 2009

37. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 37 Standard Error of the Effects calculated from Sample Data (con’t)…..  Because is the same for all of the effects and is used to calculate the Standard Error of any specific Effect( ie, A, B, AB,…) the value calculated will be the same for each one…  For the Epitaxial Process  The value of the Effect is twice that of the coefficient in the Regression Equation. Similarly, the Standard Error for the Coefficient is half that of the Effect

38. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 38 Standard Error of the Effects calculated from Sample Data (con’t)…..  A Hypothesis Test is carried out on each of the Main Effects and the Interaction Effects. This is a t-test.  The A Effect is significant and the B and AB Effects are not 7-5

39. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 39 Example 14.1 Excel Regression Analysis

40. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 40 Standard Error of the Effects calculated from Sample Data (con’t)…..

41. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 41 Example 14-1:Statistical Analysis of the Regression Model-  There are three ways of conducting a statistical analysis of the regression model- and all will lead to the same conclusion Standard Error of the Effects calculated from Sample Data Sum of Squares based on Mean and Interaction Effects ANOVA/Significance Analysis of the Regression Equation  All of these methods are based on analysis of the single data set generated in the DOE.

42. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 42 Sum of Squares:Main Factors and Interaction  The Sum of Squares for the Effects can be expressed as  Sum of Squares from the Main and Interaction Effects can be used to assess the relative importance of each term  The Total Sum of Squares is obtained from and the Mean Square Error from

43. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 43 Sum of Squares: Two Calculation Methods  The Total Sum of Squares,Effect Sum of Squares,and Mean Square Error are obtained from

44. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 44 Example 14-1:Statistical Analysis of the Regression Model-  There are three ways of conducting a statistical analysis of the regression model- and all will lead to the same conclusion Standard Error of the Effects calculated from Sample Data Sum of Squares based on Mean and Interaction Effects ANOVA/Significance Analysis of the Regression Equation  All of these methods are based on analysis of the single data set generated in the DOE.

45. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 45 Example 14.1 Regression Analysis and ANOVA (con’t) 7-6

46. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 46 ANOVA: for each term  The Significance of each term (A,B,AB) can be obtained from ANOVA A is Significant B and AB are not Significant

47. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 47 Example 14.1 Regression Analysis and ANOVA(con’t) 7-6

48. L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 48 Summary of Topics  Design of Engineering Experiments DOE and Engineering Design Coded Variables  Factorial Experiments Main Effects Interactions Optimization Statistical Analysis