Presentation is loading. Please wait.

Presentation is loading. Please wait.

Executing Robust Design. Definition of Robust Design Robustness is defined as a condition in which the product or process will be minimally affected by.

Similar presentations


Presentation on theme: "Executing Robust Design. Definition of Robust Design Robustness is defined as a condition in which the product or process will be minimally affected by."— Presentation transcript:

1 Executing Robust Design

2 Definition of Robust Design Robustness is defined as a condition in which the product or process will be minimally affected by sources of variation. A product can be robust: Against variation in raw materials Against variation in manufacturing conditions Against variation in manufacturing personnel Against variation in the end use environment `Against variation in end-users Against wear-out or deterioration

3 Why We Need to Reduce Variation Cost Low Variation; Minimum Cost LSL USL Nom Cost High Variation; High Cost LSL USL Nom

4 Purpose of this Module To introduce a variation improvement investigation strategy –Can noise factors be manipulated? To provide the MINITAB steps to design, execute, and analyze a variability response experiment To provide the MINITAB steps to optimize a design for both mean and variation effects

5 Objectives of this Module At the end of this module, participants will be able to : Identify possible variation effects from residual plots Create a variability response from replicates Identify possible mean and variance adjustment factors from noise-factor interaction plots Use the MINITAB Response Optimizer to achieve a process on target with minimum variation

6 Strategies to Detect Variation Effects Passive Approach –Noise factors are NOT included, manipulated or controlled in the experimental design –Possible variation effects are identified through analysis of the variability of replicates from an experimental design Active Approach –Noise factors ARE included in the experimental design in order to force variability to occur –Analysis is similar to the passive approach

7 The Passive Approach A factorial experiment is performed using Control factors. Noise factors are not explicitly manipulated nor is an attempt made to control them during the course of the experiment. Pros –Simple extension of standard experimental techniques –Does not require explicit identification of noise factors Cons –Requires larger number of replicates than would typically be required to determine mean effects –Requires “true” randomization and replication –Requires that noise factors be “noisy” during the execution of the experiment

8 How to ensure that noise is noisy? Let excluded factors vary Compare noise factor variations prior to and within DOE –Monitor noise factor levels during normal process conditions –Monitor noise factor variation during course of experiment –Compare before/during levels Run DOE over a longer period of time with : –More replicates –Full randomization

9 A Passive Example A and B are control factors. Within each treatment combination, noise factors are allowed to naturally fluctuate. Within treatment variation is largely driven by this background noise. A B

10 Example output from a Passive Design The graphs at right illustrate the type of output which might be obtained from a Robust Parameter Design Experiment. Both are Main Effects plots with the top row showing the main effects of factors A and B on the mean and the bottom row showing the main effects of factors A and B on the variation. Note that in this example the mean and variation can be adjusted independently of each other! Mean Y Variation Y

11 The Models Our objective in performing a designed experiment is to develop a transfer function between the factors (X’s) and the Y. Thus far, we have only addressed the mean of Y. Now we must also consider the variability of Y If our experiments are successful at identifying a variation effect, we now have an opportunity to simultaneously optimize both equations!

12 Example: A Passive Noise Experiment A design engineer has evaluated the output performance of a circuit design and performed an initial capability analysis of this design to determine if there is a problem with the mean and/or the variability. Stat > Quality Tools > Capability Analysis > Normal Y = Y1Initial; Lower Spec = 58; Upper Spec = 62

13 Design Capability Analysis Is there a problem?

14 2 4 Full Factorial Experiment A 2 4 full factorial has been designed to determine if four factors have an effect on the mean and/or variability of voltage drop (Y1). There are five replicates for a total of 80 runs, with no center points or blocks. –Resistor R33 (A) –Inductor L3 (B) –Capacitor C23 (E) –Capacitor C29 (F) Worksheet: “Passive Design”

15 Passive Analysis Roadmap - Part 1 (for Mean Only) Analyze the response of interest –Factorial Plots (Main Effects, Interaction) –Statistical Results (ANOVA table and p-values) –Residual Plots by factor Reduce model using statistical results Use the residuals plot to evaluate potential existence of variation effects –If residuals plot indicates a possible variation effect, go to Passive Analysis Roadmap - Part 2

16 Interaction Plot Based on the interaction plot, a few of the interactions may be significant. Check the statistical output for verification. Stat > DOE > Factorial > Factorial Plots > Interaction Plot

17 Main Effects Plot The main effects plot indicates that factors B and E have the largest effects. Factor A also has a moderate positive effect. Factor F does not seem to be important. Let’s look at the results. Stat > DOE > Factorial > Factorial Plots > Main Effects Plot

18 Factorial Analysis A preliminary look at the statistical output of the experiment indicates factor F may not be significant. Did we make a mistake by including it in the experimental design? * Note that the 3-way and 4-way interactions are still in the model but not presented in the output above Stat > DOE > Factorial > Analyze Factorial Design Estimated Effects and Coefficients for Y1 (coded units) Term Effect Coef SE Coef T P Constant A B E F A*B A*E A*F B*E B*F E*F

19 Reduce Model to Significant Terms Our final model indicates that factors A, B, and E are significant, along with interactions BE, BF, ABF, and BEF, using a p-value cut-off of 0.2 Estimated Effects and Coefficients for Y1 (coded units) Term Effect Coef SE Coef T P Constant A B E F B*E B*F A*B*F B*E*F S = R-Sq = 73.11% R-Sq(adj) = 70.08% Stat > DOE > Factorial > Analyze Factorial Design

20 The Role of Residual Plots in RD In Robust Parameter Design, the residual plots can show the possibility for a variation effect Remember from ANOVA and Regression, we stated one of the assumptions on the residuals was constant variance and we checked this via plots Stat > DOE > Factorial > Analyze Factorial Design Choose Graphs > Residuals vs Variables > A B E F

21 What Next? After reducing the model, the “Residuals versus Factor F” plot still indicates that F contributes to a variation effect. This finding should encourage us to move further in the analysis of this data to create a variability response and analyze the data. Thus we move on to Part 2 of the roadmap. Stat > DOE > Factorial > Analyze Factorial Design Choose Graphs > Residuals vs Variables > F

22 Create a Variability Response Analyze Variability –Factorial Plots (Main Effects, Interaction) –Statistical Results (ANOVA table and p-values) –Reduce model using statistical results Compare main effects plots for mean and variability to determine which are Mean Adjustment Factors and which are Variance Adjustment Factors (or both) Use the Multiple Response Optimizer to find optimal settings of the factors –Mean on target –Minimum variability Perform a capability study / analysis on the resulting factor settings Passive Analysis Roadmap - Part 2 (if Variation effect present)

23 Create a Variability Response We are now going to use the replications to make a new response in order to model the variability. Once we have modeled the variability, we can use the MINITAB Response Optimizer to find the settings of the control factors that will put Y on target with minimum variation. MINITAB makes this easy with a pre-processing of the responses in preparation for a variability analysis You will see that MINITAB will use the standard deviation as the measure of variability, rather than the variance –the results are equivalent

24 Uses Natural Log (Standard Dev of Y) All of the statistical techniques that we are using to analyze this DOE assume that the data is symmetric (because we are testing for mean differences) Unfortunately, when we use a calculated standard deviation as a response, we do not meet this assumption because the sampling distribution of variances is expected to be skewed, hence the distribution of standard deviations would also be skewed Raw St Dev Ln (St Dev)

25 Create a Variability Response Stat > DOE > Factorial > Pre-Process Responses for Analyze Variability

26 Create a Variability Response Worksheet should now contain the following new columns

27 Analyze the Variability Analysis of the variability will be essentially identical to the analysis for the mean Will select the “Terms” to estimate in the model Will use the Pareto of Effects “Graph” in order to facilitate the first model reduction Stat > DOE > Factorial > Analyze Variability

28 Analyze the Variability TERMSGRAPHS

29 Pareto Chart of the Effects Because we don’t have any degrees of freedom for error, we must look at the Pareto of effects to decide which term to drop into the error and begin to reduce the model Drop ABD interaction first

30 Final Model for ln StDevY1 Once the insignificant terms have been eliminated using a p- value cut-off of 0.2, the reduced model is shown below Regression Estimated Effects and Coefficients for Natural Log of StDevY1 (coded units) Ratio Term Effect Effect Coef SE Coef T P Constant A B E F A*B A*E A*F B*F A*B*E B*E*F A*B*E*F R-Sq = 99.93% R-Sq(adj) = 99.75%

31 Interaction Plot for StDevY1 The interaction plot indicates a moderately strong interaction between factors A & E and A & F Stat > DOE > Factorial > Factorial Plots > Interaction Plot Where should factors A, B, E and F be set in order to minimize the variability in voltage drop, Y1?

32 Main Effects Plot for StDevY1 Factor F has the largest effect on the variability. Increasing F should reduce variability. But what did the interaction plot show? Factor A is the next strongest. Set A = 10. What did the interaction plot show? Factors B and E are weak but what did the interaction plot show? Stat > DOE > Factorial > Factorial Plots > Main Effects Plot

33 Determine Mean & Variation Effects The graphs at right allow us to directly compare each factor’s singular effect on both the mean and variation Based on these graphs, –Factors B and E are Mean Adjustment Factors since they affect the mean with little or no effect on the variability –Factor F is a Variance Adjustment Factor since it affects the variability with little or no effect on the mean –Factor A appears to affect both mean and variability Affects Both Affects Mean Affects Variation

34 Quality Check: Status of Your Models Use the “Show Design” icon to check on the status of the analysis. You should make sure that the correct model has been fit for each response that you intend to specify in the response optimizer. As shown in this window, models have been fit for both the Y1 and StDevY1 responses

35 Multiple Response Optimizer Stat > DOE > Factorial > Response Optimizer Set the Weight for Y1 to 10 to ensure hitting 60, tight lower & upper range Read “first-guess” target & upper values for StDevY1 from interaction plots –Note that StDevY1 is in regular units here, NOT logged units! For StDevY1, set weight low to protect against a bad first guess

36 Multiple Response Optimizer We use the multiple response optimizer to provide a stacked main effects plot. This plot allows us to interactively manipulate the values of each factor in the model and see the effect on both the mean and the variation. You can use the red sliders to tune each of the factors

37 Use the Equations to Confirm Y1 Let’s use the model coefficients to predict and see that it matches (make sure to use un-coded)! From the optimized solution, A = , B = 1, E = 13.5, F = 69 Y1 = *A *B *E *F *B*E *B*F *A*B*F *B*E*F Y1 = * * * * *1* *1* * *1* *1*13.5*69 Y1 = , as seen in the optimizer window

38 Use the Equations to Confirm StDevY1 Again, make sure to use the un-coded coefficients! Again, A = , B = 1, E = 13.5, F = 69 lnStDevY1 = *A *B *E *F *A*B *A*E *A*F *B*F *A*B*E *B*E*F *A*B*E*F lnStDevY1 = * * * * * * * * * * *1* * *1* *1*13.5* * *1*13.5*69 lnStDevY1 = StDevY1 = e = , as seen in the optimizer

39 Final Design Capability Analysis Did we achieve our objectives? worksheet “passive capability” Stat > Quality Tools > Capability Analysis > Normal Y = Y1Final; Lower Spec = 58; Upper Spec = 62

40 Remember the Two Strategies? We just reviewed the Passive Approach –Noise factors are NOT included, manipulated or controlled in the experimental design –We analyzed the variability of replicates from an experimental design Now we will look at the Active Approach –Noise factors ARE included in the experimental design in order to force variability to occur –We will see that the analysis is similar to the passive approach

41 The Active Approach A factorial experiment is performed using Control AND Noise factors in the same experiment. Analysis can be performed by characterizing Control*Noise interactions only or by moving forward to analyze the variability by dropping the noise factors into the error term. Pros –Simple extension of standard experimental techniques –Guarantees noise in the Noise factors –Provides for flexibility in analysis methods –Can allow for reduced replication Cons –Requires ability to manipulate and control Noise factors –Optimal designs for minimization of unneeded effects (noise by noise interactions) can be difficult to create

42 3 control factors 1 noise factor 2 4 full factorial design Two Approaches to Analysis –Use only interpretation of interaction plots to choose settings of the control factors to minimize effect of noise –Model the variability by dropping the noise factors into the error and analyze like the passive approach Example: An Active Noise Experiment

43 Active Analysis Roadmap – Plots Only Create and execute with noise included as a factor Analyze the response of interest –Factorial Plots (Main Effects, Interaction) –Statistical Results (ANOVA table and p-values) –Reduce model using statistical results Review Interactions Plot –Interpret the interaction plots to look for evidence of variation effects Review Main Effects Plot (if applicable) Use the Multiple Response Optimizer to find the optimal settings of the factors such that the mean is on target –Will force in settings obtained from the interaction plots Perform a capability study / analysis on the resulting factor settings

44 Example: An Active Noise Experiment An engineer is interested in improving the stability and robustness of a filtration product Review the capability of the current performance to determine the opportunity to apply robust design techniques Stat > Quality Tools > Capability Analysis > Normal Y = Y4Initial; Lower Spec = 60; Upper Spec = 80

45 Design Capability Analysis What conclusions can you draw from this graph?

46 Example: An Active Noise Experiment The device contains several control factors from which three were identified as DOE candidates –Pressure (A) –Concentration (B) –Stir Rate (C) Ambient Temperature was identified as being significant, but not economically controllable –Temperature would not change appreciably during the time in which it would take to execute a three factor experiment –Decided to include it as a factor in the design to force it to change –Call this Factor G

47 The Experimental Design A fractional design (Res IV) was rejected because the 2-way interactions are of great interest in this experiment A 2 4 full factorial design was used Because of time constraints, only 1 replicate was performed The variables are listed below: –A = Pressure –B = Concentration –C = Stir Rate –G = Temperature The data is in worksheet “Active Design” Open worksheet “Active Design” within “Robust Design.mpj”

48 Factorial Analysis This DOE is an unreplicated, 4-factor full factorial –We need to create the “Pareto of Effects” chart Stat > DOE > Factorial > Analyze Factorial Design

49 Fit the Reduced Model Stat > DOE > Factorial > Analyze Factorial Design Based on the p-values, the A*G and B*G and C*G interactions are important. Since we have identified some important control*noise interactions, the next step is to examine the interaction plots. Estimated Effects and Coefficients for Y4 (coded units) Term Effect Coef SE Coef T P Constant A B C G A*B A*G B*C B*G C*G A*B*C A*B*G A*B*C*G

50 Interaction Plot The interaction plot show the valuable interactions available to the designer. Let’s take a closer look at the strongest ones. Stat > DOE > Factorial > Factorial Plots > Interaction Plot

51 Interaction Plot – A Closer Look The two interaction plots at right indicate that both B and C can be exploited to desensitize Y4 to the noise variable G –If B is set at its high level, the slope of the G effect line is minimized –If C is set at its low level, the slope of the G effect line is also minimized To minimize output variation due to noise in ambient temperature (G), the above two settings should be controlled in the design

52 Main Effects Plot Since factor A is not involved in a significant interaction and its main effect is significant, we should take a look at its main effect plot to see if there is some potential value in controlling A This plot indicates that factor A has about +/- 3 units of control over the nominal value of Y4. Thus, if manipulating one of the other factors takes the mean value off target, this factor could be used to exert some control over the mean value of Y. Stat > DOE > Factorial > Factorial Plots > Main Effects Plot

53 New Settings : Capability Analysis B was set to 5, C was set to 150, A was left at nominal (15) It appears that the changes to B & C were successful in reducing variation in Y4 but the mean is now off target Use factor A to adjust back to target!

54 How much should we shift factor A? Set up the response optimizer to target 70. The lower and upper limits are not important since we will manually manipulate this. Set factor B=5 and factor C=150. The optimizer indicates a nominal Y4=67.7, very close to that observed in the validation study. Finally, slowly slide the bar for factor A to the right while observing the predicted value of Y4. This indicates that a nominal setting of A=18.8 should achieve Y4=70. Worksheet “active design” Stat > DOE > Factorial > Response Optimizer

55 New Setting for A : Capability Analysis When we shift factor A to this new nominal value, we succeed at shifting the response to put it on target without degrading the variation

56 Summary Variation improvement strategies can take two forms: –Passive Approach –Active Approach The choice of which strategy to use depends on the ability to control or manipulate noise factors (at least for the duration of the experiment) Standard full and fractional designs can be used Variation effects must be calculated using replications A log transform of the variability response is automatically used to minimize the effects of asymmetry in the variance distribution The response optimizer can be used to simultaneously optimize both mean and variability responses A validation study must be made at the end of a Robust Parameter Design study

57 Design for DFSS-57 Copyright 2003 Cummins, Inc. All Rights Reserved. Copyright Sigma Breakthrough Technologies, Inc. Used with permission. Objectives Revisited At the end of this module, participants should be able to : Identify possible variation effects from residual plots Create a variability response from replicates Identify possible mean and variance adjustment factors from noise-factor interaction plots Use the MINITAB Response Optimizer to achieve a process on target with minimum variation Complete validation capability studies


Download ppt "Executing Robust Design. Definition of Robust Design Robustness is defined as a condition in which the product or process will be minimally affected by."

Similar presentations


Ads by Google