Presentation is loading. Please wait.

Presentation is loading. Please wait.


Similar presentations

Presentation on theme: "REGRESSION TO THE MEAN AS A TOOL TO UNDERSTAND OUT-OF- SPECIFICATION (OOS) RESULTS Jyh-Ming Shoung and Stan Altan"— Presentation transcript:

1 REGRESSION TO THE MEAN AS A TOOL TO UNDERSTAND OUT-OF- SPECIFICATION (OOS) RESULTS Jyh-Ming Shoung and Stan Altan Midwest Biopharmaceutical Statistics Workshop Session on Statistical Mitigation of OOS and OOT in a QbD World May 24,

2 O UTLINE o Introduction  OOS Guidance for Industry (October 2006) – the current regulatory view o Out-of-Specification (OOS) results viewed through the prism of Regression to the Mean(RtM) o OOS Case Study – applying RtM principles o Recommendations 2

3 I NTRODUCTION THE CURRENT REGULATORY VIEW OOS Guidance for Industry (October 2006)  Prescriptive approach to investigations addressing the question of root cause  Is there a flaw in the product or process?  Statistical references ;  Outlier testing - write it into the SOP  It should never be assumed that the reason for an outlier is error in the testing procedure, rather than inherent variability in the sample being tested.  Retesting (of the original sample)  The number of retests to be performed on a sample should be specified in advance by the firm in the SOP…based on scientifically sound, supportable principles. The number should not be adjusted depending on the results obtained.  Re-sampling (new sample) appears to be discouraged, the original sample is supposed to be large enough to permit re- testing 3

4 OOS GUIDANCE – WHAT IS THE ISSUE? o Ignores statistical considerations  “In cases where … some of the individual results are OOS, some are within specification,... the passing results are no more likely to represent the true value for the sample than the OOS results…and treat the reportable average of these values as an OOS result, even if that average is within specification. … every individual application of the official test should be expected to produce a result that meets specifications.” o This language is in conflict with the basic principle that the essential quality statement is captured in the ‘average’ and variability between dose units is captured in a separate protocol o An operational root cause will not be found for some or many OOSs, and this does not necessarily indicate a product or process flaw 4

5 Q UALITY BY D ESIGN – AN OPPORTUNITY TO REVISIT OOS MANAGEMENT ? o Improved Process Knowledge  Systematic Development approach  Formulation understanding  Process understanding  Packaging understanding o Identify Critical to Quality Attributes (CQAs) o Process Understanding as input to risk management - Quality risk management o Control what is critical - Advanced control strategy 5

6 A PROCESS IS WELL UNDERSTOOD WHEN… o All critical sources of variability are identified and explained  OOSs WILL happen occasionally o Variability is managed by the process  How do we integrate occurrence of OOS’s in a QbD framework o Product quality attributes can be accurately and reliably predicted over the design space  Basic Principle : Occurrence of isolated OOSs does not contradict quality in product manufacture 6

7 o Multiple repeated stability determinations of the same lot on stability necessarily lead to an increasing chance of an OOS o Such OOSs require context and mitigation o Statistical mitigation is completely consistent with QbD concepts of advanced risk management and control strategies 7 Tim Schofield (Specs Workshop, 2005)

8 OOS’ S VIEWED THROUGH THE PRISM OF R EGRESSION TO THE M EAN IN A QbD C ONTEXT o An isolated OOS can be thought of as a random outcome related to incipient sources of variability and hence should be viewed as a normal part of data collection and testing o Compliance considerations have clouded the true understanding of the occurrence of OOSs o Under QbD, control strategies related to statistical considerations can be brought to bear to understand and assess the ‘truth’ of an OOS o OOSs can be mitigated through the application of a Regression to the Mean approach 8

9 R EGRESSION TO THE M EAN (RtM) 9 Regression to the Mean (RtM) is a statistical phenomenon that occurs when repeated measurements are made on the same subject or unit of observation. During development studies or commercial studies where numerous analytical determinations are being carried out on the same batch or process, isolated unusual observations can be expected and understood as a ‘pretest’ to be mitigated through a ‘posttest’.


11 H ARMONIZED C ONTENT U NIFORMITY T EST - USP (J ANUARY, 2007) 11 Stage 1, 10 Tablets Yes PASS No Stage 2, additional 20 Tablets Yes PASS No FAIL

12 D ATA D ESCRIPTION AND G OAL o Data  2,000 marketed lots from 12 different groups of sizes  Manufactured prior to 2007 and tested under old USP method  6 lots (A – F) with Stage 2 CU data  New USP test criteria applied to all 2000 lots  1,997 lots passed new USP test,  3 lots failed (X, Y, Z) Stage 1, Stage 2 not available o Issue  Lots (X, Y, Z) failed new Stage 1 test and no Stage 2 data o Objective  Predict Stage 2 test likely outcome based on a RtM analysis 12

13 S TAGE 2 RtM T RAJECTORIES IN 6 L OTS 13 3 lots without S2 samples S1 (n=10) test criteria S2 (n=30) test criteria

14 M ODEL A SSUMPTIONS AND F IT R ESULTS o 2,000 lots with Stage 1 and Stage 2 (only 6 lots) data were used for analysis o A mixed effects model was fit to the data with fixed effects for group and random effects due to lot-to-lot within group, stage-to-stage test (analytical run-to-run) within lot and residuals (dose unit, measurement error, etc.) o The estimated variance components are as follows:  Var(Lot) (  b 2 ) = 2.8  Var(Stage) (   2 ) = 7.1  Var(Resid) (  w 2 ) =

15 M ULTIVARIATE N ORMAL D ISTRIBUTION Considering the following two equations where b,  1,  2, w 1, w 2i are independent and 15

16 T HEORETICAL R T M E FFECT Given, And the conditional distribution of  +b given is where 16

17 SIMULATION OF USP STAGE 2 TEST - ADDITIONAL 20 SAMPLES GIVEN STAGE 1 MEAN 17   Adding variability due to stage-to-stage Adding 20 residual errors RtM Effect

18 E MPIRICAL R T M E FFECT The empirical RtM effect can be estimated by a linear regression of second stage mean (n=20) on the first stage mean (n=10) from those 6 lots with stage 2 results as follows: Obs.S2mean – Group Mean =  × (Obs.S1mean – Group Mean) + error 18

19 19 Empirical RtM Theoretical RtM

20 10,000 S IMULATED S2 R ESULTS L OT A 20 Observed S1 result (n=10) Observed S2 result (n=30) Simulated S2 results (n=30)

21 21

22 S UMMARY R ESULTS Statistical evaluation of 3 lots reporting outlying Stage 1 results shows that on simulated retest, all 3 would pass Stage 2 criterion (> 99%) as a consequence of Regression to the Mean Principle with high certainty Caveat : Limited information to estimate RTM effect but justified by the overwhelmingly stable behavior of the process This case study shows the application of the RtM principle to OOS mitigation 22

23 R ECOMMENDATIONS AND F UTURE R ESEARCH o As a consequence of the Clinical Drug Development paradigm, Quality of Materials should be related to the Average as the essential quality statement o Content uniformity should not be inferred from isolated indeterminate OOSs o Re-sampling should be part of a control strategy to mitigate OOS and exploit the RtM principle to achieve a more representative sample for calculating the lot Average o The RtM principle can serve as a basis for pursuing advanced control strategies for OOS mitigation o Directions for future research  Bayesian approach – in a commercial context could be easier to justify priors  Errors-in-variable adjustment 23


Similar presentations

Ads by Google