Unequal Randomisation

Slides:



Advertisements
Similar presentations
Correcting for Selection Bias in Randomized Clinical Trials Vance W. Berger, NCI 9/15/05 FDA/Industry Workshop, DC.
Advertisements

Inferential Statistics and t - tests
Randomized Controlled Trial
Statistical Techniques I
Breakout Session 4: Personalized Medicine and Subgroup Selection Christopher Jennison, University of Bath Robert A. Beckman, Daiichi Sankyo Pharmaceutical.
Hypothesis testing Another judgment method of sampling data.
Statistics Review – Part II Topics: – Hypothesis Testing – Paired Tests – Tests of variability 1.
Statistical considerations Alfredo García – Arieta, PhD Training workshop: Training of BE assessors, Kiev, October 2009.
Use of Placebos in Controlled Trials. Background The traditional ‘double-blind’ RCT uses a placebo to conceal allocation. There are a number of advantages.
Meta-analysis: summarising data for two arm trials and other simple outcome studies Steff Lewis statistician.
Observational Studies and RCT Libby Brewin. What are the 3 types of observational studies? Cross-sectional studies Case-control Cohort.
Improving the Economic Efficiency of Clinical Trials.
Thinking hats: What are the key assumptions of each approach? What are the benefits of each approach? What are the weaknesses of each approach? This is.
Point estimation, interval estimation
N = 1, Cross-Over Trials and Balanced Designs. N = 1 Trials Trials can be undertaken with just one participant. If the condition is a chronic relapsing.
Stopping Trials for Futility RSS/NIHR HTA/MRC 1 day workshop 11 Nov 2008.
Clinical Trials Hanyan Yang
Pragmatic Randomised Trials. Background Many clinical trials take place in artificial conditions that do not represent NORMAL clinical practice. Often.
11 Populations and Samples.
Factorial Designs. Background Factorial designs are when different treatments are evaluated within the same randomised trial. A factorial design has a.
Pre-randomisation consent (Zelen’s method)
5-3 Inference on the Means of Two Populations, Variances Unknown
Sample size calculations
Sample Size Determination
Sample Size Determination Ziad Taib March 7, 2014.
Determining Sample Size
Intervention Studies Principles of Epidemiology Lecture 10 Dona Schneider, PhD, MPH, FACE.
1 Experimental Study Designs Dr. Birgit Greiner Dep. of Epidemiology and Public Health.
Week 9 Testing Hypotheses. Philosophy of Hypothesis Testing Model Data Null hypothesis, H 0 (and alternative, H A ) Test statistic, T p-value = prob(T.
CHAPTER 16: Inference in Practice. Chapter 16 Concepts 2  Conditions for Inference in Practice  Cautions About Confidence Intervals  Cautions About.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 6 Sampling Distributions.
ECON ECON Health Economic Policy Lab Kem P. Krueger, Pharm.D., Ph.D. Anne Alexander, M.S., Ph.D. University of Wyoming.
The time to progression ratio for phase II trials of personalized medicine Marc Buyse, ScD IDDI, Louvain-la-Neuve, and I-BioStat, Hasselt University, Belgium.
Standard Error and Confidence Intervals Martin Bland Professor of Health Statistics University of York
N318b Winter 2002 Nursing Statistics Lecture 2: Measures of Central Tendency and Variability.
No criminal on the run The concept of test of significance FETP India.
Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter 7 Sampling Distributions.
Sample Size In Clinical Trials In The Name Of God Sample size in clinical trials.
Adaptive randomization
What is a non-inferiority trial, and what particular challenges do such trials present? Andrew Nunn MRC Clinical Trials Unit 20th February 2012.
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
통계적 추론 (Statistical Inference) 삼성생명과학연구소 통계지원팀 김선우 1.
Overview of Study Designs. Study Designs Experimental Randomized Controlled Trial Group Randomized Trial Observational Descriptive Analytical Cross-sectional.
MPS/MSc in StatisticsAdaptive & Bayesian - Lect 61 Lecture 6 Response adaptive designs 6.1Unequal treatment allocation 6.2Varying the allocation ratio.
MPS/MSc in StatisticsAdaptive & Bayesian - Lect 51 Lecture 5 Adaptive designs 5.1Introduction 5.2Fisher’s combination method 5.3The inverse normal method.
1 Health and Disease in Populations 2002 Session 8 – 21/03/02 Randomised controlled trials 1 Dr Jenny Kurinczuk.
Sample Size Determination
Compliance Original Study Design Randomised Surgical care Medical care.
Matching. Objectives Discuss methods of matching Discuss advantages and disadvantages of matching Discuss applications of matching Confounding residual.
MPS/MSc in StatisticsAdaptive & Bayesian - Lect 91 Lecture 9 Bayesian approaches for quantitative responses 9.1 Proof-of-concept studies outside oncology.
X Treatment population Control population 0 Examples: Drug vs. Placebo, Drugs vs. Surgery, New Tx vs. Standard Tx  Let X = decrease (–) in cholesterol.
Hypothesis Tests. An Hypothesis is a guess about a situation that can be tested, and the test outcome can be either true or false. –The Null Hypothesis.
MPS/MSc in StatisticsAdaptive & Bayesian - Lect 31 Lecture 3 Sequential designs 3.1 A multi-stage (or group sequential) design 3.2 A general setting for.
Chapter 10: The t Test For Two Independent Samples.
Inference for a Single Population Proportion (p)
Sample Size Considerations
CHAPTER 9 Testing a Claim
Sample Size Determination
How many study subjects are required ? (Estimation of Sample size) By Dr.Shaik Shaffi Ahamed Associate Professor Dept. of Family & Community Medicine.
Interventional trials
Chapter 8: Inference for Proportions
Statistical Process Control
Chapter 6 Hypothesis tests.
Chapter 9 Hypothesis Testing.
Estimating with Confidence
CHAPTER 9 Testing a Claim
Comparing Populations
Interpreting Basic Statistics
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Presentation transcript:

Unequal Randomisation

Background Most RCTs randomised participants into equally sized groups. Equal randomisation 1:1 ratio is statistically the most EFFICIENT method. For any given TOTAL sample size the most power to detect a difference occurs with equal group sizes. Statisticians usually recommend 1:1 as this satisfies their desire for POWER.

Allocation Ratios and Power Although a ratio of 1:1 does produce the most power ratios of 2:1 or 3:2 do not substantially reduce power. 2:1 for example moves a study’s power from 80% to 75%. Therefore, quite LARGE imbalances in sample sizes have little effect on power.

Why unequal allocation? Sometimes it is better to put more participants into one group than another. Reasons are as follows: Practical Learning curve Cost Statistical

Practical/Administrative For some treatments such as group therapy sessions there might be a minimum number of participants needed to make the group sessions viable. For example, Hundley et al allocated more women in a mid-wives trial to the new intervention in order to keep the ward full.

Learning Curve A new technique, e.g. surgery, may require some learning. More participants allocated to the new treatment can allow a more precise estimate of any learning effects. For example Garry et al, (BMJ 2004,328,129) used unequal allocation in favour of a laparoscopic surgery so surgons had more people to practice on. Interestingly, they did not look at the effects of learning in their analysis

Treatment experience As well as learning curve we might be interested in the side-effect profile of a new treatment. For standard therapy side-effects will be well established, but for the new treatment there are more unknowns. Therefore, we might have more people so that we have more power to pick up any unknown side-effects.

Ethics Some people advocate unequal allocation to minimise exposure to either the control treatment or new, hazardous treatment. This suggests, to me, that there is a strong belief in one treatment, which would question the necessity of the trial. I would not use unbalanced allocation for ethical reasons.

Cost An important reason, commonly overlooked, is due to cost. One treatment may be much more expensive than the alternative and the trial can be made much cheaper if more people are allocated to the cheaper treatment. Indeed this could make a trial more powerful.

Cost and power ALL trials have a limited budget. We want to get MOST power from this money. The idea behind putting more people onto the cheaper treatment is that it the savings released can be used to put MORE people into the trial.

Cost savings Trial cost efficiency may be improved by allocating more participants to the less expensive treatment and more to the cheaper treatment. Statistical power can be maintained by increasing the sample size. OR power can even be increased by recruiting MORE participants.

Optimum Randomisation Ratio The most efficient allocation ratio is calculated by the square root of the cost ratio of two treatments. If treatment A costs 4 X as much as treatment B then the optimum allocation ratio is 2 or 9 x as much then the ratio is 3.

Example MRC Taxol trial for ovarian cancer. The new drug, taxol, extremely expensive about £10,000 per patient. In order to reduce costs the trialists allocated twice as many women to the control group (2:1) than in the treatment arm.

Cost Savings of Unequal allocation

Cost Savings By using an unequal allocation ratio the trial saved about £1 million. Many studies do not have as dramatic cost difference but important savings can still be made.

Hip Protector Trial In the hip protector trial a key additional cost was the cost of the hip protectors (about £80 per person for 3 pairs including postage). The cost of controls, after recruitment costs, was mailing out follow-up q’naires.

Estimating the ratio Initially we thought we would recruit 10% of women we approached. The cost of the mailout was about £1 a person. To recruit 100 women would cost £1,000 (£10 per person). To follow-up the women would be another £5 in postage after randomisation (£15 in total). The intervention group would cost an additiona £80 (£95 in total) 95/15 = 6.3, square root = 2.51.

Ratio We, therefore adopted an allocation ratio of 2:1. BUT recruitment costs went up to £20 per woman therefore the ratio of costs were 4.2, square root is about 2. Therefore, our optimum ratio still remained about 2.

Cost savings We estimated to have saved 10% of our research budget by using unequal allocation, which allowed us to mail out to more participants (to compensate for the unexpected shortfall in recruitment) and follow up participants for longer.

Recruitment with fixed budget Increase allocation to control using saved money to increase mail out. Disadvantages will increase workload for local trial co-ordinators in terms of data entry and data management.

Allocation Ratio - lessons A fixed allocation ratio is unlikely to be correct through the lifetime of a trial. Should plan for an adaptive allocation and change ratio during recruitment if cost ratio changes. Budget planning should probably start with an ‘inefficiently’ high allocation (e.g. 3:2 or 1:1) ratio and adapt downwards (e.g. 2:1) as trial proceeds if necessary.

Allocation ratios: a review What is done in actual practice? To find out we are undertaking a review of trials using unequal allocation ratios to see why. We searched electronic databases using unequal allocation, unbalanced randomisation etc, plus personal knowledge. We couldn’t find many trials. This confirms that it is not used widely (unfortunately).

Reasons for unequal allocation Cost 4 (7%) Drop-outs 5 (9%) Pt acceptability Ethics 3 (5%) Experience 8 (14%) Other Not stated 30 (52%) Dumville et al, 2005.

‘Other’ reasons Expected variability differs in trial arms. Can increase power if more patients are allocated to group with larger SD as central limit theorum helps improve normality. Comparison of two treatment arms vs a control treatment (larger numbers in treatment arms to increase power of treatment vs treatment comparison).

Comparison of treatments We might have 3 arms: control; dose 1; dose 2. To compared dose 1 and 2 we would expect a muted treatment response, and therefore, we would need larger sample sizes to observe a treatment effect.

A Digression Unequal allocation, if undertaken randomly, STILL results in equivalent groups in terms of equal distribution of confounders. It does NOT lead to BIASED allocation.

Analysis of unequal allocation This is exactly the same as a trial that uses equal allocation EXCEPT if the allocation ratio changes part of the way through the study. If the allocation does change this needs to be taken into account in the analysis.

Summary Most trials have unequal costs and probably could benefit from unequal randomisation. Most trials use even allocation. WARNING - many grant referees do NOT understand unequal allocation and some see it as UNSCIENTIFIC.