1. Social Work Research & Development Unit1 Implementing an RCT in Children’s Social Services challenges & complexities Dr Nina Biehal & Jo Dixon

2. Social Work Research & Development Unit2 Evaluating Multi-Dimensional Treatment Foster Care (MTFCE) Specialist, intensive foster care (from USA) DfES pilot: 15+ local authorities in England For adolescents with challenging/complex needs (11– 16yrs) Intervention delivered by foster carer + MTFCE team Time-limited placement Costly (as are some alternatives)

3. Social Work Research & Development Unit3 Design Pragmatic trial Comparing outcomes for young people placed in MTFCE and those in usual care placements Data collection - outcome measures+qualitative Randomise to offer of MTFCE placement or TAU Parallel Case Control Study

4. Social Work Research & Development Unit4 Challenges RCTs - well established in Health research and increasingly in Education research Different to other English Foster Care RCTs  children to placements v carers to training packages A number of challenges arise in implementing an RCT in social care:  Practical – implementation of the programme  Contextual - social care arena  Cultural – professional concerns  Gatekeeping – recruiting to the trial

5. Social Work Research & Development Unit5 Practical Challenges Multi-site – each site very small  Few places available (2 – 9)  Few & slow referrals, may be one at a time  MTFCE recruitment problems IMPACT upon trial recruitment Implications for sample size/power Heterogeneity of TAU Analysis of how/why MTFCE ‘works’ is complex  Many components/professionals/outcomes  Variations in treatment fidelity across sites

6. Social Work Research & Development Unit6 Contextual Issues RCT requires some control over intervention & practitioner support but:  15 autonomous local authorities  Multiple stakeholders in each LA: conflict /changing decisions Financial concerns – resistance to RCT:  Referrals to MTFCE can be driven by strategic/budgetary concerns(most costly yps earmarked)  Anxiety that costly places left empty  Concerns over selection bias Blinding difficult - strategies to overcome this

7. Social Work Research & Development Unit7 Cultural Issues & Professional Concerns Cultural issues:  RCT unfamiliar in social care (medical model)  Distrust, reluctance, resistance to RCT Professional concerns:  RCT undermines decision-making  Raises issue of accountability  Issue of placement ‘choice’ Concerns about professional autonomy  Bureaucratisation of SW

8. Social Work Research & Development Unit8 Gatekeeping Need agreement from all concerned  Parallel consent processes (intervention & trial)  Information overload for child  Fears that will put child off intervention  Timing - Trial recruitment at point of transition  Fear that randomising out = more rejection Lengthy negotiation to engage child in intervention  Can’t then reject child  So randomise to an offer, not to intervention  ITT analysis

9. Social Work Research & Development Unit9 Meeting these Challenges Real practical, contextual and wider difficulties Need to adapt design to context and intervention Get in early to influence referral procedures Flexibility and adaptation to professional concerns without compromising trial e.g.  Allow for matching pre-randomisation  Randomisation to offer, not intervention Encourage cultural shift  Protecting children from research/untested interventions  Convince of need for rigour Need for ongoing, sensitive negotiation  At all levels, on all sites  Staffing implications (funding) Find opportunities for ‘natural’ experiments?