1. How can we improve the quality of Cochrane Reviews (in 8 minutes)? David Tovey

2. What is quality? ? ValidRelevantAccessibleTimely

3. Moving from process to end point

4. What is a good enough review?

5. You should see the rubbish that is submitted to us..

6. And the authors are volunteers.... so what can we do?

7. Hmmm....what would she do?

8. What does these chaps think about improving quality?

9. Whats the plan? Agree standards Set standards Measure against standards Act

10. And training....

11. Results: 3 priorities Presenting effects Significance and non significance Harms

12. Absolute and relative effects If Cochrane reviews continue to express results solely in [relative] terms, they will continue to mislead clinicians, reporters, and the general public in just the way the pharmaceutical and vaccine companies would like. ****s were significantly more effective for [outcome] than placebo (OR 3.20, 95% CI:2.85, 4.27).

13. A recommended approach is to re-express an odds ratio or a risk ratio as a variety of NNTs across a range of assumed control risks... If a relative effect measure..is chosen for meta-analysis, then a control group risk needs to be specified as part of the calculation of an ARR or NNT

14. No evidence of an effect? Combined data from the... studies revealed a non-significant difference between groups There was a trend towards an increase in risk of [outcome]

15. Review authors are advised not to describe results as not statistically significant or non significant

16. 0Favours interventionFavours control

17. 0Favours interventionFavours control

18. 0Favours interventionFavours control

19. Harms A Cochrane review that considers only the favourable outcomes of the interventions....will lack balance and make the intervention look more favourable than it should.. Different types of studies may be needed to evaluate different outcomes

20. Harms A Cochrane review that considers only the favourable outcomes of the interventions....will lack balance and make the intervention look more favourable than it should.. Different types of studies may be needed to evaluate different outcomes Observational studies are almost always necessary to assess harms adequately 1 1 Chou, Aronson, Adkins et al 2010

21. Conclusions Review quality is of paramount importance (Strategic review recommendation #1) Quality is multi-faceted We need to work together to identify, agree and implement explicit review quality standards – Across review groups (warranted and unwarranted variation)