1. Reading and evaluating the scientific and medical literature Robert Silbergleit, MD Department of Emergency Medicine

2. Goals Reading Philosophy Habit Strategies Evaluating Question Design Other Bias Statistics

3. Philosophy The scientific literature is a discussion

5. Philosophy Data are plentiful but truth is elusive

6. Habit You must read.

7. Habit You must read. There is too much to read.

8. “It’s all right, sweetie. In the information age, everybody feels stupid.”

9. Strategies Strategies for reading –Grazing –Searching –Delivery

10. Strategies Information age strategic aids. –On-line journals –Weekly search agents Traditional strategic aids. –Review articles –Lectures –Journal clubs

11. Strategies Putting it together- a clinician’s strategy –NEJM (or JAMA or BMJ) –Clinical specialty journal (or 2) –Special interest or subspecialty journal –Abstract service

12. Strategies A research scientist’s strategy –Science (or Nature) –A research focus journal (or 2) –A weekly literature search agent

13. Strategies Pitfalls –Intimidation –Education that is not education –Honor and beware the opinion leaders

14. Strategies Strategies for skimming –Table of contents –Abstract (don’t believe it) –Figures (or Results text) –Methods –Intro and discussion

15. Abstracts were found to contain errors or inaccurately represent the article 48% of the time, and ranged from 18% in one journal to 68% in another. JAMA 1999;281:1110

16. Evaluating Assessing quality Being critical Determining value

18. Question Did they ask the right question? Did they answer the right question? Is the outcome they measured the one they are interested in?

19. Question What makes a good outcome measure? –Meaningful –Accurate (Gold standard) –Objective –Distinct

20. Question Is the correct population studied, or the appropriate animal model used? –Referral bias –Species differences

22. Design Randomized and controlled Observational (cohort, case-control)

23. Bias In science we mean: Any systematic uncontrolled influence on data that favors a particular result.

24. Bias But sometimes it really is the lay definition: A preference or inclination that inhibits impartial judgment.

25. Bias Publication bias Spectrum bias

26. Statistics Clinical v. statistical “significance” Hypothesis testing and the p-value Multiple comparisons Regression and confounding

28. Take home points Science is a discussion Make scientific reading a habit Be skeptical, don’t be cynical