1. UNIVERSITY OF MISSOURI Family & Community Medicine Research Lessons Learned the Hard Way Richelle Koopman, MD, MS Kevin Everett, PhD Debra Parker Oliver, PhD

2. UNIVERSITY OF MISSOURI Family & Community Medicine -Oscar Wilde Irish author Experience is the name every one gives to their mistakes.

3. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson #1 Its more than the Science  Know what your intervention Is it the technology- or a planned use of the technology?  Develop an Intervention manual  Funding  IRB process- be proactive  Accounting/Budgeting- Be proactive and conservative  Human Resources- orientation, training, supervision,  Data Management- don’t wait until the end to look at it!!!!!  Fidelity plan and audits- How do you know they are all doing it the same?? How can you assure- how will you check

4. UNIVERSITY OF MISSOURI Family & Community Medicine - Mark Twain American humorist, Missourian A man who carries a cat by the tail learns something he can learn in no other way.

5. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson #2 Recruitment is hard  Be conservative!  Value of relationships  Important to consider individual agency culture  Have a back up plan  WEATHER/ NATURAL DISASTERS  Track recruitment statistics and look at them regularly!

6. UNIVERSITY OF MISSOURI Family & Community Medicine -James Joyce Irish author A man's errors are his portals of discovery.

7. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson # 3 Pilots are IMPORTANT  Firm up the intervention manual  Develop recruitment plan  Identify outcomes  Establish research team- Practice  Test feasibility of intervention- work out glitches

8. UNIVERSITY OF MISSOURI Family & Community Medicine - John Heywood British playwright, 1500s Many hands make light work.

9. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson #4 Don’t Try to do it All Yourself Investigative collaborators add their unique skills and perspectives Hire a Research Assistant  Pick a good one  Define their work  Then set them free  The right help can advance your project quickly Find the right balance between delegation and micromanagement

10. UNIVERSITY OF MISSOURI Family & Community Medicine - John Heywood British playwright, 1500s Rome was not built in a day.

11. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson #5 Timelines: Multiply by Three (at least) Things always take longer than you expect Things happen  People get sick (maybe even you)  Unanticipated extra steps  Major catastrophes

12. UNIVERSITY OF MISSOURI Family & Community Medicine - Tom Bodett American humorist The difference between school and life? In school, you're taught a lesson and then given a test. In life, you're given a test that teaches you a lesson.

13. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson #6: …Make Lemonade Unanticipated things will always happen Sometimes you can turn them into positives  (Like this presentation) Share your lemon stories so other people can learn from your “experience” Consider a real-world evaluation perspective like the RE-AIM framework

14. UNIVERSITY OF MISSOURI Family & Community Medicine - Tom Krause Motivational speaker & author, Missourian There are no failures - just experiences and your reactions to them.

15. UNIVERSITY OF MISSOURI Family & Community Medicine Lesson #6a: RE-AIM Framework Reach Effectiveness Adoption Implementation Maintenance RE-AIM.org Glasgow et. al. Kaiser Permanente Colorado Region

16. UNIVERSITY OF MISSOURI Family & Community Medicine - John Heywood British playwright, 1500s If you will call your troubles experiences, and remember that every experience develops some latent force within you, you will grow vigorous and happy, however adverse your circumstances may seem to be.

17. UNIVERSITY OF MISSOURI Family & Community Medicine - John Maxwell Leadership guru If we're growing, we're always going to be out of our comfort zone.

18. UNIVERSITY OF MISSOURI Family & Community Medicine - C.S. Lewis British scholar & novelist Experience: that most brutal of teachers. But you learn, my God do you learn.

19. UNIVERSITY OF MISSOURI Family & Community Medicine - Albert Einstein Physicist The only source of knowledge is experience.

20. Questions ? UNIVERSITY OF MISSOURI Family & Community Medicine