1. 1 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Presents… 1 Outcome Measures for CILs A National Onsite Training Storing Outcome Information September 13-15, 2011 Portland, OR Presenters: Mike Hendricks, Ph.D. Bob Michaels

2. CIL-NET, a project of ILRU – Independent Living Research Utilization Outcomes& Outcomes Mgmt. LogicModels Storing Outcome Information Analyzing Outcome Information Using Outcome Information Choosing Outcomes to Measure to Measure Measurable Indicators Sources and Methods Gathering Outcome Information

3. 3 CIL-NET, a project of ILRU – Independent Living Research Utilization Why Does It Matter? Don’t want to lose your hard work -- All of it -- Parts of it Need to keep it confidential Need to be able to analyze it now May want to merge it with other information later on

4. 4 CIL-NET, a project of ILRU – Independent Living Research Utilization What Options Do I Have? Depends on how you gather the information If you use paper forms: - Lock the originals in a safe place (protection, confidentiality) - Enter the information into a computer (optical scanner, manual entry) - Maybe convert open-ended answers (words) into numbers - Maybe enter the words directly

5. 5 CIL-NET, a project of ILRU – Independent Living Research Utilization Or…. You could skip the paper forms entirely: - Interviewer types answers as they’re given - Computerize your questionnaire - Web-based surveys (Survey Monkey, etc.) - Other ways?

6. 6 CIL-NET, a project of ILRU – Independent Living Research Utilization NCIL Outcome Measures Project Storing Outcome Information 6

7. 7 CIL-NET, a project of ILRU – Independent Living Research Utilization How the Field Test Stored the Data Recorded originally on paper forms CIL staff entered the information from each paper form – numbers and words -- into a computerized data base (Survey Monkey)

8. 8 CIL-NET, a project of ILRU – Independent Living Research Utilization What is Survey Monkey? A private American company Enables users to create their own web-survey Uses free and enhanced paid products and services

9. 9 CIL-NET, a project of ILRU – Independent Living Research Utilization Why use Survey Monkey? Relatively inexpensive Excellent customer service Easy to design survey Simple collection systems Straightforward analysis of data

10. 10 CIL-NET, a project of ILRU – Independent Living Research Utilization Features of Survey Monkey Wide variety of question types (multiple choice, comment boxes, demographics, etc.) Requirements to answer questions Correction features Filtering, crosstabbing, and downloading responses Skip logic

11. 11 CIL-NET, a project of ILRU – Independent Living Research Utilization From the consumer interview form: Sometimes we’re able to help people learn new skills, new knowledge, or new resources, and sometimes we’re not. For you personally, do you think you’ve learned any new skills, knowledge, or resources you didn’t have when you first started working with ___(name of your CIL)___? Don’t Know____ (GO TO QUESTION #7) No___________ (GO TO QUESTION #7) Yes __________ (ASK QUESTION #6 BELOW)

12. 12 CIL-NET, a project of ILRU – Independent Living Research Utilization How it looks in Survey Monkey: *5. Sometimes we’re able to help people learn new skills, new knowledge, or new resources, and sometimes we’re not. For you personally, do you think you’ve learned any new skills, knowledge, or resources you didn’t have when you first started working with ___(name of your CIL)___? Don’t Know No Yes

13. 13 CIL-NET, a project of ILRU – Independent Living Research Utilization How it looks in Survey Monkey, cont’d. 6. What specific skills, knowledge, or resources did you learn about that you didn’t know before? WRITE ON THE FIRST LINE BELOW THE FIRST THING THE CONSUMER MENTIONS. IF THE CONSUMER MENTIONS A SECOND THING, WRITE IT ON THE SECOND LINE. A ______________________________________ B ______________________________________

14. 14 CIL-NET, a project of ILRU – Independent Living Research Utilization Or You Could Use a Commercial MIS Types of information the system is able to include: MIS Product CFALQ-90IO Demographic information?Yes Randomly sampling?Yes Cross-CIL outcome information now?MI Services/ Goals Services/ Goals Cross-CIL outcome information in the future? Yes Outcomes unique to a CIL?Yes Able to analyze outcome data?Yes Able to generate outcome reports?Yes

15. 15 CIL-NET, a project of ILRU – Independent Living Research Utilization Your Turn How do you plan to store outcome information back at your own CIL? Talk about this at your table.

16. 16 CIL-NET, a project of ILRU – Independent Living Research Utilization For more information Contact: Mike Hendricks – MikeHendri@aol.comMikeHendri@aol.com Bob Michaels – bobmichaels@cox.netbobmichaels@cox.net

17. 17 CIL-NET, a project of ILRU – Independent Living Research Utilization CIL-NET Attribution Support for development of this training was provided by the U.S. Department of Education, Rehabilitation Services Administration under grant number H132B070002-10. No official endorsement of the Department of Education should be inferred. Permission is granted for duplication of any portion of this PowerPoint presentation, providing that the following credit is given to the project: Developed as part of the CIL-NET, a project of the IL NET, an ILRU/NCIL/APRIL National Training and Technical Assistance Program.