Improving Programs Highly effective organizations use data to continuously track performance and drive quality improvements. Jim Collins, Author Built to Last & Good to Great
Tools and Know-How Capturing and using data Defining and measuring success Sharing and learning together
Pilot Participants
TOOL OF TECHNOLOGY Scanning System
TOOL OF TECHNOLOGY Tracking Activities
TOOL OF TECHNOLOGY Capturing Information
KNOWING AND COMMUNICATING RESULTS Defining Success
Final Youth Development Logic Model Health: Physical Health Psychological/ Behavioral Health Self-Actualization: Career/vocation Social mobility Self-sufficiency Positive future outlook/confidence Sustained Social Connectedness Community Connectedness Health & fitness behaviors Productive life choices/positive life choices Behavioral adaptability w/in different environments Strengthened self-esteem Strengthened interpersonal communication skills Pursuit of continued/ongoing formal and/or informal education and vocation advancement Increased appreciation for arts and culture Long-term social relationships Community leadership Strengthened attitude, motivation and skills for healthy living Identification of strengths and passions (self- awareness and knowledge) Stronger/improved goal setting & decision making attitudes, motivation and skills (including “delay of gratification”) Positive attitude toward school/education & learning Strengthened learning skills Increased “creative expression” (behavior) Sense of “belonging” and being valued (belief/attitude) Develop and strengthen positive relationships (behavior) Valuing diversity (attitude) Increased opportunities for community engagement Health Services Training/Group Education Organized Recreation Activities Organized Social Activities Self-Directed Recreation Activities Self-Directed Social Activities Hands-On/Experiential Learning Opportunities 1:1 Direct Assistance Key Inputs: staff skills, knowledge & experience; youth readiness factors; facilities & equipment; curricula; staff & youth time Productive Citizen
Goal-setting & decision-making [Colorado Trust Decision Making, Planning, & Leadership Scale] Academic skills [Academic scale from the Self-Efficacy Questionnaire for Children] Interpersonal communication skills [Colorado Trust Friendship and Communication Scale] Self-empowerment [Sense of Efficacy Scale – Child Development Project Student Questionnaire] KNOWING AND COMMUNICATING RESULTS Defining Success Children improve: Children rate: Program quality [Colorado Trust Toolkit for Evaluating Positive Youth Development]
KNOWING AND COMMUNICATING RESULTS Evaluation Tools
KNOWING AND COMMUNICATING RESULTS Color-coded Outcome Reports Strongly Weaker Moderately Weaker Slightly Weaker Borderline Weaker Typical Borderline Better Slightly Better Moderately Better Strongly Better
KNOWING AND COMMUNICATING RESULTS Comparative Reports
A LEARNING COMMUNITY Sharing Knowledge
OUR EXPERIENCE Lessons Learned
Technology simplifies data collection Organizations have more in common than they realized Organizations want to continue Organizations need assistance using data for the program quality improvement Predictors of child gains identified