NOTE: To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image. ACADEMIC COACHING EVALUATION EME 640- Spring 2014 Megan Cardillo, Katilin Gibbons, Jennifer McIntosh, Ileana Wilburg, Jamal Wilburg

Evaluation Plan Description

Evaluation Implementation Prepare And Deliver Results And Recommendations Analyze Data Attend Coaches’ Meeting (Focus Group) Distribute Survey To Students Utilizing Coaching Interview Assistant Director Of ACE Initiate Contact With Assistant Director Of Academic Center For Excellence (ACE)

Description of Materials Evaluated Packet of Materials Coaching for Student Success Brochure Coach Contract Coaching for Student Success Guidebook

Data Collection - Participants Assistant Director, Academic Center for Excellence Undergraduate Students Receiving Coaching Volunteer Graduate Students

Data Collection Tools Interview with Subject Matter Expert Student Survey Coach Focus Group Previous Survey

Tool Administration Interview Protocol Google Forms Focus Group Questions Fall 2013 Survey

Data Collection Results - Survey Surveys were sent to 26 students and available for 14 days. Only one respondent (3.8% of sample) responded to the survey, the evaluators have determined the data to be neither valid nor reliable. Possible reasons for low-response rate include 1.Timing (Spring Break) 2.Number of surveys distributed over university 3.Student motivation 4.Frequency students check university

Data Collection Results - Interview  Program established in Spring 2011  Graduate students are coaches  Intent is to help students improve:  Time management skills  Study skills  Academic probation status  Program is individualized  Coaches receive 6-hour block of training at the beginning of semester

Challenges One Semester Commitment For Coaches No Process For Pairing No Previous Comprehensive Program Evaluation Difficulty Getting Students To Open Up Coaches Have No Desire To Continue In Program Lack Of Standards And Metrics

Program Comparison Program FeatureUniversity Of South CarolinaThe University Of Tampa Compensation Coaches Are Graduate Students, Paid $10 Per Hour. Coaches Are Graduate Student Volunteers Or Participants In Practicum Program. Coach Training Mandatory Training At The Beginning Of The Fall Semester. Mandatory Training At The Beginning Of Semester They Will Be Coaching (Fall Or Spring). Team Meetings Coaches Must Attend Meetings Every Other Week. Coaches Meet With The Director At Least Once During The Semester. Coach CommitmentFull Year Commitment, Fall And Spring.Single Semester Commitment. Coach Work Commitment Coaches Are Expected To Work An Average Of Eight Hours Per Week In The ACE Offices On Campus. No Minimal On-campus Work Hours Required. Prior Experience No Prior Experience Required. Additional Training Provided Throughout The Semester. No Prior Experience Required. No Additional Training Provided During Semester. Students On Academic ProbationMandatory For First-year Freshman In Academic Recovery Program Highly Encouraged For Students On Academic Probation

Recommendations Program FeatureProposed RecommendationsIntended Result Accountability Required Amount Of Meetings/Hours Per Month Students Will Be More Apt To Meet With Students And/Or Director Program Measurement Establish Objectives And Create A Tool For Measurement Ensure The Functionality Of The Program Measurement Of Improvement Assessment At Beginning, Midway And End Of Program Better Understanding On Program Efficiency Coach CommitmentCommitment Of 2 Semesters For Adequate Coaching Experience Help With Shortage Of Coaches, Will Have A More Solid Number Of Coaches

Questions?