1. Using Analytics to Evaluate Teaching Effectiveness
Robyn L. Raschke

2. Analytics & Teaching Effectiveness
Do we think or know?
Data analytics gives us the
power to know!

3. Systems model approach
Input
Process
Output
Feedback

4. What data do we use? How often?
Teaching effectiveness is more than the course evaluations at the end of the semester
Using data throughout the semester can make a difference for you and your students!
Opportunities to demonstrate impact of teaching effectiveness

5. Student Learning
Learning
Progress
Engagement

6. Student Engagement Reports from Learning Management Systems
Piazza (Q&A app add-in to LMS)

7. Learning Management Systems Reports
Exam Exam Final

8. LMS drill down to student
Use specific data if a student is struggling and I need to get them on track
Showing them their data and comparing to average can make a difference in their habits (e.g. need to preview the slides earlier or work homework earlier)

9. Student Engagement using Piazza
Piazza is a free tool for educators & can be “added as an app” into LMS
Q&A platform & Polls
Student’s asking
Student’s helping
Student’s “listening” (not all students are active, but they listen!)
Active anonymous student participation allows students more willingness to participate in learning (Sankar, P., Gilmartin, J., & Sobel, M ACM SIGCAS Computers and Society, 45(2), 7-10.)
Teacher response rate
Other analytics

10. Piazza use from my Fall 2018 class

11. Piazza - analytics

12. Piazza Analytics: Student’s Asking

13. Piazza Analytics: Student’s Helping

14. Piazza Analytics: Student’s Listening

15. Student Progress using surveys
Learning
Progress
Engagement

16. Student Progress
Do you formally check-in with your students? How often?
Survey’s provide data from the feedback loop and can improve communications and trust with the students
Survey Last week of instruction
VARK (1st week)
Post Exam 1 (5th week)
Post Exam 2 (10th week)

17. Student Survey’s Do you start with a learning benchmark?
VARK – How do I learn best?
Visual
Aural
Read/Write
Kinesthetic

18. Survey process for Fall, 2018 course
Class VARK results (every class is different!) Students do this online (free) at vark-learn.com during 1st week of class

19. Survey after 1st exam (5th week)
Short (5 likert, 2 open-ended)
Anonymous
Strongly Disagree
Disagree
Neither Agree/Disagree
Agree
Strongly Agree
I read the chapter before the lecture
The inclass assignments help me prepare for the exams
The chapter outlines are helpful for preparing for class
The chapter outlines are helpful for preparing for exams
My performance on exam 1 reflects my effort made in this class so far

20. Insights…

21. Open-ended feedback Suggestion to improve going forward:
Tell me at least one thing that you want me to continue doing in this class that is helpful:
Suggestion to improve going forward:

22. Survey after 2nd exam (10th week)
Short (6 questions + 2 open-ended)
Anonymous

23. Before the final (15th week) anonymous and more insightful than my course evaluations!

24. In Summary… Systems model approach used throughout the semester helps!
Improve the class during the semester
Continuous improvement for future semesters
Drive curriculum development
Assessment

25. Expect the best of your students & yourself!
“Success comes from knowing that you did your best to become the best that you are capable of becoming.” - Coach John Wooden

26. Thank you!