1. This work is supported by the National Science Foundation’s Transforming Undergraduate Education in STEM program within the Directorate for Education and Human Resources (DUE-1245025). GETSI C LASSROOM T ESTING & S TUDENT D ATA C OLLECTION K RISTIN O’C ONNELL, E LLEN I VERSON, B ETH P RATT -S ITAULA The webinar begins at: 11 am PT | 12 pm MT | 1 pm CT | 2 pm ET For audio, call: 1-800-704-9804 (or 1-404-920-6604) Access Code: 472 58 282 Press *6 to mute and unmute (but hopefully we won’t need any muting)

2. G OALS FOR THIS W EBINAR By the end of the webinar you will be able to: 1.Find more information as you need it: – Web resources – Timeline – IRB 2.Know timing of piloting testing w/r/t authoring and rubric review 3.Understand what data will be collected, why, and how (GLE, attitudinal surveys, student work)

3. Identify Course & Module Learning Goals Identify learning objectives for individual lessons Determine how to assess and measure student success on goals and objectives Design teaching resources and materials to match assessments Plan Instructional Strategies to implement teaching resources Pilot Materials, Make changes

4. C LASSROOM P ILOT & D ATA C OLLECTION *IRB approval Development Timeline http://serc.carleton.edu/getsi/info_team_members/timeline.html

6. Pre- & Post-course Geoscience Literacy Assessment (GLE 8 MC questions) 2 from each literacy document 4 Single answer and 4 “select all that apply” Two post-course short essay questions (interdisciplinary & systems thinking) http://serc.carleton.edu/integrate/info_team_members/currdev/documents/gle/index.html GETSI is still deciding whether to include these

7. Critical to keep these questions SECURE! Example of GLE question

8. P OST - COURSE SHORT ESSAY QUESTIONS See websitewebsite Critical to keep these questions SECURE!

9. Graded by faculty of the pilot testing classroom based upon a rubric Summative and conclusive  measuring the level of understanding when learning related to that module goal is completed Used in the same fashion in all materials pilot- testing classrooms http://serc.carleton.edu/integrate/info_team_members/currdev/assessment.html#sum

10. Pre- & post-course motivation and career interest survey (related to project evaluation) http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.html

11. Course Information Demographic data Faculty Reflection Surveys Checkpoint 4 (after development) Notes while teaching (individual reporting page) Post-Pilot After Revisions

12. Conducted and setup through SERC using course set-up form http://serc.carleton.edu/getsi/info_team_members/forms_docs/course_form.html

13. GETSI C OURSE S TATUS P AGE Once your course set-up form is completed, this will be your go-to place to see your progress in the assessment process http://serc.carleton.edu/integrate/info_team_members/currdev/status_page.html

15. Make contact with your IRB early (Checkpoint 1) Know that IRB procedures vary by institution Give project list of which students do not consent Carleton College has EXEMPT status You will need Carleton letter Consent form examples are posted http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.h tml http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.h tml Ask for help! IRB: What you Need to Know

16. Give students option to opt out at beginning of term Implied consent Signed consent IRB: What you need to know What about consent? http://serc.carleton.edu/getsi/info_team_members/timeline.html#irb

17. Data Collection http://serc.carleton.edu/integrate/info_team_members/currdev/course_status.html Where can you find help?

18. G OALS FOR THIS W EBINAR By the end of the webinar you will be able to: 1.Find more information as you need it: – Web resources – Timeline – IRB 2.Know timing of piloting testing w/r/t authoring and rubric review 3.Understand what data will be collected, why, and how (GLE, attitudinal surveys, student work)

19. Testing Process and Assessment What questions do you have about testing and data collection?

20. “H OMEWORK ” Fill out Course Set Up form IRB process if needed http://serc.carleton.edu/getsi/info_team_members/forms_docs/course_form.html http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.html