1. Science General Education Assessment
Assessment Development Status Update
Assessment Day
May 4th, 2018

2. Recap Consensus: Our Goals of the Assessment Development
Incorporate modifications to the assessment format
Generate a faculty feedback report that conveys value to faculty instruction
Generate a student feedback report that communicates feedback on performance indicators of scientific reasoning

3. Scenario Development Criteria
Primary learning outcome is scientific reasoning
Relatable
Minimal technical terminology
7 questions
5 possible multiple-choice answers

4. Scenario Development Progress
Topic: Type 2 diabetes – Dietary influences (i.e., sugar- sweetened beverages, coffee consumption)
Scientific reasoning indicators:
Identify the objective and hypothesis
Analyze the experimental format: Independent/Dependent variables
Identify controls
Determine replication
Generate conclusions
Evaluating sources

5. Scenario Development Progress
Format:
Seven questions with five answer choices
Short text description of background and experimental details
2-4 data sets
2-4 references (For evaluation of sources)
Pre/post-test format
Logistics:
Pre-test – Week 3
Base line relative to previous assessment cycle data
Post-test – Week ~9

6. Assessment Logistics Assessment Implementation
Faculty/Student Feedback
Week 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

7. Scenarios Breakout Goals Scenario evaluation
Need ideas on questions for source evaluation
Similar (stand alone) or different themes
Provide copy and make notes, group everyone, what are the positives, issues – how can we improve (“How might we address…”)

8. Scenario Break-out

9. Faculty Feedback Report
Develop a faculty feedback report format that will inform faculty of student results (from their own classes)
Breakdown of student strengths/areas of improvement needed according to the skills measured
Pre/post-assessment report

10. Faculty Feedback Report Progress
Personalized report for faculty includes:
Correct number of questions answered by students
Breakdown question/skill assessed into categories by class, campus, and division
Completion time
Include automatic logout and/or prevent multiple attempts:
Include in assessment instructions
Logistics – pre/post assessments ✓ ✓ ✓

11. Student Feedback Report
Develop ed reporting mechanism to the student
Work with IR to develop an automatically-generated report
Sent once assessment cycle completed
Informs on areas of strength or improvement needed and possibly their score
Answers not provided
Include the IR address for students to give feedback

12. Student Feedback Report
Automated pre-developed responses for incorrect answers (Skill missed-feedback)
Positive feedback for skills from correct answers
Highlight how this skill is useful beyond the classroom
Relate feedback to a different example to not give away answers of the current scenario
Audio or video may be added, but embedded link recommended for addition of these features
✓-Static text features may be added
✓-Routing to another link/survey

13. Improvement Plan Intervention between pre and post-assessment - Daeri
What activity do we want to use as the intervention?
Report out group ideas
Consensus on the intervention
Ideate/Brainstorming

14. Improvement Plan Break-out