Presentation is loading. Please wait.

Presentation is loading. Please wait.

Effect of Paper Color on Students’ Physics Exam Performances David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Objectives Examine the manifestation.

Similar presentations


Presentation on theme: "Effect of Paper Color on Students’ Physics Exam Performances David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Objectives Examine the manifestation."— Presentation transcript:

1 Effect of Paper Color on Students’ Physics Exam Performances David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Objectives Examine the manifestation of a color-performance relationship in an introductory E&M course. Discuss findings in the context of prior studies’ arguments and claims. Address the implications of results for current institutional practices. Background Prior work has 1.Established the existence of a color-performance relationship in achievement contexts 1,2. 2.Demonstrated the presence of such a relationship in some undergraduate course examinations. Results, however, have been inconsistent 3,4,5. Since papers of various colors can be used to distinguish exam versions (as is done at CSM), the possibility that different colors may lead to measurable differences in performance raises an issue of basic fairness in educational practice. Discussion & Conclusion All results were null. As such, we conclude that use of the colors tested here in similar exam settings will most likely not yield differential performances. As no concrete claims regarding causality can be made concerning this null result, this conclusion may or may not be generalizable to all possible colors and shades thereof. We speculate on mechanisms for this null result (as compared to the results observed elsewhere) in the associated proceedings article. Results from ANOVA testing on the time students’ required in completing their exams, their initial levels of confidence, their self-perceptions of performance, and their confidence gains for Exams I, II, and III. “Initial Confidence” and “Perceived Performance” were measured by questions placed at the beginning and end of each exam asking students to self-evaluate on a 1-5 scale. For Exam II, only time was measured. All tests yielded null results, and we did not observe any trends consistent across all three exams. Results from ANOVA testing on students’ total, multiple choice, free response, conceptual, and mathematical performances on Exams I, II, and III. For the purposes of this study, a question was categorized as “Conceptual” if it did not require any manipulation or numerical evaluation. All other questions were categorized as “Mathematical.” All tests yielded null results, and we did not observe any trends consistent across all three exams. Students’ total exam scores differentiated by exam and paper color. Error bars represent 95% confidence intervals based on standard errors of the means. For each exam, performances associated with each color were within error of one another. Performance Other Experiment & Data For three regular examinations in an introductory E&M course (Spring 2012, N~400), we printed each exam version on a different color of paper. We conducted analysis involving measures of performance and other data. Analysis of performance included students’ total exam scores, scores on different types of question (conceptual vs. mathematical), and different question formats (free response vs. multiple choice). Analysis of other, non-performance, measures included students’ completion times, confidences, and perceptions of performance. Acknowledgements Thanks to the NSF TUES grant 0836937 which funded this study and to the rest of the Physics II teaching staff. 1.A.S. Soldat, R.C. Sinclair, and M.M. Mark, “Color as an environmental processing cue: External affective cues can directly affect processing strategy without affecting mood,” Soc. Cognition 15(1), 55-71, 1997. 2.A.J. Elliot, M.A. Maier, A.C. Moller, R. Friedman, and J. Meinhardt, “Color and psychological functioning: The effect of red on performance attainment,” J. Exp. Psychol. Gen. 136(1), 154–168, 2007. 3.R.C. Sinclair, A.S. Soldat, and M.M. Mark, “Affective cues and processing strategy: Color-coded examination forms influence performance,” Teach. Psychol. 25(2), 130-132, 1998. 4.N.F. Skinner, “Differential test performance from differently colored paper: White paper works best,” Teach. Psychol., 31(2), 111–112, 2004. 5.I.R. Tal, K.G. Akers, and G.K. Hodge, “Effect of paper color and question order on exam performance,” Teach. Psychol. 35(1), 26-28, 2008. Exam IExam IIExam III F Ratiop-valueF Ratiop-valueF Ratiop-value Total ScoreF(3,314)=0.86p=0.454F(3,409)=0.47p=0.702F(3,395)=0.80p=0.497 Multiple ChoiceF(3,314)=1.21p=0.306F(3,409)=0.48p=0.698F(3,395)=0.73p=0.536 Free ResponseF(3,314)=0.27p=0.265F(3,409)=0.19p=0.902F(3,395)=1.53p=0.206 ConceptualF(3,314)=0.84p=0.836F(3,409)=0.33p=0.327F(3,395)=0.85p=0.849 MathematicalF(3,314)=0.18p=0.178F(3,409)=0.64p=0.592F(3,395)=0.43p=0.731 Exam IExam IIExam III F Ratiop-valueF Ratiop-valueF Ratiop-value TimeF(3,212)=2.68p=0.048F(3,405)=2.24p=0.083F(3,317)=0.41p=0.745 Initial ConfidenceF(3,314)=0.63p=0.597XXF(3,393)=2.68p=0.047 Perceived PerformanceF(3,303)=1.57p=0.197XXF(3,382)=1.77p=0.153 Confidence GainF(3,303)=1.13p=0.339XXF(3,382)=0.56p=0.640


Download ppt "Effect of Paper Color on Students’ Physics Exam Performances David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Objectives Examine the manifestation."

Similar presentations


Ads by Google