Ismaila Odogba Department of Geography and Geology The Impact of Collaborative Testing on Student Learning in an Introductory Level Geography Course INTRODUCTION.

Slides:



Advertisements
Similar presentations
QAA Research Teaching Linkages: Enhancing Graduate Attributes Theme Linda Juleff, QAA Steering Group Representative.
Advertisements

Standardized Testing. Standardized Testing Defined A standardized test is designed in such a way that its administration, scoring and interpretation are.
Impact of class size on student engagement: literature review and preliminary data analysis.
STAAR/EOC Overview of Assessment Program HISD Professional Support & Development High School Science Team.
Indiana State University Assessment of General Education Objectives Using Indicators From National Survey of Student Engagement (NSSE)
Assessing Learning for Classroom Success Friday, February 16, :00-3:00.
Introduction to Psychology: Northern Arizona University Fully implemented, 2009  2000/year foundational, survey-style class  Traditionally, 8-11 uncoordinated.
Summary In a previous study, bioethical discussion of a controversial topic was shown to enhance learning and retention of biological content knowledge.
The Science Writing Heuristic (SWH) [1] is an inquiry-based approach that links writing, reading, and science laboratory activities. The SWH emphasizes.
The Impact of Content-Based Instructional PROGRAMS on the Academic Progress of ESL Students Loretta Frances Kasper.
Writing Program Assessment Report Fall 2002 through Spring 2004 Laurence Musgrove Writing Program Director Department of English and Foreign Languages.
International Conference on Lifelong Leaning ICLLL 2011
ICER 2005 Factors Affecting the Success of Non-Majors in Learning to Program Susan Wiedenbeck Drexel University.
TABLE 1: Comparison of scores from the year the immediate feedback format was used to the previous year when multi-format exams were used. * p < 0.05 compared.
For science courses, exams determine the majority of the student grades. Testing students on their comprehension and application of the course material.
Three Heads are Better than One! Undergraduate Nursing Students’ Experiences with Collaborative Testing Dr. Donna Martin, Assistant Professor, Faculty.
The possible effects of target language learning prior to secondary dual language school studies by Anna Várkuti 10th Summer School of Psycholinguistics.
Turning a Disciplinary Lens to Teaching and Learning Preparing Tomorrow’s Professionals for a Complex World The integrity of the discipline leads to a.
METHODS Study Population Study Population: 224 students enrolled in a 3-credit hour, undergraduate, clinical pharmacology course in Fall 2005 and Spring.
Evaluation and analysis of the application of interactive digital resources in a blended-learning methodology for a computer networks subject F.A. Candelas,
Improved Performance and Critical Thinking in Economics Students Using Current Event Journaling Sahar Bahmani, Ph.D. WI Teaching Fellow INTRODUCTION.
Direct vs Indirect Assessment of Student Learning: An Introduction Dr. Sheila Handy, Chair Business Management and Co-Chair University Assessment Committee.
Chris Evans, University of Winchester Dr Paul Redford, UWE Chris Evans, University of Winchester Dr Paul Redford, UWE Self-Efficacy and Academic Performance:
Are there “Hidden Variables” in Students’ Initial Knowledge State Which Correlate with Learning Gains? David E. Meltzer Department of Physics and Astronomy.
Quasi-Experimental Designs For Evaluating MSP Projects: Processes & Some Results Dr. George N. Bratton Project Evaluator in Arkansas.
Learning to Teach Elementary Science: From Preservice to Induction Change Associated with Readiness, Education, & Efficacy in Reform Science Dr. Betty.
Using Empirical Article Analyses to Assess Students Learning of Psychology Research Methods Sarah Richardson, Michael Schiel, Kaetlyn Graham, & Allen Keniston.
CriteriaExemplary (4 - 5) Good (2 – 3) Needs Improvement (0 – 1) Identifying Problem and Main Objective Initial QuestionsQuestions are probing and help.
What is PBL & Why in the World are we Doing THIS? Jodi Haney, BGSU Or… But we did just fine the other way!
When the Tail Wags the Dog: Perceptions of Learning and Grade Orientations in, and by, Contemporary College Students and Faculty Howard R. Pollio University.
T 7.0 Chapter 7: Questioning for Inquiry Chapter 7: Questioning for Inquiry Central concepts:  Questioning stimulates and guides inquiry  Teachers use.
The Case The Case Why do introductory level students struggle devising substantive answers to questions about the past? Furthermore, how do we teach students.
Science Case Network GAPS IN REACHING DIVERSE AUDIENCES Aditi Pai Networking Conference August 6-7, 2012 RCN-UBE Project #
DOES CONTENT ORDER AFFECT PERFORMANCE ON MULTIPLE CHOICE EXAMS? Introduction 2.- Theory and hypotheses 3.- Methodology 4.- Results 5.- Conclusion.
November 2006 Copyright © 2006 Mississippi Department of Education 1 Where are We? Where do we want to be?
Christine Harrington Ph.D. Middlesex County College Cengage Learning.
Toward improving the academic performance in National Diploma Mechanical Engineering Thermodynamics 2 students Louw, C Mammen, K.J.
Online Course Evaluations Is there a perfect time? Presenters: Cassandra Jones, Ph.D., Director of Assessment Michael Anuszkiewicz, Research Associate.
Using Common Core State Standards of Seventh Grade Mathematics in the Application of NXT LEGO® Robotics for CReSIS Middle School Students.
NCATE STANDARD I STATUS REPORT  Hyacinth E. Findlay  March 1, 2007.
Chiraz Ouerfelli Higher Institute of Applied Studies in Humanities Tunis Situating Strategy Use: The Interplay of Language Learning Strategies and Individual.
1.  Introduction  Literature Review  Research Design and Data Collection Methods  Data Analysis Activities &Cognitive Test  Discussion of Results.
Results Table 1 Table 1 displays means and standard deviations of scores on the retention test. Higher scores indicate better recall of material from the.
Authentic Discovery Projects in Statistics GCTM Conference October 16, 2009 Dianna Spence NGCSU Math/CS Dept, Dahlonega, GA.
The Impact of Student Self-e ffi cacy on Scientific Inquiry Skills: An Exploratory Investigation in River City, a Multi-user Virtual Environment Presenter:
Early Identification of Introductory Major's Biology Students for Inclusion in an Academic Support Program BETHANY V. BOWLING and E. DAVID THOMPSON Department.
There are tomes of evidence that team-based learning is highly effective in improving comprehension, critical thinking, and content retention when a course.
What is the Advanced Placement Program? The Advanced Placement Program are courses taught at local high schools, which allow students to participate in.
Group quizzes as an assessment that supports learning Blog:
Deliberate practice helps students develop science process and metacognitive skills Michelle Withers Associate Professor Department of Biology, WVU.
Innovative Applications of Formative Assessments in Higher Education Beyond Exams Dan Thompson M.S. & Brandy Close M.S. Oklahoma State University Center.
CDIO: Overview, Standards, and Processes (Part 2) Doris R. Brodeur, November 2005.
이화여자대학교 Combining Cooperative Learning And Peer Instruction In Introductory Computer Science (SIGCSE 2000 Proceedings) 002OFE03 비서교육전공 4 학기 황 정 희 J. D.
Chapter 11: Test for Comparing Group Means: Part I.
Dr. Marciano B. Melchor University of Ha’il, KINGDOM OF SAUDI ARABIA May 2013.
University of Northern Colorado
Preliminary Data Analyses
Oleh: Beni Setiawan, Wahyu Budi Sabtiawan
Assessing Students' Understanding of the Scientific Process Amy Marion, Department of Biology, New Mexico State University Abstract The primary goal of.
Research Question and Hypothesis
PROJECT/PROBLEM-BASED LEARNING: Who’s Doing the Thinking?
Instructor Made Videos Enhance Student Learning
Psychology Department, George Mason University
THE JOURNEY TO BECOMING
Multi-faceted Approach to Improve Learning in Pharmacokinetics
Why do we use this workbook all the time??
The whole is greater than the sum of the parts. –Aristotle
Multi-faceted Approach to Improve Learning in Pharmacokinetics
An Introduction to AP, Pre-AP and Vertical Teams
Hypothesis Testing for Proportions
Presentation transcript:

Ismaila Odogba Department of Geography and Geology The Impact of Collaborative Testing on Student Learning in an Introductory Level Geography Course INTRODUCTION Instructors in most disciplines usually assign students to teams/groups to work on projects and assignments. Studies show that Team-Based Exams (TBEs) enhance student performance (Leight at el, 2012; Cortright et al, 2003), the development of positive attitude towards testing (Haberyan and Barnett, 2010; Revere et al., 2008; Zimbardo et al 2003), encourage comprehension, problem solving, and the long- term retention of knowledge (Revere, 2003; Mitchell and Melton, 2003; Rao et al, 2002). This study examines the impact of collaborative testing on student performance and critical thinking. METHODS Design In order to examine the impact of collaborative testing on student learning, two sections of Geography 113: World Regional Geography, were used during the Fall semester of GEOG 113 is an undergraduate level course that introduces students to the world’s major region. It explores the flows and linkages between regions and the patterns of human-land relationships at the global and local level (Tables 1 & 2). Course and subjects The design of this study enables it to test the hypothesis that collaboration testing, specifically, TBEs enhances student learning. To test this hypothesis (Fig. 1), each section of the course took both a traditional exam (TE) and TBE. Evidence of student learning involved a comparison of TE and TBEs for differences in performance and critical thinking by analyzing exam scores and responses to complex application questions. Figure 1: Research design. GEOG (n = 43; 14 groups) and GEOG (n=41; 13 groups). Exam 2 occurred five weeks after exam 1. The team-based learning activities lasted five weeks for each section prior to the TBE. DISCUSSION Analysis To determine if collaborative testing increased student performance, a Wilcoxon matched-pairs signed-ranks test was used to compare scores when the students sat for an exam in the traditional format with the scores obtained when the same students took another exam questions in teams (Fig. 2). Also, a independent sample t-test was used to compare TBEs scores for both sections (Fig 3). To determine if collaborative testing facilitated critical thinking, the proportion of correct answers on Higher-Level Thinking (HLT) multiple choice questions was compared (Table 3). HLT question require the students to use judgment and critical thinking to answer them correctly. RESULTS Figure 2: Comparison of Traditional and Team-Based exam performances. The mean scores of the Team-Based Exams were significantly higher than the mean scores of the Traditional Exam. For GEOG 113-1, the mean group score ( ) was significantly higher than the mean score for the individual exam ( ). Likewise for GEOG 113-2, the mean group score ( ) was significantly higher than the mean score for the individual exam ( ). Values are Mean + SE; *P < Figure 3: Comparison of Team-Based Exam performances. Average Team-Based Exam scores for GEOG ( ) was not significantly different from average Team-Based Exam scores for GEOG ( ). Values are Mean + SE; P = Table 3: Performance on Higher-Level Thinking Questions. Scores were greater on the HLT questions for the Team-Based Exam as opposed to the Traditional Exam. Exams 1 and 2 both contained 5 HLT questions. each. Overall the TBE performances were greater on the HLT questions compared to the same questions on the TE. Based on the analysis of test scores, there is statistically significant evidence that collaborative testing does improve student performance. This confirms previous studies which indicate that student performance on TBEs is significantly higher than that on TE. Improvement proportions indicate that 91% and 83% of the students in GEOG and GEOG respectively experienced a positive change in their test scores when comparing performance on the TE and TBE. Analysis indicates that TBE enhances critical thinking. However, the fact that less than 70% of students that selected the right choice (Table 3) failed to provide a reasonable explanation is puzzling. This might have to do with the fact that critical thinking requires content domain knowledge, the ability to recall this knowledge, and then deploy it in problem solving (Willingham, 2007). Overall, based on preliminary inquiry, the majority of the students believed that collaborative testing improved their higher-level cognitive skills and enhanced understanding of the course material. This perception of improved cognitive skills is collaborated to some extent by the results of the HLT question analysis. CONCLUSION Based on this study, collaborative testing does improve student learning in an introductory level geography course. Evidence regarding critical thinking, in this case, the ability to exercise reasoned judgments is not definitive as indicative of the initial analysis. REFERENCES Cortright, R., Collins, H., Rodenbaugh, D., & DiCarlo, S. (2003). Student retention of course content is improved by collaborative-group testing. Advances in Physiology Education, 3 (27) 102–108. Leight, H., Saunders, C., Calkins, R., & Withers, M. (2012). Collaborative testing improves performance but not content retention in a large enrollment introductory biology class. Life Sciences Education, 11(4), Haberyan, A., & Barnett, J. (2010). Collaborative testing and achievement: are two heads really better than one? Journal of Instructional Psychology, 37(1), Mitchell, N., & Melton, S. (2003). Collaborative testing: an innovative approach to test taking. Nurse Educator, 28(2), Rao, S. P., Collins, H.L., & DiCarlo, S. E. (2002). Collaborative testing enhances student learning. Advances in Physiology Education, 26(1), Revere, L. (2003). An Approach to improving student performance, assessment, and satisfaction. Southwest Business Administration Journal, 3(1), Revere, L., Elden, M., & Bartsch, R. (2008). Designing group examinations to decrease social loafing and increase learning. International Journal for the Scholarship of Teaching and Learning, 2(1). Willingham, D Critical thinking, why is it so hard to teach? America Educator, Summer 2007, Zimbardo, P.G., Bulter, L.D., & Wolfe, V. A. (2003). Cooperative college examinations: more gain, less pain when students share information and grades. The Journal of Experimental Education, 71(2), Special thanks to the Office of Professional and Instructional Development (OPID), Office of the Provost, UW-Stevens Point, and the Department of Geography and Geology, UW-Stevens Point for their support of this study.