CAA MUST be more than multiple-choice tests for it to be academically credible? Phil Davies School of Computing University of Glamorgan.

Slides:

Advertisements

Similar presentations

Parts of a Lesson Plan Any format that works for you and your JTEs is ok… BUT! Here are some ideas that might help you set up your LP format. The ALTs.

Advertisements

1 Assessing and Giving Feedback. 2 Learning Outcomes By the end of the session, participants should be able to: Identify the purposes and use of different.

Computer Aided Assessment using QuestionMark Perception by Catherine Ogilvie Educational Development Officer.

WISER Karen Smith. Barriers & Motivators to Learning.

College Assessment Board Dr Kim Wolff: Chair CAB.

Innovation in Assessment? Why? Poor student feedback regarding feedback timeliness and usefulness Staff workloads Student lack of awareness as to what.

An Introduction to Computer- assisted Assessment Joanna Bull and Ian Hesketh CAA Centre Teaching and Learning Directorate.

Computer Aided-Assessment: Can it be accepted? Phil Davies School of Computing.

The Benefits from Allowing Plagiarism Workshop Facilitator Phil Davies School of Computing University of Glamorgan.

Year 6 SATs preparation meeting Standard Attainment Tests – SATs Level 4 aimers.

INCLUSIVE ASSESSMENT IN THE SCIENTIFIC CURRICULA Dr Kimberley Bennett Mr Sebastian Stevens.

Core principles of effective assessment. Three interrelated objectives for quality in student assessment in higher education 1. Assessment that guides.

IELTSTOEFT Definition Test of English as a Foreign Language International English Language Testing System Type of English British English (academic.

PROJECTS Looking back at last year’s projects and their development.

Improving Students’ understanding of Feedback

Creating learning and unlearning opportunities from Turnitin in the process of academic writing Mary Davis Oxford Brookes University.

Perceptions of the Role of Feedback in Supporting 1 st Yr Learning Jon Scott, Ruth Bevan, Jo Badge & Alan Cann School of Biological Sciences.

© AJC /18 Extended Matching Sets Questions for Numeracy Assessments: A Case Study Alan J. Cann Department of Microbiology & Immunology University.

E-portfolios for PDP An overview of student and staff perceptions across subject areas Federica Oradini and Gunter Saunders Online Learning Development.

Assessment in Higher Education Linda Carey Centre for Educational Development Queen’s University Belfast.

Assessing Transferable Skills Personal Development Planning David Cole-Hamilton School of Chemistry University of St. Andrews.

Self, Peer and Tutor Assessment of Text Online. Design, Delivery and Analysis Dr Richard Parsons Centre for Learning and Teaching University of Dundee.

Essay Skills RMPS.

Learning Development and Innovation Overview and Updates Steve Wyn Williams March 2013.

Thinking Skills 1 of 23. Why teach thinking skills? Is it really that important? Creative and critical thinking abilities are not inborn as was once believed.

International Conference on Enhancement and Innovation in Higher Education Crowne Plaza Hotel, Glasgow 9-11 June 2015 Welcome.

Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani,

The Future of Engineering Education: CDIO conference, Singapore Teaching teamwork and project management using virtual projects Peter Goodhew FREng.

Group Work Assessment in Media Production

Renovating Assessment Practices Lisa Miller February, 2013.

Programme Specification, Benchmarks etc. Warren Houghton School of Engineering and Computer Science, University of Exeter.

Designing in and designing out: strategies for deterring student plagiarism through course and task design Jude Carroll, Oxford Brookes University 22 April.

Heriot-Watt University The Use of Computerized Peer-Assessment Dr Phil Davies Division of Computing & Mathematical Sciences Department of Computing FAT.

E- ASSESSMENT Why use it.. whatever it is? Phil Davies School of Computing University of Glamorgan.

 Powerful tool for teaching and learning  Students become thoughtful judges of work  Reduce time evaluating work  Easy to use and explain ~Heidi.

Franklin Consulting E-assessment: What is it? Why does it matter? Tom Franklin Franklin Consulting

EAssessment Colin Milligan Heriot-Watt University.

Plagiarism Whose fault is it? Phil Davies FAT. Plagiarism in Education Plagiarism in education is not a student problem, it is one that is created by.

Toward improving the academic performance in National Diploma Mechanical Engineering Thermodynamics 2 students Louw, C Mammen, K.J.

The use of Web-PA as a formative peer assessment instrument for team working Tom Joyce, Nuala Davis* and Clare Hopkins School of Mechanical & Systems Engineering.

The Independent Learner – a sixth form college perspective Linking London, 17 October 2012.

Computerised Peer-Assessment that supports the rewarding of evaluative skills in Essay Writing (C.A.P.) & Programming (Coursemarker) Phil Davies & Stuart.

Peer-Review/Assessment Aid to Learning & Assessment Phil Davies Division of Computing & Mathematical Sciences Department of Computing FAT University of.

Adapted from “Best Practices for Student Learning, Assessment in Online Courses”“Best Practices for Student Learning, Assessment in Online Courses”

The Quality of Peer-Feedback in the Computerised Peer-Assessment of Essays? The case for awarding ‘marks for marking’ based upon peer feedback not marks.

Review in Computerized Peer- Assessment Dr Phil Davies Department of Computing Division of Computing & Mathematical Sciences FAT University of Glamorgan.

Effective Grading Strategies Alison Morrison-Shetlar Faculty Center for Teaching and Learning Adapted from the book Effective Grading by Barbara Walvoord.

Heriot Watt University Breakout Session MCQ with Confidence Dr Phil Davies Division of Computing & Mathematical Sciences Department of Computing FAT University.

The Continual Assessment of Confidence or Knowledge with Hidden MCQ? Short Paper W.I.P. Phil Davies School of Computing University of Glamorgan.

Feedback in University Teaching Prof. Arif Khurshed Division of Accounting and Finance.

Innovative Assessment Carol John and Zoë Davis Disability and Dyslexia Service.

“The End Justifies the Means” When and how to use Computerised Assessment to Promote Learning Phil Davies School of Computing.

ALT Conference Cardiff, 2015 Using Multiple Choice Questions in Summative Assessment Penny English, Cailin Morrison and Andrew Gilbert Anglia Law School.

Computerised Peer-Assessment Phil Davies University of Glamorgan South Wales Lecturer getting out of doing marking.

Computerised self/peer support, learning and assessment of final year undergraduates? Phil Davies University of Glamorgan.

1 Phil Davies School of Computing University of Glamorgan “Super U” The Automatic Generation of ‘Marks for Marking’ within the Computerised Peer-Assessment.

SCROLLA 16th June 2004 The Future of Computer Aided Assessment Helen Ashton Ruth Thomas Heriot-Watt University.

E-Assessment: Removing the Boundaries of C.A.A. Phil Davies School of Computing University of Glamorgan South Wales UK.

A MEMBER OF THE RUSSELL GROUP. Denis Duret School of Veterinary Science University of Liverpool Denis.

Assessment and the Institutional Environment Context Institutiona l Mission vision and values Intended learning and Educational Experiences Impact Educational.

Creating Assessments that Engage Students & Staff Professor Jon Green.

1 Phil Davies School of Computing University of Glamorgan “Super U” Peer-Assessment: No marks required, just feedback? Evaluating the Quality of Computerized.

Angela Kleanthous University of Cyprus May 20th, 2017

Developing the reflective learner -

Case study of a novel assessment using a group wiki space.

blended Approach to academic literacy in so100 self & society

Phil Davies School of Computing University of Glamorgan “Super U”

Welcome Back Scholars 

Phil Davies School of Computing University of Glamorgan “Super U”

Phil Davies School of Computing University of Glamorgan

Presentation transcript:

CAA MUST be more than multiple-choice tests for it to be academically credible? Phil Davies School of Computing University of Glamorgan

What is CAA? Multiple Choice tests Formative? Learn?? Summative Objective Testing / Higher level skills? / Gender Issues Employable Skills? Who gains …… student or staff Academically acceptable? BATTLE

Cynical Example of MCQ What colour is the sky? A Don’t know.. Give me a clue –Blue / Green / Brown –Blue B Blue C Sometimes it is blue, red or grey, depending upon weather, time, season,etc. Who gets the job? Process?? Expected Answer

How to make CAA acceptable Subjective and Objective Testing Integration of methods End product more important than individual process results OBJECTIVE = MCQ SUBJECTIVE = ESSAY (oh no more marking!!!)

OLAL

ESSAYS Time consuming to mark Subjective (Lecturer).. Opinionated Should we assess grammar –Foreign Students –Pre-Requisite –Learning Outcomes FEEDBACK … WHAT FEEDBACK???

Computerised Assessment (by Peers) or (with Plagiarism) C.A.P. SYSTEM Computerised Assessment of essays Peer Assessed Embedded Web Referencing Marked Properly!!! Copious Comments (Destructive (honest?))

Success / Failure Major benefits –style / feedback / objectivity through subjectivity Problems –Wide range of marks / conflicting comments / why bother marking Marks for MARKING (how?)

Integration Produce essay Do multiple choice A Perform peer assessment Get feedback Perform multiple choice B

Compare Report and MCQ Average reports = 62% St dev = 8 No student less than 40% overall Average MCQ1 = 70% St dev = 14 Average MCQ2 = 72% Improvement Report to MCQ1 class average +8% achieved report <50% … improve +24% Group MCQ2 = +6% Weaker students benefit from MCQ & CAP

Student Comments about peer marking Learn from marking the work of others Peer work acted as marker to own ability “they said they couldn’t read my report, I could” “you realise you’re not as thick as you thought you were” 30% took more care because it was to be marked “properly”

Student Opinion Plagiarism OK.. Sentence or two I’m foreign so my English is not so good why waste time rewording when I could be learning 75% put in more effort with report because they were to be further tested via MCQ “writing a report is just rephrasing web sources, the tests checked understanding”

Conclusions EXPLAINATIVE not Formative Peer assessment must be shown to be beneficial to the students Quality of Assessment …..Marking must be judged (higher level skill?) MCQ.. Part of the process.. Not Process Acceptance … Integrative Process

CAA MUST be more than multiple-choice tests for it to be academically credible? Trying to make it acceptable by “types of questions” / “formatting of questions” / so called “deeper learning” => Complexity Integration of Subjective and Objective Testing may provide credibility