Improving Marking Efficiency and Engineering Undergraduate Feedback with Innovative Software Tools Barry J Beggs, Elaine M Smith & Allan Pellow

Slides:



Advertisements
Similar presentations
Elements of Module & Programme Design Monojit Chatterji University of Dundee Associate Economics Network.
Advertisements

Assessment. Assessment What is it ? Why assess and for whom? How should we assess? When should we.
Personal Development Plans (PDPs) Subject-specific PDPs in Economics.
ESCalate ITE Conference - May 2009 Reflection on Peer Reflection Reflecting on practice to enhance student learning Lawry Price Roehampton University.
Demanding Questions and Difficult Answers Alan Maddocks Carol Newbold Loughborough University.
The Student-Supervisor Relationship Rob Briner Organizational Psychology Birkbeck.
Self-directed Learners Mary Pryor Academic Learning & Study Unit (ALSU)
Computer Aided Assessment using QuestionMark Perception by Catherine Ogilvie Educational Development Officer.
Dissertation Preparation Meeting on Dissertation Preparation for MSc Projects – 30 th June 2005 by Lydia Lau Why this meeting? More than just write-up!
The Cost of Authoring with a Knowledge Layer Judy Kay and Lichao Li School of Information Technologies The University of Sydney, Australia.
Making Feedback a positive learning experience Joint Academy/NUS Special Interest Group Professor Brenda Smith Senior Associate
Performance Management
Creating a dialogue over feedback between staff and students in the classroom and online Heather A. Thornton
S ETTING QUESTIONS AND GIVING FEEDBACK. Learning outcomes To critically evaluate the appropriateness and usefulness of questions set to measure learning.
An Introduction to Computer- assisted Assessment Joanna Bull and Ian Hesketh CAA Centre Teaching and Learning Directorate.
Developing coherence in assessment. Relationship to the new C- QEM report* Coherence in the course and assessment *Course quality enhancement and monitoring.
PDP 4 – Writing academic Reports. Academic assignments In higher education, assignments are submitted in several formats –Essay –Presentation –Dissertation.
EMPLOYABILITY PROGRAMME: INCORPORATING DIFFERENT CAREER INTERESTS AND LEVELS OF EXPERIENCE Dr Amy Irwin School of Psychology EMPLOYABILITY Late in 2012.
BSc Honours Project Introduction CSY4010
Delivering Planning Education Now and in the Future Ruth Richards London South Bank University.
Project Management Network for Excellence in Learning & Teaching PMnetwork for Excellence in Learning & Teaching Fifth Workshop Bournemouth University.
David Mossley Senior Adviser, Higher Education Academy.
Searching for Information: advanced & using Endnote Web to manage references Sport & Exercise Science Year 2: Autumn 2012 Peter Bradley: Subject Librarian.
References Prof. Saul Greenberg, University of Calgary, notes and articles INUSE 6.2 and RESPECT 5.3 Handbook Prof. , University of , Notes and articles.
Task-Centered User Interface Design who are the users? what are the tasks? plagiarize! iterative design –rough descriptions, mock-ups, prototypes test.
E-Portfolio July2014 Managing Multi-source Feedback.
Fit to Learn Using the Employability Skills Framework to improve your performance at College The Employability Skills Framework has been developed by business.
Essay Writing 1: Structure What do tutors look for in assignments ? Example of a well-written management undergraduate essay  How is it structured ? 
Lecture 8 Presentation & Report Writing & Assessment.
"In the name of ALLAH, most Gracious, most Compassionate".
BRIEFING 1: FYP INTRODUCTION
 Digital Assessment for the YouTube Generation: Reflective Practice in 21 st Century Legal Education Nigel Firth (LLB Programme Leader)
International Conference on Enhancement and Innovation in Higher Education Crowne Plaza Hotel, Glasgow 9-11 June 2015 Welcome.
Where Should I Be Now??? Finished corrections to task a/b Annotated a page of code and put it in folder Put evidence of manual code changes (edit and add)
Marking Scheme ISM ISM Top-up. Project Contents Abstract, – A one page summary (max. 400 words) of the Intent, work undertaken. Introduction, – An overview.
Software Engineering Management Lecture 1 The Software Process.
BSc Honours Project Introduction CSY4010 Amir Minai Module Leader.
©Dr I M Bradley Doing the project and other things.
Requirement Engineering for Trust Management : Model, Methodology Reasoning P. Giorgini, F. Massacci, J. Mylopoulos, N. Zannone, “Requirements Engineering.
Science Notebooking In the OC Presented by District Coordinators &Lead Teacher.
ACCURACY IN ASSESSMENT; EVIDENCING AND TRACKING PROGRESS IN TEACHER EDUCATION BEA NOBLE-ROGERS.
SHOW US YOUR RUBRICS A FACULTY DEVELOPMENT WORKSHOP SERIES Material for this workshop comes from the Schreyer Institute for Innovation in Learning.
Welcome 3 rd and 4 th year students! Arne Kovac, Director of Undergraduate Studies.
G040 – Lecture 06 Comparing Documents Report Mr C Johnston ICT Teacher
Project Thesis 2006 Adapted from Flor Siperstein Lecture 2004 Class CLASS Project Thesis (Fundamental Research Tools)
Human Factors Issues Chapter 8. What is Human Factors? Application of the scientific knowledge of human capabilities and limitations to the design of.
Ian F. C. Smith Writing a Journal Paper. 2 Disclaimer / Preamble This is mostly opinion. Suggestions are incomplete. There are other strategies. A good.
3-18 Skills for Careers Characters EmployabilityCommunicationProblem Solving Working with others Self Awareness.
Writing Reports Workshop. 1. To share and build on good practice 2. To improve the quality of reports and meeting milestones 3. To develop guidelines.
Evaluating Educational Resources W301. What are Educational Resources? There are many kinds of resources available to you: –Productivity Resources are.
E-Commerce Project Ninth Lecture Mohammed Antour
Supervision vs Management. What is… Supervision A developmental process designed to support and enhance an individual’s acquisition of the motivation,
BSc Honours Project Introduction CSY4010 Amir Minai Module Leader.
Completing your HEFA written assignment. To give you a chance to develop skills and gain analytical writing experience which will help you working for.
Investigate Plan Design Create Evaluate (Test it to objective evaluation at each stage of the design cycle) state – describe - explain the problem some.
Assessment of EPQ What is assessed? AO1 Managing the project AO2 Use resources Where’s the evidence? Production log – aims of project, detailed project.
Introduction to Evaluation
<Student’s name>
Research, Reasoning and Rhetoric: Thinking with History: Lecture 6 Understanding marks and feedback 7: Understanding marks and feedback Ted Vallance.
Katie Cattanach, MSc. Ambitious Futures Dr. Ruth Watkins
IB Environmental Systems and Societies
Sarah Etchells Dr Sebastian Rasinger Department of English and Media
Enhancing Effective Assessment and Feedback
In the Company of Wolves and Wolf Alice
Pacific Peoples Research Skills Symposium, 2018
PERFORMANCE EVALUATIONS – WHY DO THEY GO WRONG?
DESIGNING RUBRICS Hein van der Watt
FIP UNIT 2.2 Prep.
Monitoring & Evaluating
What is a contract? An explicit agreement of what the consulting team and client expect from each other and how they are going to work together. It is.
Presentation transcript:

Improving Marking Efficiency and Engineering Undergraduate Feedback with Innovative Software Tools Barry J Beggs, Elaine M Smith & Allan Pellow

Important Elements of the Student Experience

Using Feedback to Enhance Learning and Reflecting students need to take ownership of their own learning and to develop reflective thinking students complain that they do not get enough feedback or that the feedback comes when it is too late

Methodology Employed in Software Development analyse the conventional hand written feedback of lecturers develop and then use a software tool to re-mark the same batch of student work redeveloped based on evaluation

Analysis of Hand Written Marking

Development of the Software Tool Create marking categories to include in marking schedules Develop a database of re usable comments for each marking category Allow the editing and addition of free text

Project Interim Report Marking Categories ID Title Mark ID Title Mark 1 Presentation of Report 204 Self Organisation and Time Management 20 2 Critical Evaluation of Progress 205 Motivation, Initiative and Adaptability 20 3 Identification of Problem Areas and Solutions 206 Supervisor Comments 0

The feedback comments can align with the QAA engineering benchmark statements Text Order It was clear that your report is very well presented with no errors. Excell ent Your report was well presented with few errors. Good Your report was reasonably presented but had some errors. You can learn how to improve your presentation skills by consulting the project handbook or at: Thres hold Unfortunately your report was not very well presented. You should make an attempt to improve this before you write your final year project report. Advice is available from the project handbook or at Below Thres hold

Conclusions and Observations Hand written comments created by a lecturer provide accurate feedback that can be finely tuned to convey appropriate detail and level of importance Bespoke software tools have the potential to improve the consistency, quality, quantity and efficiency of providing feedback to students