Aligning assessment with long term learning needs David Boud University of Technology, Sydney

Outline l What does learning throughout life require of learners? l How well are students prepared in university courses? l What does accepting preparation of students for lifelong assessment as a goal imply? l What conceptual tools are available to help? l What might new assessment practices look like?

Constructive alignment

A Graduate of the University of... l operates effectively with and upon a body of knowledge of sufficient depth to begin professional practice l is prepared for life-long learning in pursuit of personal development and excellence in professional practice l is an effective problem solver, capable of applying logical, critical, and creative thinking to a range of problems l can work both autonomously and collaboratively as a professional l is committed to ethical action and social responsibility as a professional and citizen l communicates effectively in professional practice and as a member of the community l demonstrates international perspectives as a professional and as a citizen

Common features referring to lifelong learning l Learning-how-to-learn skills l Disposition to learn and take learning opportunities l Problem-formulation and problem-solving l Ability to learn with and from others, teamwork l Ability to identify and access appropriate resources for learning and assessment

How do existing practices de-skill students and distort learning? (old list) l Learners are assessed on matters easy to assess leading to an over-emphasis on memory and lower-level skills. l Assessment encourages learners to focus on assessed topics at the expense of those which are not. l The nature of assessment tasks influence learners’ approaches to learning, often to promote surface approaches. l Learners who perform well on examinations still retain fundamental misconceptions about key concepts.

How do existing practices de-skill students and distort learning? (new list) l Learners look to other people and don’t develop their own judgments. l Learners look to other learners to judge standing rather than to appropriate standards. l Assessment tasks often emphasise problem solutions rather than problem formulation. l Unrealistic and decontextualised settings are used to assess. l Learner involvement in assessment is omitted and key stages in judging learning rendered invisible. l Courses often imply that collaboration is cheating and thus discourage learners working cooperatively.

Purposes of assessment 1.Certifying achievement (summative assessment) 2.Aiding learning (formative assessment)

Purposes of assessment 1.Certifying achievement (summative assessment) 2.Aiding learning (formative assessment) 3.Fostering lifelong learning (sustainable assessment)

Sustainable assessment “Assessment that meets the needs of the present without compromising the ability of students to meet their own future learning needs.”

Sustainable assessment implies: l Focuses of learning outcomes needed now. l There is constructive alignment with learning objectives and teaching and learning activities. l Equips students to learn and assess themselves beyond the immediate task.

Sustainable assessment Example 1 Essay-type assignment l Before completion: students asked to identify what constitutes a good essay in this subject at this level. l On completion: students complete an attachment indicating extent to which criteria have been met.

Sustainable assessment Example 2 Test-type assignment l Before completion: students take part in discussion of characteristics of good answers. l On completion: students use model answers to provide feedback on scripts of peers, each mark justified. l Could, in addition apply the same process to their own script.

Sustainable assessment What other examples can you identify? What are examples of unsustainable assessment?

Assessment always has to do double duty l to encompass formative assessment for learning and summative for certification. l to attend to both learning process and substantive content domain. l to focus both on the immediate task and on implications for equipping students for lifelong learning in an unknown future.

What does research on formative assessment tell us? l Need criterion- or standards-based framework. l Believe all students can succeed. l Learners’ beliefs about their capacity to learn affects achievement. l Consider separating feedback from grading. l Focus on learning rather than performance. l Development of self-assessment is vital. l Encourage reflective assessment with peers. l For assessment to be formative, it has to be used. l Need to change teaching not just assessment.

What will this mean for teaching and assessment? l Make lifelong assessment skills a learning outcome. l Provide opportunities for practice of assessment skills. l Check existing assessment to ensure it does not undermine lifelong assessment outcomes. l Be prepared when students challenge changes l Make our expertise more transparent. l Have students focus on criteria and standards for any task. l Develop self-monitoring skills.

A long way to go? One of the most consistently weak areas of assessment practice was the feedback given to students. "In every subject overview report for the two final rounds of visits, the reviewers identified deficiencies in the feedback given to students, [this] included the perfunctory nature of feedback, the absence of constructive comment, particularly for weaker students, and the failure to make timely comment so that students could improve their subsequent performance." The report concludes: "Despite the evidence of developments in assessment strategies and practices, the reviewers, even in the later round of visits, saw this as the area most in need of further consideration by institutions.” The Higher 20 Feb 2004 quoting QAA Report, Learning from Subject Review

The new agenda l Not just constructive alignment, but alignment of assessment now with long term learning goals l Breakdown the binary between assessment and pedagogy l Revisit assessment from the perspective of lifelong learning l Revisit pedagogy from the perspective of lifelong assessment

Some questions to ask of assessment A.Basic structure of tasks l Are all assessment standards-based? l Do assessment tasks directly prompt desired learning? l Does formal assessment focus on the most important outcomes? l Is the development of students’ skills in assessment explicit? l Does assessment encourage students to self assess?. l What steps are taken to develop the ability to assess learning in normal assessment tasks?

Some questions to ask of assessment B. Teaching and learning activities l Is the case for developing assessment skills well argued in handouts and briefings? l Is practice given in the development of students’ assessment skills? l Are students exposed to how experienced practitioners would approach problems similar to those expected of students?

Some questions to ask of assessment C. Nature of feedback [Feedback is not just one-to-one and by staff] l Does provided feedback help students diagnose their learning needs? Is it related to the standards and learning outcomes specified? l Is detailed feedback to students emphasised more than ratings or grades? (eg. assignment attachment forms providing structured feedback.) l Are students able to demonstrate learning in later assessment tasks from earlier feedback?

Some questions to ask of assessment D. Providing practice l Do students get practice and feedback on all major outcomes prior to final assessment? l Is self-assessment incorporated into the course unit other than as part of formal assessment? l Are students shown how to spot cues about criteria for attainment from the nature of the tasks they are given? l Are there structured opportunities for students to discuss their learning with peers and benefit from peer feedback?

Some questions to ask of assessment E. General l Are assessment and teaching/ learning constructively aligned? l Is there balance of feedback from mechanical sources, student peers and staff so that staff spent time on what they are best equipped to offer? l Are the demands of assessment on staff sustainable over time? l Are others adequately briefed to appreciate goals of assessment for lifelong learning?

References l Black, P. and Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education, 5, 1, l Boud, D. (1995). Enhancing Learning through Self Assessment. London: Kogan Page. l Boud, D. (2000). Sustainable assessment: rethinking assessment for the learning society. Studies in Continuing Education, 22, 2, l Ecclestone, K. (2002). Learning Autonomy in Post-16 Education: The Politics and Practice of Formative Assessment. London: Routledge Falmer. l Falchikov, N. (forthcoming 2004). Improving Assessment through Student Involvement. London: RoutledgeFalmer. l Hounsell, D. (2003). Student feedback, learning and development. In Slowey, M. & Watson, D. (Eds.) Higher Education and the Lifecourse. Buckingham: SRHE & Open University Press, l Knight, P. T. and Yorke, M. (2003). Assessment, Learning and Employability. Maidenhead: SRHE and the Open University Press.