New Zealand Scholarship English Alan Newall National Assessment Facilitator responsible for NCEA & Scholarship English Exams

Whakatauki Te manu ka kai i te miro, nona te ngahere. Te manu ka kai i te matauranga, nona te ao. The bird that partakes of the berry, his is the forest. The bird that partakes of knowledge, his is the world. NZQA Level 2 Visual Arts Exemplar, 2010

A close look at the ‘whats’ and ‘hows’ of NZ Scholarship Overview of NZ Scholarship NZ Scholarship English 2011 Exam setting & marking processes What is the secret to student success? The Future: alignment, generic performance standard, and all that

Overview of NZ Scholarship introduced in 2004 the present marking system in 2006 intended to challenge most able students very demanding, even for the highest-performers students are expected to: –Demonstrate high-level critical thinking, abstraction and generalisation –integrate, synthesise and apply knowledge, skills, understanding and ideas to complex situations generally 3% of the Level 3 cohort in each subject are awarded Scholarship

Scholarship Awards Premier Awards reward the top 5 to 10 candidates each year. (10 in 2011) Outstanding Scholar Awards are given to the next top 40 to 60 candidates. (51 in 2011). 34 Top Subject Scholar Awards were given. 10,271 candidates entered NZ Scholarship in More females entered but males outperformed females at Scholarship (7,359 to 7,211) and Outstanding Scholarship levels (231 to 168)

Scholarship English Scholarships (Cut score of 13) 46 Outstanding Scholarships (Cut score of 18) ‘Top 10’ were 5 males and 5 females Five Christchurch students were in the ‘Top 10’ –All different schools –Mix of state, integrated and private schools –Some on shared sites –Shows ‘great resilience & determination’

Exam Setting Processes NZQA's exam-setting process takes approximately 18 months. The exam paper is written according to the requirements of the standard being assessed. NZQA editors format the paper as an exam booklet. The paper is reviewed by at least three critiquers and a suitable assessment schedule is developed. If required, it is translated into te reo Maori. For a diagram of this process, see standards/Qualifications/NCEA/NZQA-Examination- Setting-Process.pdf standards/Qualifications/NCEA/NZQA-Examination- Setting-Process.pdf

NZ Scholarship English 2011 IRT Analysis

NZ Scholarship English 2011 Section B Statements#874–6≤ 3 8 Shakespearean characters revealed… onions peeled Film takes you edge … keeps you safe Novels: singular view.. persuade reader of that view Novelists’ worlds drawn to fully form characters Poems.. distillation of life’s experiences and emotion Shakespeare worlds drawn to fully form characters Poetry.. backbone of ideas, well-chosen skin of words Drama: confronts issues need to address Film.. camera needs to be in the eye of a poet Short stories’ sparseness.. writers’ artistry visible Drama appeal explore human relationships Non fiction.. unfortunate limitation.. tell truth Media: diversity of ways diffuses impact and reception150069

NZ Scholarship English 2011 Section C Statements#874–6≤ 3 22Heroic figures: goodness not satisfy, but flaws Literature.. lamp illuminating particular world Dystopian literature – power is ability to warn Writing: has power.. readers accept its points of view Literature: not moon shining, glint light broken glass Writing influential marks on page move to tears Literature: study others culture / better appreciate own Fantasy: modern.. takes place of religion Literature: hardship /glamour: glamour / hardship Children’s literature child adult / adult child Literature = read twice: Journalism = read once Books: self-contained auto playing50023

Exam Marking Processes For an overview of the marking process, see standards/Qualifications/NCEA/NZQA-Examination- Marking-Process.pdf standards/Qualifications/NCEA/NZQA-Examination- Marking-Process.pdf In 2011, Grade Score Marking, a new approach to marking exams was used to mark Level 1. It is being introduced at L2 & L3 with the aligned standards.Grade Score Marking

What is the secret to student success? What are we looking for? It is not ‘rocket science’: –‘Answer the questions’ Refer to the examiner’s Assessment Report: ‘This paper provided challenges allowing candidates to identify key elements and bring their experience of texts through relevant reflection.’ ‘Candidates were able to argue for and against statements, displaying perception and discrimination.’

Section A Candidates need to have a real understanding of audience, purpose and language contrast and compare to produce insightful and focused discussion focus in depth on particular and well-chosen connections rather than covering a large number in little depth or focus, relying on generalisations.

Section B Candidates need to work within the frame of the particular genre engage with the question in relation to this chose texts for the question rather than just proceeding to ‘tell everything I know’ about a studied text have the question at the forefront of the response and clearly grappled with (before employing supporting textual references).

Section C Candidate need to discuss classic issues to do with literature interpret the literature clearly establish an engagement and understanding of just what the statement means for them show regard to all aspects of the topic weave a supported and connected discussion through their presented readings avoid the reference to an over large numbers of texts, which often precluded synthesising.

For candidates to succeed they need four key components: a tool kit of a thorough knowledge of literary terms and grammatical techniques academic writing skills a background of detailed text knowledge including wide independent text reading a real interest and engagement with various ideas and texts.

Ideas are fundamental Candidates need to engage with the question to advance their own take of what that means independent thought and creative response a real understanding of where they are, what the world is all about, and how people respond to it a development of an independent perspective an interest and engagement with the argument a genuine development of an argument with supporting details

The Future: Alignment, Generic Performance Standard, and all that 2013 Level 3 & NZ Scholarship Standards Alignment Generic Scholarship Performance Standard for all subjects: Subject specific ‘Outcome Description’: –‘The student will use their knowledge of English to respond critically to demanding texts and questions by means of extended, coherent and informed (argument ) discussion.’

Scholarship Performance Descriptor The student will demonstrate aspects of high level: analysis and critical thinking integration, synthesis and application of highly developed knowledge, skills and understanding to complex situations logical development, precision and clarity of ideas.

Outstanding Performance Descriptor In addition to the requirements for Scholarship, the student will also demonstrate, in a sustained manner, aspects of: perception and insight sophisticated integration and abstraction independent reflection and extrapolation convincing communication.

Public Consultation on the Draft Scholarship Performance Standard Thirteen online submissions were made on English Rating of the overall Draft PS for English was 4.2 (between good and very good) Rating of key aspects averaged between good and very good Some concerns about lack of details –These can be addressed by the Assessment Specifications and exemplars

2013 Scholarship English The present exam work well The exam is challenging The exam discriminate well at the top end Do you have any suggestions how it could be enhanced? At NCEA L1 -3 generic question are being phased out with the alignment: should we do the same for Scholarship?

The future: we need you It is important to use a variety of teachers as contractors for exam setting and marking English exams At all levels the exam setting teams have been ‘refreshed’ (and they are always confidential) A conscious effort is being made to move marking panels around regions If you are interested check the NZQA web or contact me Thank you for your interest and attention

Links to web resources standards/Qualifications/NCEA/NZQA-Examination- Setting-Process.pdfhttp:// standards/Qualifications/NCEA/NZQA-Examination- Setting-Process.pdf standards/Qualifications/NCEA/NZQA-Examination- Marking-Process.pdfhttp:// standards/Qualifications/NCEA/NZQA-Examination- Marking-Process.pdf standards/awards/scholarship/ standards/awards/scholarship/ standards/awards/scholarship/scholarship- subjects/scholarship-english/ standards/awards/scholarship/scholarship- subjects/scholarship-english/