The National Examinations in Foreign Languages in Slovakia Ivana Pichaničová Network meeting Relating language curricula, tests and examinations to the Common European Framework of Reference GRAZ, 3 – 4 October 2017

Content Introduction of NUCEM The development and current trends of school-leaving examination (Maturita) in foreign languages in Slovakia Characteristic features of foreign languages tests, tested skills, written part of the Maturita Perspectives of foreign languages testing - English language test on level A2 in Testing 9 (at primary schools)

NÚCEM Primary mission: was established on the 1st September 2008 implementation of educational measurements: the secondary school-leaving examination (Maturita): external part & written form of the internal part Testing 5 and Testing 9 (testing of the 5th and 9th grade primary school pupils) international measurements according to the programs in which the Slovak Republic participates (PISA, PIRLS, TIMSS) research and development in the area of educational measurements evaluation of the quality of education in SR

Maturita – the school-living exam regular exam date (March), substitute examinations (April) and repair tests (September) instructions are translated also in Hungarian language adaptations for students with health disadvantages STRUCTURE External part Internal written part Internal oral part The 1st Foreign Language (Eng) 4-year grammar school  4 hours per week secondary vocational schools and conservatories  min 3 hours /week.

The development and current trends of Maturita in foreign languages in Slovakia until 2004 School-leaving examination (MATURITA exam) in foreign languages – only oral exam Examiners: internal teachers + one external teacher, internally prepared topics External elements: missing (objectivity, reliability, comparability of students) Disappointment (memorizing) 2000 New model of MATURITA – external part and written form of internal part of foreign languages (comparable to EU countries, external tests, written part)

The development and current trends of Maturita in foreign languages in Slovakia 2000 – 2003 the pilot tests 2004 the New Maturita test rehearsal since 2005 MATURITA exam (including foreign languages ) obligatory 2008 The New School Act came into force foundation of NÚCEM external part and written form of internal part of Maturita exam (including the foreign languages) prepared and organised by NÚCEM

The development and current trends of Maturita in foreign languages in Slovakia 2008 preparation of relevant documents based on National Curricula (for foreign languages primarily based on CEFR descriptors): the Catalogue of requirements for graduates (structure and content of school leaving exam) - created and updated by National Institute for Education since 2012 secondary grammar school students (B2 level) secondary vocational students (B1/ B2 level) since 2015 cancelled the possibility of replacing the foreign language Maturita by language certificate (Cambridge, TOEFL, etc.) since 2017 bilingual school students (C1 level)

Foreign language/level The development and current trends of Maturita in foreign languages (FL) in Slovakia Foreign language/level 2000 Eng/A 2006 FL/A, B 2001 - 2004 FL (Eng, Ger/1,2) 2007 - 2008 FL/A, B, C 2004 Eng, Ger/1, 2 2009 - 2016 FL/B1, B2 2005 Eng, Ger/A, B 2016 Eng, Ger, Rus / C1 Fre, Rus, Spa/A, B 2017 Eng, Ger, Rus/C1 FL 6 Foreign languages (Eng, Fre, Ger, Ita, Rus, Spa) Pilot tests Rehearsal exam MATURITA

Number of students in Maturita of English and German Language

Number of students in Maturita of other Foreign languages The graph shows that the number of pupils from other foreign languages is still decreasing, with the greatest interest in Russian language at secondary vocational schools.

Characteristics of foreign language (FL) tests, tested skills, written part of Maturita Common European Framework of Reference for Languages (CEFR) National Curriculum Catalogue of requirements for graduates from FL FL TESTS B1, B2, C1 Maturita tests are based on the CEFR and are in line with the national curriculum. This provides a key document for test development the Catalogue of requirements for graduates Language descriptors

MATURITA Subjects External part Time & Items structure Written part mc = multiple choice (items) o = open-ended (items) Subjects External part Time & Items structure Written part Time languages of instruction (SLL, SLSL, ULL, HLL) 100 min (40 mc + 24 o) 150 min foreign languages B1 level (36 mc + 24 o ) 60 min foreign languages B2 level 120 min (46 mc + 34 o) foreign languages C1 level (64 mc + 26 o) 90 min Mathematics (10 mc + 20 o) -

Test (external part of MATURITA) B1 B2 C1 Time 100 120 150 Listening Comprehension 3 recordings 20 items (30 min) 30 items (40 min) Language in Use 2 texts (25 min) 3 texts 40 items (45 min) (40 min) Reading Comprehension (45 min) 20 items (45 min) 4 texts 30 items (70 min)

(written form of internal part of MATURITA) Writing (written form of internal part of MATURITA) Conditions: students write their essays at the same time the topic is designed by NÚCEM, the same topic in all FL (different for B1+ B2 vs. C1) students are not allowed to use dictionaries assignment is based on the topics specified in the catalogue of requirements for graduates Level Time (min) Range (words) B1 60 160 – 180 B2 200 – 220 C1 90 260 – 320 (min 180)

Supporting documents published by NÚCEM Test specifications for teachers Guidelines and evaluation criteria Final reports task performance item characteristics test quality, test scores the achievements of students - in percentage in different skills All tests, answer keys and answer sheets are published as didactical material after the test in the electronic form in the .pdf format on NUCEM website

Publishing school results

Perspectives of foreign languages testing Teaching and testing foreign language (FL) at primary schools The general objective of FL teaching in Slovak Republic (SR) ensure the communication level B1/B2 according the CEFR in the 1st FL and the communication level A2/B1 according to CEFR in the 2nd FL for all pupils of the education system in the SR at the end of the secondary school Since 2011 English language compulsory for all pupils from 3rd to 9th grade of primary school for 3 hrs/week in each school year + 2nd FL from 6th to 9th grade for 4 hrs together for 4 years Since 2015 the second foreign language optional Summative tests in school level prepared by FL teachers

Perspectives of foreign languages testing - English language test on level A2 in Testing 9 Primary goals To monitor knowledge, skills + key competencies (reading and mathematical literacy) of pupils at the end of lower secondary education Tested subjects: Slovak language, Mathematics, Languages of instructions (Hungarian, Ukrainian) To give a pupil a certificate of his or her success  Secondary schools accept student's results in T9 as one criterion in the entrance process To guarantee the objectivity of the evaluation (exams) We'd like to extend the testing 9 to the English language

English language test on level A2 in Testing 9 Common European Framework of Reference for Languages (CEFR) National Curriculum English language level A2 Pedagogic documentation ISCED 2 Language descriptors

English language test on level A2 in Testing 9 2010 – 2011: test specifications 2011 – 2012: test development 2011 – 2012: pilot testing In the years 2010 to 2013, we launched a project (co-financed from EU) resources in which we prepared and piloted tests of A2 level according the CEFR. 2013: test samples + materials

English language test on level A2 in Testing 9 Basic information (structure and tasks): 60 items – 100 min Instructions for A2 level test – in Slovak language Listening Comprehension: 4 texts/exercises with 5 items = 20 test items aimed at listening (30 min) Reading Comprehension + Language in Use (Grammar and Vocabulary): 8 texts/exercises with 5 items = 40 test items aimed at reading + grammar and vocabulary (70 min) Multiple choice, matching, gap filling, true/false, open cloze, multiple-choice cloze, word formation

English language test on level A2 in Testing 9 Having results both from testing at A2 and B1/B2/C1 will be beneficial for teachers in 2nd degree of primary schools and also of secondary and grammar schools Will A2 English language test become a part of T9? ...still unknown (based on decision of the Ministry of Education)

Request specification for RELANG workshop Slovak Republic Expectations: - to increase qualification of item writers and test developers in linkage FL tests to the CERF - to ensure that national language examinations are of a high standard and are fully in line with the CERF framework. Objectives to be reached through the project activity: - screening of foreign language tests (A2) for their links to the levels in the CEFR - linking the tests and examinations to the (levels in the) CEFR and the validation of the linking process Languages: Primarily English, also German, Russian, Spanish, French, Italian Target groups: language test developers, language testers and examiners, item writers and curriculum developers, examination center management The evaluation of this activity will be carried out by the participants themselves in the form of a questionnaire. At the same time, the preparation and implementation of the workshop will be checked and evaluated by representatives of the Ministry of Education, Science, Research and Sport of the Slovak Republic.

Thank you for your attention. www.nucem.sk