Introduction The attainment of examination and assessment credibility is a journey and not a destination. As a system the DBE has attained a degree of success over the years, with regard to Public Examination administration. However, the DBE strives to migrate to the next level of effective functionality. The model of a national examination system is not achieved in totality.
The Examination Cycle 5 Credible Exams & Assess Assessment Instruments Test Admin Marking & Moderation Analysis & Feedback
Monday, May 04, 2015 Examination Cycle Registration of centres Enrolment of Learners Setting of QPs Internal Moderation External Moderation Writing of Examination Marking Process Capturing of Marks Standardisation of Marks Statistical Moderation of SBA Declaration of Result by Umalusi Release of Results by Minister Certification HE World of work 6
Scope and Size of 2013 NSC Exams Total Candidates: Full Time Candidates: Part Time Candidates : Question Papers:258 Printed Question Papers:9.1 million Scripts:8.7 million Examination Centres:6699 Invigilators: Markers: Marking Centres:118
9 Province NameTotal Entered EASTERN CAPE FREE STATE GAUTENG KWAZULU-NATAL LIMPOPO MPUMALANGA NORTH WEST NORTHERN CAPE WESTERN CAPE NATIONAL NSC Full-Time Enrolments per Province 2013
10 Province Entered 2009 Entered 2010 Entered 2011 Entered 2012 Entered 2013 Eastern Cape Free State Gauteng KwaZulu-Natal Limpopo Mpumalanga North West Northern Cape Western Cape National NSC Full-Time Enrolments per Province 2009 to 2013
11 SubjectEntered Accounting Afrikaans First Additional Language Agricultural Sciences Business Studies Economics English First Additional Language Geography History Life Sciences Mathematical Literacy Mathematics Physical Sciences NSC Full-Time Subject Enrolments 2013
12 Subject Entered 2009 Entered 2010 Entered 2011 Entered 2012 Entered 2013 Accounting Afrikaans First Additional Language Agricultural Sciences Business Studies Economics English First Additional Language Geography History Life Sciences Mathematical Literacy Mathematics Physical Sciences NSC Full-Time Subject Enrolments 2009 to 2013
13 Province Difference in FT Full TimePart timeTotalFull TimePart timeTotal Eastern Cape Free State Gauteng KwaZulu-Natal Limpopo Mpumalanga North West Northern Cape Western Cape Total NSC Enrolments and 2013 comparison
14 Enrolments NSC 2013 in terms of Gender Province Name Male Entered Female Entered EASTERN CAPE FREE STATE GAUTENG KWAZULU-NATAL LIMPOPO MPUMALANGA NORTH WEST NORTHERN CAPE WESTERN CAPE NATIONAL Province Name % Male Entered % Female Entered EASTERN CAPE FREE STATE GAUTENG KWAZULU-NATAL LIMPOPO MPUMALANGA NORTH WEST NORTHERN CAPE WESTERN CAPE NATIONAL
DBE MONITORING APPROACH
Monitoring Approach Broader mandate of building a national examination and assessment system DBE engages with the PEDs on an ongoing basis through meetings, teleconferences and regular reporting. Intensive audit of the examination/assessment processes and systems of the Provincial Education Departments (PEDs) conducted. Audit was based on the shortcomings identified in the previous examinations. Examination and assessment processes, facilities and resources and management procedure were audited
Monitoring Approach Audit plan submitted to PEDs in preparation for the audit visit. Evidence based. Based on the audit, the areas of weakness identified, improvement plan developed. DBE provides ongoing support and monitoring. Final State of Readiness visit in September 2013
a)High quality question papers are set and moderated. b)Examination centre and candidates are accurately registered on the examination computer system. c)Question papers are accurately printed. d)Question papers are distributed on time to all schools and candidates and strict security measures adhered to in the distribution process.
Target Success Indicators i)SBA is completed in accordance with policy prescripts and moderated. j)All examination and SBA marks are accurately captured. k)All examination irregularities are appropriately managed. l)All candidates are accurately and timeously resulted. m)Effective feedback provided to schools. n)All eligible candidates receive certificates.
Target Success Indicators e) All candidates including learners with special needs are accommodated in the examination. f)Examinations are conducted under controlled conditions across all examination centres. g)Answer scripts accurately marked and moderated. h) All examination marks are accurately captured on the examination computer system.
Registration of Candidates/Centres a)All candidates have been registered on the Examination Computer System. b)Two schedules of entries have been sent to all schools to verify accuracy of registration of all candidates. c)Subject changes, immigrant candidates and special concessions have been appropriately managed. d)Registration data has been audited by the DBE. e)Mark sheet printing commenced on 30 August f)Letters of admission to the examination will be sent to schools by 13 September 2013.
Registration of Candidates/Centres g)All enhancements on the examination computer system will be completed by 30 September h)A complete dry run on the system will be commence by 30 September Dry run done in conjunction with Umalusi. i)All independent centres have been evaluated to ensure that they satisfy the criteria for registration. Centres with repeated irregularities have been de-registered. j)In cases where there is doubt about the integrity of the centre, the examination will be administered by the PED at these centres, or will be closely monitored. k)Candidates from the South African Comprehensive Assessment Institute (SACAI) have been registered as private candidates.
Registration of Candidates/Centres l)PEDs are now able to register learners on the IECS from Grade 10 and transfer candidate data to grade 11 and 12. As from 2014, this will be made compulsory for all PEDs. l)Improved management of subject changes which would minimise non - resulting of candidates. m)Concessions granted to candidates with special needs include: Additional time Amanuensis Scribe
Question Papers a)All 258 question papers for November 2013 and March 2014 examinations have been set and moderated by the DBE to ensure a national standard b)Question papers have been approved by Umalusi, edited, quality assured and handed over to PEDS for printing. c)Adaptation of the question papers for blind, partially sighted and deaf candidates is complete. d)Brailing of the adapted papers for the blind is in progress. 33
Question Papers Improvement Initiatives : Reviewed the examining panels where there was evidence of capacity shortfalls. Trained examiners and moderators. Results of intensive post test analysis results shared with examiners and moderators. Findings from international benchmarking shared with examiners and moderators and incorporated where necessary. 34
Question Papers Improvement Initiatives Pre-writing of selected question papers Close monitoring of the setting and moderation process Improved editing and translation of question papers, with the inclusion of an additional tier of quality assurance 35
Question Papers Preparations for CAPs 2014 Exemplars for Grade 11 were developed in selected subjects and distributed. Examiners and moderators for Grade 12 (2014) appointed and trained. Examination guidelines and Exemplars Grade 12 (2014) currently being developed. To be released to Provinces by 30 October
PRINTING, PACKING AND DISTRIBUTION
Printing, Packing and Distribution a)Six of the PEDs have excellent in-house printing facilities. The remaining two PEDs utilise the services of GPW, SITA, and the remaining PED outsources printing to a reputable service provider. b)Printing and packing progressing according to plan. c)Common date for the commencement of printing across all PEDs - 01 August This allowed more time for the additional quality checks to be completed before printing commences. 38
Printing, Packing and Distribution d)Storage facilities across all PEDs have been inspected and security has been improved at distribution points. e)Question papers will be distributed to examination centres on the morning of the examination, except in the Western Cape. e)In the Northern Cape, only in schools that are far from the districts, will question papers be stored at schools. f)Western Cape piloted daily distribution of question papers to schools during the SC examination in June 2013, and will extend the pilot in November
Writing of the examination a)Examination commences on 28 October 2013 and concludes on 29 November a)Invigilators who supervise the writing of exams are in the process of being trained across all PEDs. b)The principal is the Chief Invigilator. c)Detailed regulations and guidelines govern the conduct of exams and the managing of irregularities. a)To inculcate a sense of commitment to complying with the examination code of conduct, all learners will sign a Pledge on 18 October 2013, at a Pledge Signing Ceremony. 41
Writing of the examination d)All chief invigilators and invigilators are officially appointed for the duration of the examination. Chief Invigilators are all trained by the PED and the district, who in turn train the invigilators. e)The writing of the examinations will be monitored by DBE, PEDs and Umalusi. DBE has appointed 30 independent monitors who will be deployed to the provinces. f)Schools with previous irregularities will be closely monitored. f)Collaborative forum established with SAPs, Crime Intelligence and Disaster Management services through National Joint Operational and Intelligence Structure (NATJOINTS). A priority committee on Education has been formed. 42
Collection of Answer Scripts a)Stricter control of Answer books introduced across all PEDs. b)All scripts to be returned to the district office the same day. c)Scripts to enjoy the same attention and security as the question paper. d)7 of the 9 PEDs (except WCED and NC) will be using bar coded labels in the 2013 NSC examination. This will enable PEDs to scan scripts and ensure better script control. e) All scripts must be correctly labeled with centre number and subject and must be sealed at the school level. 44
Collection of Answer Scripts f)All scripts to be controlled and checked at each stage of the process. f)DBE has introduced norm times for the return of scripts between the different collection points.
Marking a)Marking centres have been established across all PEDs based on the prescripts contained in the Policy. b)Markers have been appointed based on the PAM criteria and most PEDs have added learner performance as an additional criteria. c)Training of markers is ongoing and specialised training sessions will be organised prior to the marking sessions. c)National Marking Guideline discussions will be hosted in Pretoria for all subjects, to ensure standardisation of marking across all PEDs. 47
Marking e) Internal moderators to be appointed for each subject at each marking centre. f)DBE will appoint external moderators to evaluate the marking at each centre. g)Umalusi conducts centralised moderation of marking, while the marking is in progress. 48
SCHOOL- BASED ASSESSMENT
School Based Assessment (SBA) a)Moderation of SBA is ongoing at the school, district and provincial level. b)DBE conducted Audit of provincial SBA moderation systems Focused moderation of assessment tasks in selected districts across all PEDS, in July c)Second national moderation will be conducted in October 2013 and will evaluate the assessment tasks and the learner evidence. d)Provincial moderation to be completed by 16 October e)All SBA marks will be captured by 15 November
School Based Assessment (SBA) f)Common Assessment Task developed by the DBE was administered across PEDs, in Life Orientation, on 04 September g)National Marking Guideline discussions are currently being hosted in Pretoria for Life Orientation, to ensure standardisation of marking across all PEDs. 51
PROCESSING, RELEASE AND APPEALS
P rocessing, Release and Appeals a)Marking will be completed by 15 December across all PEDs. b)Mark Capture will be completed by 18 December c)A technical team will prepare proposals in respect of adjustments for the pre-standardisation meeting – 20 December d)Pre-standardisation meetings will be held on 21 and 22 December. e)Umalusi standardisation meeting to be held on 23 December f)Results will be thoroughly checked by DBE, PEDs and Umalusi from 23 – 30 December. g)Umalusi approval meeting to be held on 30 December h)Results will be released on 7 January
P rocessing, Release and Appeals i)Remark and re-check will take place early in February j)Candidates given 21 days after the release of the results, to apply for a re-mark or re-check. k)If candidates are still not satisfied, with the outcome, candidates will be allowed to view his/her script. l)Based on specific criteria, candidates are allowed to write the supplementary examination. 54
ANALYSIS AND FEEDBACK
Analysis and Feedback a)Detailed analysis of results per school, per district, per province, per subject will be made available. b)Qualitative analytical reports from chief markers/internal moderators will be consolidated for distribution to schools. c)Outcomes of the Umalusi standardisation meetings will be made available to curriculum specialists and examining panels. d)Workshops will be conducted with teachers and subject advisors. e)Under-performing schools will be brought to account and improvement plans will be designed. f)Curriculum specialists to develop subject improvement plans.
Certification a)The issue of the certificate signifies the culmination of the examination cycle. b)The certificates for candidates that wrote the examination in 2012 were distributed to candidates at the end of June c)The 2013 certificates are scheduled to be released to candidates by the end of May 2014.
Irregularities The serious irregularities experienced in 2012 and the action taken: (a)Principal who left a box of question papers on the roof of the vehicle – principal relieved of responsibility and charged. Need for greater vigilance included in training. (b)Printing error – Mathematics Paper – circle omitted – software compatibility. Software across PEDs now synchronised. (c)Missing scripts – scanning of scripts now introduced. (d)Candidate found with a page of the Economics paper – confirmed that three candidates had prior access to the question paper. Candidates barred from writing the examination for two/three years. Three examination officials have been charged. Improved security in the province introduced.
Progress Chart TARGET INDICATORSPROGRESS 1. High quality question papers are set and moderated 2. Examination centre and candidates are accurately registered on the examination computer system. 3. Question papers are accurately printed. In progress 4. Question papers are distributed on time to all schools and candidates and strict security measures adhered to in the distribution process 5. All candidates including learners with special needs are accommodated in the examination. 6. Examinations are conducted under controlled conditions across all examination centres.
Progress Chart TARGET INDICATORSPROGRESS 7. Answer scripts accurately marked and moderated. 8. All examination marks are accurately captured on the examination computer system. 9. SBA is completed in accordance with policy prescripts and moderated. In progress 10. All examination and SBA marks are accurately captured. 11. All examination irregularities are appropriately managed. 12. All candidates are accurately and timeously resulted. 13. Effective feedback provided to schools. 14. All eligible candidates receive certificates.
Conclusion The DBE and the PEDs are ready to administer the 2013 NSC examination. The DBE will vigorously pursue its agenda of building a national examination and assessment system, that is internationally comparable and credible. DBE is confident based on the extensive intervention programme that there will be an improvement in learner performance in 2013.