1. VCE School Leaders Briefing 2016

2. 9:30 Administrative Procedures 9.50 Special Provision update 10.00 Curriculum Briefing 10:40 School-based Assessment Audit 10.50 Break 11.10 Exam Conduct and Supervision 11:20 Statistical Moderation and Study Score Running Times

3. Administrative Procedures

4. School and VCAA responsibilities  Schools Provision and oversight of a suitable program Collection of student details and enrolment data Entry of student data on VASS  VCAA QA data Processing student enrolment and result data Reporting to students, schools and other stakeholders VCE and VCAL Administrative Handbook 2016

5. Key school tasks  Run eligibility  Identify students who are not eligible and adjust program  Print Student Full Details / Student Personal Details Forms  Distribute for students to confirm all details  Print class lists for teachers  Final checks before due dates

6. Examples of SRRU identified data errors

8. VASS Critical dates ENR Enrolment 1 on 22 February venues for oral and performance exams setting of end-of-year examination timetable (to minimise clashes and 3 in one day) Enrolment 2 on 2 May stationery for the GAT DET will base VET funding on enrolment as of this date.

9. Enrolling students into a Second Language (EAL) VASS will disable VASS/VCE coordinators’ ability to grant EAL approval for students whose country of origin is Singapore or India. Approval for these countries can only be granted by the VCAA. Schools are required to forward the applications to the VCAA for a thorough assessment to be made. Applications need to include supportive school documentation ( in English using an approved translator) and passport stamp and/or International Movement Records to determine if the student is eligible for EAL. If approval is granted, it will be entered on VASS and the student will be able to be enrolled.

10. Student transfer and credit from interstate studies  Students must apply to the VCAA through the Victorian school at which they are enrolled using the Application for Credit towards the VCE/VCAL form. (please note evidence must be in English and translations only accepted if a certified translator used)  At Units 1 and 2 level, schools will recommend the amount of credit to be granted on receipt of an interstate school or authority transcript and after consulting the equivalent qualification guidelines. Credit recommended by the school must be entered on the application form (Part E).  Previous school reports and certificates should be attached.  Decisions on the amount of credit at Units 3 and 4 level will be made by the VCAA (only available from within Australia).

11. Privacy Considerations  Both the VCAA and schools have obligations under privacy legislation to protect the personal information of students.  The VCAA is aware that some schools engage a Third Party to analyse end of year data.  The VCAA discussed this use with the Victorian Privacy Commissioner.  We were advised that schools can best meet their privacy obligations by providing de-identifiable data to third party analysts.

12. Contact Details Student Records and Results student.records@edumail.vic.gov.au

13. Special Provision

14. Special Provision – 2016 and beyond  2016 Special Examination Arrangement (SEA) applications were sent to schools last November.  Applications for long-term or chronic conditions must be completed as stipulated and submitted to the VCAA by Friday 4 March.  The VCAA will ensure that decisions are released in the week commencing Monday 9 May for ‘complete’ applications received by the above closing date.  Administrative advise re 2016 Special Provision policy and procedures is available on the VCAA website www.vcaa.vic.gov.au/Pages/vce/exams/specialprovision/specialprovision.aspx

15. Special Provision Review Primary focus in 2016 :  continued development of the VCAA’s Special Provision online system (School-based provisions, SEA and DES applications).  engaging with a cross section of schools to work towards introducing a flexible and more accessible Special Provision platform which accommodates early engagement with the VCAA (discussion & formalisation of appropriate ongoing provisions for students with special needs/circumstances).  Ongoing review of the most appropriate evidence requirements and provisions available for each condition/circumstance.  Stakeholders will be kept informed on the progress of the review via VCAA notices and/or VCAA website www.vcaa.vic.edu.au/Pages/vce/exams/specialprovision/specialprovisionreview.aspx

16. Curriculum

17. VCE Studies in Review 2016 Once accredited, for implementation in 2018  Algorithmics (HESS) – minor review  Outdoor and Environmental Studies – minor review  Product Design and Technology – minor review  Sociology – minor review  Visual Communication Design – minor review  Accounting – major review  Australian and Global Politics – major review  Health and Human Development – major review  Legal Studies – major review  Media – major review

18. VCAA Curriculum Managers Subject Associations Curriculum Development and Review Input into the Review and Accreditation Cycle Teacher and stakeholder consultation

19. Review Process Evidence-based review by panel comprising teachers, university, TAFE and industry representatives.  International and national benchmarking  Analysis of data -Enrolment trends -School-based and examination results -Examiners’ reports -State reviewer reports from coursework audits -Online surveys -Teacher focus groups

20. Teacher Involvement  Study Review Panels  Text List Advisory Panels  Exam Assessors  Exam Panels  State Reviewers Excellent professional learning opportunities. Call for applications in VCAA Bulletin. Apply through SSMS.

21. Consultation on Draft Study Designs Consultation register now open: www.vcaa.vic.edu.au/Pages/2016ConsultationRegister.aspx Notice to Schools when individual study consultation is open: Draft study design Questionnaire Summary of proposed changes

22. New VCE Studies The following VCE studies introduced in 2016:  Bridging EAL: Units 1 and 2 (2016−2018)  History: Units 1−4 (2016−2020) −Ancient History −Global Empires  Karen: Units 1 and 2 only (Units 3 and 4 in 2017)  Vietnamese First Language: Units 1 and 2 only (Units 3 and 4 in 2017)  Chin Hakha: Units 3 and 4

23. Revised and Reaccredited VCE Studies The following are the revised and reaccredited study designs for implementation in 2016:  Geography  Computing (formerly Information Technology)  English Language  Global Politics  History: − Twentieth Century History − Australian History − Revolutions  Mathematics

24. Staged Implementation 2016–2017 For the following studies, Units 1 and 2 are implemented in 2016, and Units 3 and 4 will be implemented in 2017: English/English as an Additional Language Literature Biology Chemistry Environmental Science Physics Psychology.

25. Revised and Reaccredited Study Designs for Implementation in 2017 Revised VCE Texts and Traditions Study Design now available. The following revised study designs will be published throughout Term 1: Art Business Management Economics Food and Technology (changing to Food Studies) Music Physical Education Religion and Society Studio Arts

26. Implementation Briefings for Revised VCE Studies  During 2016 the VCAA will conduct statewide implementation briefings for teachers of the revised VCE studies.  Support for Music, Art and Texts and Traditions will be provided. Details will be available in the April edition of the VCAA Bulletin.

27. Bridging EAL: Implementation Support  VCE Bridging EAL is being implemented by schools for the first time in 2016.  In April (Unit 1) and August (Unit 2), the VCAA will invite all Bridging EAL providers to complete a questionnaire to gather information about how the study is being taught and assessed.  This information will inform future implementation support and resources.  The information gathering process will also provide an opportunity for schools to ask questions and get advice about the implementation of VCE Bridging EAL.

28. School-based Assessment Resources Assessment Handbooks/Advice for teachers Published for all VCE studies:  SAC performance descriptors are advisory (except for Extended Investigation where their use is mandated)  SAT criteria and descriptors of level of performance are mandatory  Apply to Units 3 and 4, can be used to inform Units 1 and 2  Published online only on the individual VCE study pages Companion document Procedures for Assessment in VCE Studies 2016

29. Advice for Teachers – New Format VCAA Bulletin VCE, VCAL and VET No. 4, November 2014:  Merger of Advice for Teachers and Assessment Handbook into one online publication  For studies published in 2015 onwards

30. School-assessed Tasks 10 VCE studies with SATs  Mandated assessment criteria and performance level descriptors on 10 point marking scale  Published each year in February on individual study pages  Authentication record for each study  Full day professional learning program conducted annually in February/March

31. Industry Pathways  Industry Pathways are available in four industry areas: Building and Construction, Community Services and Health, Manufacturing & Engineering and Sport & Recreation  Includes VET certificates from the industry, English/Literacy, Maths/Numeracy, selected other studies and Work Placement  Further information available at: www.vcaa.vic.edu.au/Pages/vet/Industry_pathways_VCE_VCAL.aspx

32. VCE (Baccalaureate)  Introduced in 2014  Awarded to 3828 students in 2014, 4033 students in 2015 (approx. 8% of VCE completions)  To be eligible to receive the VCE (Baccalaureate) the student must satisfactorily complete the VCE and receive a study score for each prescribed study component: −a Units 3 and 4 sequence in English or Literature or English Language with a study score of 30 or above; or a Units 3 and 4 sequence in EAL with a study score of 33 or above −a Units 3 and 4 sequence in either Mathematics Methods (CAS) or Specialist Mathematics −a Units 3 and 4 sequence in a VCE Language  At least two other Units 3 and 4 sequences  FAQs on VCAA website: www.vcaa.vic.edu.au/Pages/vce/studies/index.aspx

33. Higher Education Studies  Contribute to satisfactory completion of the VCE as a 3–4 sequence  No more than one HE study can contribute  Contribute to the ATAR as 5 th or 6 th unscored study (incremental scale)  List of approved 1 st year university studies on VCAA website: www.vcaa.vic.edu.au/pages/vce/studies/studiesextension

34. VCE on a Northern Hemisphere Timetable  Timetable runs September – July  Unit 3–4 enrolments from Sept 2016; first exams June 2017  Curriculum and assessment requirements – follow previous calendar year  Equating process for comparability  Emerged out of VCE international program, available to Victorian VCE providers  Local stakeholders – flexibility including: −staggered delivery −return to study, adult VCE −international students  Authorisation to deliver – opens April

35. VCAA Sponsored Awards  VCE Season of Excellence  VCE Leadership Awards  VCAA Plain English Speaking Award  Margaret Schofield Memorial Scholarships open to VCE Music students from Government schools  Premier's VCE Awards  John Button School Prize entrants submit an essay (up to 2000 words)  VCAL Achievement Awards

36. School-based Assessment Audit

37. Purpose of the Audit To ensure that school-based assessment is conducted in line with VCAA principles of assessment and the requirements of the relevant study design. For the school, it provides opportunities to:  validate the quality of school-based assessment  set up professional conversations about teaching and learning. For the VCAA:  the audit outcomes assist in planning assessment advice and professional development support for teachers.

38.  All VCE providers are annually audited for at least one VCE study (maximum of 4 VCE studies)  All VCE studies are subject to the audit  Notification to schools via VASS  Audit dates published in Important Administrative Dates: −Unit 3 Notification: 29 February −Unit 4 Notification: 24 June Audit Process

39.  Four stages: −Stages 1 and 3: completion of a study specific online questionnaire −Stages 2 and 4: submission of further evidence, if required  Notification of the outcome of the audit and any further evidence required sent to school via email and VASS.  Further evidence may be in the form of ─School-assessed Coursework tasks ─Marking schemes/Assessment criteria ─Timelines ─Authentication records ─Student work. Audit Process

40.  Audit panel checks submissions against the requirements of the study design  School-based assessment must allow the students the opportunity to meet the outcomes  The school is notified immediately if a serious anomaly is detected (e.g. incorrect text being taught). Audit Process

41.  Submission meets requirements −Suggestions for improvement may be provided.  Further evidence required −Feedback on the submission will be provided.  Immediate follow up with VCAA required −The submission indicates possible error or poor practice. Audit Outcomes

42. VCE Study Pages: www.vcaa.vic.edu.au/Pages/vce/studies/index.aspx General Advice and Policy:  General Administrative Information for School-based Assessment  VCE and VCAL Administrative Handbook 2016  Report on Lost/Stolen/Damaged School-assessed Tasks  Individual study pages for SAT information  Authentication Record for School-assessed Tasks  Teacher additional comment sheet for Technology studies Resources

43. School-based Assessment

44. Unit Results Schools report students’ results for completion of VCE Units, and VCE VET units of competence/modules VCE Unit Results are reported as: S = Satisfactory Completion N = Not Satisfactory J is to be used where the student: is no longer attending class has not submitted work for assessment VCE VET unit of competence/module results are reported as: S = Satisfactory Completion N = Not Yet Completed

45. Satisfactory Completion Satisfactory VCE Unit Result The student receives S for a unit when all the outcomes are achieved A student must: Produce work that demonstrates achievement of the outcome/s Observe school and VCAA rules If a teacher judges that all outcomes are achieved, the student satisfactorily completes the unit. The decision to award an ‘S’ for the unit is distinct from the assessment of levels of achievement.

46. Importance of Internal Moderation  Consistency of teacher decisions  Procedures for making school-based assessments  For Statistical Moderation purposes, each school’s assessment in a study is treated as a single group not as separate unique teaching classes

47. Indicative Grades primary purpose is to be used as part of the quality assurance procedures for marking examinations, however they are also used in the calculation of the DES. are the prediction of a student’s actual level of achievement on the examination the rank order and level of spread of the indicative grades for the school cohort in the study is of prime importance.

48. Indicative Grades Suggestions for producing Indicative Grades: Indicative Grades should be based on a similar task to the exam or even a past exam. Not necessarily the same as coursework performance. The previous years grade range can be used to inform this process http://www.vcaa.vic.edu.au/Pages/vce/statistics/subjectstats.aspx http://www.vcaa.vic.edu.au/Pages/vce/statistics/subjectstats.aspx Not a traditional notion of what a grade’s value may be. In one Study the A+ exam grade range may be 98-100, yet may be 74-100 in another.

49. Contact Details Student Records and Results student.records@edumail.vic.gov.au

50. Exam Conduct and Supervision

51. VCE Examination Conduct and Administration Support Resources  VCE Examination Manual  VCE Examination Document Register  VCE Exams Navigator  GAT Information brochure  Training sessions for new chief supervisors and relevant school personnel Training sessions for new chief supervisors and/or new school personnel - MAY increased focus on school audits in 2016, therefore no briefing sessions for ongoing chief supervisors and school personnel; key information/updates refer to Examination Manual and VCE Session Details and Equipment Listing  VCAA Bulletins and Notices  VCAA website - vcaa.vic.edu.au/vce/examsvcaa.vic.edu.au/vce/exams

52. All Principals must read and sign this agreement to certify that they fully understand all VCAA requirements for conducting and administering VCE external assessments. The Principal may delegate the management of their VCE external assessments to appropriate school personnel. 2016 Agreement to conduct and administer VCE external assessments

53. 2015 Examination Conduct and Supervision issues – focus for 2016  Need for school personnel to work closely with and support supervisors, particularly when only one supervisor  Understanding and administering Special Examination Arrangements  Ensure students are adequately prepared  Appropriate school personnel to carry out materials and identification checks prior to students entering examination room  Mobile phones/electronic devices – final check before reading time commences – confiscate then return

54. 2015 Examination Conduct and Supervision issues – focus for 2016  Additional response materials cannot be brought in by students. Spare question and answer books or general answer books should be provided. Lined paper is the last option. Complete incident report & journal when lined paper supplied.  Supervisors/school personnel to be aware of examination specific emergency evacuation plan  Observation visits during VCE examinations and the GAT will continue in 2016  Increased focus on auditing of administrative procedures prior to examination periods in 2016.

55. VCAA Key Contacts  VCE Examination Planning and Logistics: Maria Fragale Phone: 03 9225 2255 Email: fragale.maria.m@edumail.vic.gov.aufragale.maria.m@edumail.vic.gov.au Susan Meadows Phone 03 9225 2237 Email: meadows.susan.s@edumail.vic.gov.au

56. Statistical Moderation and Study Score Calculation

57. What and Why? A process that moderates the School-based Assessment scores Uses the exam scores because it is the only task that is exactly the same for each student in the study

58. What is Statistical Moderation? Process to ensure comparability of results Aims to eliminate marking differences between schools, not within Aligns external and internal assessment scales Maintains rank order given by the school

59. The Common Scale USA $299 Singapore $370 Australia $350 Which is the cheapest ? The smartphone from Singapore

60. Why is it Needed? Assessment marking varies between schools Measurements are only comparable when they are expressed on the same scale School-based assessment can only be included in the ATAR (ENTER) if it is moderated

61. How is it Done? Identify the moderation groups in each study Calculate an external score for each student Align the distributions of school-based assessment and external scores Calculate moderation formula and then apply to the coursework score for each student Statistical Moderation

62. Using the Common Scale Raw School Assessment External Score = Moderated School Assessment Highest Score in School Upper Quartile in School Median in School Zero score in School Lower Quartile in School Highest Score in external Upper Quartile in external Median in external Lower Quartile in external Zero score in external

63. Typical Group Raw Score (0-100) Examination (0-120) External Score (0-100) Moderated Score 100MAXIMUM 99 92 86 85UPPER QT. 83 81 68 65MEDIAN 62 61 60 59 57LOWER QT 47 40 35 Raw Score (0-100) Examination (0-120) External Score (0-100) Moderated Score 10095MAXIMUM 9992 86 83 8577UPPER QT. 8372 8369 8169 6859 6556MEDIAN 6252 6149 6043 5935 5732LOWER QT 4731 4030 3529 Raw Score (0-100) Examination (0-120) External Score (0-100) Moderated Score 1009589MAXIMUM 999287 928684 868382 857778UPPER QT. 837275 836974 816974 685968 655666MEDIAN 625263 614961 604358 593553 573251LOWER QT 473151 403050 352949 Raw Score (0-100) Examination (0-120) External Score (0-100) Moderated Score 1009589 MAXIMUM 99928788 92868485 86838279 857778 UPPER QT. 837275 83697475 81697473 68596867 655666 MEDIAN 62526360 61496157 60435855 59355354 573251 LOWER QT 47315148 40305045 35294941

64. Capable Student in a Lower Performing Class RS (0-100) EXAM (0-120) EXT (0-100) MOD (0-100) 93 MAXIMUM 78 72 70 MEDIAN 61 59 56 53 RS (0-100) EXAM (0-120) EXT (0-100) MOD (0-100) 93111 MAXIMUM 7888 72 70 68 MEDIAN 6164 5963 5662 5360 RS (0-100) EXAM (0-120) EXT (0-100) MOD (0-100) 9311198 MAXIMUM 788884 72 69 727068 706866 MEDIAN 616455 59 6354 566252 536050 RS (0-100) EXAM (0-120) EXT (0-100) MOD (0-100) 9311198 MAXIMUM 78888480 72 69 72706869 706866 MEDIAN 616455 596354 566252 536050

65. Tie at the Top CRSEXAMEXTMOD 100120100 119100 119100 CRSEXAMEXTMOD 98120100 98119100 98119100 CRSEXAMEXTMOD 100119100 8182 1008182 CRSEXAMEXTMOD 100120100 119100 119100 CRSEXAMEXTMOD 98120100 98119100 98119100 CRSEXAMEXTMOD 10011910088 1008182 1008182 RSEXAMEXTMOD 100120100 119100 119100 CRSEXAMEXTMOD 98120100 98119100 98119100 CRSEXAMEXTMOD 10011910088 100818288 100818288

66. Ranked Scores Report Schools with multiple classes undertaking the same VCE Unit 3/4 sequence, now have an additional resource available via a VASS report. This may be accessed via the following menu path:  Results Admin  VCE Reports  School Scores  By School (Ranked) The report will allow the teachers to compare the GA scores in a ranked format across the school.

67. Partnerships and Statistical Moderation  Statistical Moderation works most effectively with groups larger than 5  The VCAA requires that schools form partnerships  Schools who find it difficult to find a partner for any reason; lack of time / lack of access / lack of willingness can be reassured that the statistical moderation process is run as usual with the addition of precautionary checks

68. VET and Statistical Moderation  The moderation group for VCE VET coursework scores is the RTO that has delivered the program for a group of students.  The group may be all the schools auspiced by the RTO

69. Important Points to Remember about Statistical Moderation  Required so that school assessment can be used fairly as part of VCE assessment  Any adjustment to a student’s school-based assessment is made solely on the basis of the relationship between the groups school-based assessment and external scores for the group.  Does not change the rank order of students as determined by the school  Not influenced by students with negative anomalous results as they are excluded from the moderation process before moderation formulas are calculated  Students whose scores are excluded have their scores moderated using the formulas calculated for the rest of the group Statistical Moderation

70. Statistical Moderation Report

71. If the Initial Coursework average score is higher than the Moderated Coursework average score then: School’s assessment scale is less challenging than State Scale VCE EARS – Statistical Moderation

73. If the Initial Coursework average score is lower than the Moderated Coursework average score then: School’s assessment scale is more challenging than State Scale VCE EARS – Statistical Moderation

75. What is the purpose of this report? To provide awareness of the mapping of a schools school based assessment scale onto the state-wide scale. Is there an ideal look for this report? Generally schools should be within or close to the diagonal gold bands range, but not necessarily aiming for a perfectly straight line through the diagonal. This is because school based assessment is not meant to be a replication of external assessments. Schools need to work with their student cohort in the setting of tasks and in marking, such to engage lower ability students while also challenging/ discriminating higher ability students.

77. Study Score Calculation To be eligible for a study score a student must achieve ‘S’ results for units 3&4 in the one year, unless granted Interrupted Studies status. Achieve two or more GA results in the study A study score is calculated using the students’ final numeric score in each GA with each GA contributing a specified percentage Number between 0-50 with mean 30 and standard deviation 7 Study scores are distributed according to the properties of a normal distribution curve

78. Study Score Calculation

79.  Calculate  Subtract  Divide  Multiply  Add

80. Study Score Example 1 MAX. SCOREWEIGHTINGMEAN STANDARD DEVIATION A+ GRADE SCALE GA1 10025%69.2115.5284 – 100 GA2 10025%70.7814.9585 – 100 GA3 12050%66.3218.6194 – 120 STUDENT ASCOREGRADE STANDARDISED SCORE WEIGHTED SCORE GA1 100A+ 1.9847160.496179 GA2 100A+ 1.9538610.488465 GA3 106A+ 2.1326571.066328 2.050972 = 47 STUDENT BSCOREGRADE STANDARDISED SCORE WEIGHTED SCORE GA1 84A+ 0.9534680.238367 GA2 90A+ 1.2851800.321295 GA3 95A+ 1.5414420.770721 1.330383 = 40

81. Study Score Example 2 MAX. SCOREWEIGHTINGMEAN STANDARD DEVIATION A+ GRADE SCALE GA1 10025%69.2115.5284 - 100 GA2 10025%70.7814.9585 – 100 GA3 12050%66.3218.6194 - 120 STUDENT CSCOREGRADE STANDARDISED SCORE WEIGHTED SCORE GA1 96A+ 1.7269040.431726 GA2 98A+ 1.8201240.455031 GA3 92A 1.3802020.690101 1.576858 = 42 STUDENT DSCOREGRADE STANDARDISED SCORE WEIGHTED SCORE GA1 84A+ 0.9534680.238367 GA2 90A+ 1.2851800.321295 GA3 95A+ 1.5414420.770721 1.330383 = 40

82. Distribution of Study Scores as a % Approximate proportion of students who achieve a study score on or above the stated values. STUDY SCOREON/ABOVEENGLISH 42,000 students THEATRE STUDIES 1,000 students 500.3%1263 452%84020 409%379090 3526%10, 950260 3053%22, 320530 2578%32, 850780 2093%39, 170930

83. Things to Remember  Indicates how the student performed against all other students who did the study in that year.  Calculated using the numeric results for the GA not the grade.  Moderated coursework scores are used when calculating study scores to ensure fairness.  A strong performance on one GA and a weak performance in another GA will not necessarily result in a high study score  Studies where there are less than 250 students are reviewed each year by a Study Score Review Panel.

84. Contact Details Student Records and Results student.records@edumail.vic.gov.au