Presentation is loading. Please wait.

Presentation is loading. Please wait.

Broad-Based Testing Los Angeles County Office of Education PERSONNEL COMMISSION.

Similar presentations


Presentation on theme: "Broad-Based Testing Los Angeles County Office of Education PERSONNEL COMMISSION."— Presentation transcript:

1 Broad-Based Testing Los Angeles County Office of Education PERSONNEL COMMISSION

2 The Problem Many related classifications Many related classifications Differ on specific job content and levels of responsibility Differ on specific job content and levels of responsibility Many obstacles to class consolidation - logistical, political, fiscal Many obstacles to class consolidation - logistical, political, fiscal Each class has a unique examination Each class has a unique examination Variably content and quality Variably content and quality Not consistently updated Not consistently updated 2-3 month recruitment & examination cycle time 2-3 month recruitment & examination cycle time No overall competency architecture across the classes No overall competency architecture across the classes Core competencies and competency progression Core competencies and competency progression Pass point paradoxes (lower pass points for higher level jobs based on selection ratios) Pass point paradoxes (lower pass points for higher level jobs based on selection ratios)

3 Purpose and Objectives Improve testing quality, reliability, and efficiency Improve testing quality, reliability, and efficiency Improve coherence of clerical examination plans Improve coherence of clerical examination plans Reduce redundant testing Reduce redundant testing Reduce time to place candidates on eligibility lists Reduce time to place candidates on eligibility lists Ensure eligibility lists are quickly available Ensure eligibility lists are quickly available

4 Strategy Core test battery for as many classifications as possible Core test battery for as many classifications as possible Annual calendar of assessment opportunities (e.g., quarterly) Annual calendar of assessment opportunities (e.g., quarterly) Computer-based testing Computer-based testing Score banking and certification to different exam plans Score banking and certification to different exam plans Different weights and cut-off scores for different classifications based upon relevancy and level needed Different weights and cut-off scores for different classifications based upon relevancy and level needed College-Board Model (SAT, GRE, etc.) College-Board Model (SAT, GRE, etc.)

5 Score Data Flow

6 Development of the Test Battery Reviewed job analyses from Agency-Wide Classification Study Reviewed job analyses from Agency-Wide Classification Study Re-stated duties into generalized work activity (GWA) statements with no reference to specific job content. Re-stated duties into generalized work activity (GWA) statements with no reference to specific job content. Map GWAs to each classification Map GWAs to each classification Identify relevant assessment tools for GWAs Identify relevant assessment tools for GWAs Via GWAs, map assessment tools to Classifications Via GWAs, map assessment tools to Classifications Derive relevancy and weight of assessment tools to classifications. Derive relevancy and weight of assessment tools to classifications.

7 Matrix of GWA with Classifications ClassGWA Typist Clerk SecretaryAccountingClerkReceptionist Greet, interact, and provide information to others in person and on the telephone 1212 Verify, input, and correct data and information 2120 Receive, sort, and categorize information and materials 2221 Understand, interpret, explain, and follow directions, rules, and regulations 2121

8 Competencies Assessed - Tests 1. Following Instructions (MC) 2. English Usage & Grammar (MC) 3. Microsoft Outlook (MC) 4. Microsoft Excel (Performance, OPAC) 5. Microsoft Word Skills (Performance, OPAC) 6. Telephone - Customer Service (SJ, OPAC) 7. Sequencing and ordering speed and accuracy (timed) 8. Computational speed and accuracy (timed) 9. Checking and comparing speed and accuracy (timed) 10. Data Entry speed and accuracy (timed, OPAC)

9 Matrix of Tests with GWAs TestGWA Telephone Customer Service Data Entry speed and accuracy Sequencing and ordering speed and accuracy Following Written Instructions Greet, interact, and provide information to others in person and on the telephone x Verify, input, and correct data and information xx Receive, sort, and categorize information and materials x Understand, interpret, explain, and follow directions, rules, and regulations x

10 ClassTest Typist Clerk SecretaryAccountingClerkReceptionist Telephone Customer Service 1212 Data Entry speed and accuracy 2120 Sequencing and ordering speed and accuracy 2221 Following Written Instructions 2121 Matrix of Tests with Classifications

11 Result Linkage of tests-to-tasks-to-classifications to establish job relatedness Linkage of tests-to-tasks-to-classifications to establish job relatedness Derived weighting scheme for each classification Derived weighting scheme for each classification Relevant tests Relevant tests Relevant weights Relevant weights Job specific competencies identified in the job analyses are assessed in specialized examination parts Job specific competencies identified in the job analyses are assessed in specialized examination parts Min Quals Min Quals TE TE Interview Interview Performance Performance

12 Applicable Classifications 1. Clerk 2. Intermediate Clerk 3. Senior Clerk 4. School Clerk 5. Senior School Clerk 6. Data Control Clerk 7. Senior Data Control Clerk 8. Typist Clerk 9. Intermediate Typist Clerk 10. Temporary Office Worker 11. Senior Typist Clerk 12. Department Assistant, Dance 13. Department Assistant, Music 14. Department Assistant, Theater 15. Department Assistant, Visual Arts 16. Receptionist 17. Reader 18. Information Resources Specialist 19. Media Dispatching Clerk 20. Secretary 21. Division Secretary 22. Legal Secretary 23. School Administrative Secretary 24. Senior Division Secretary 25. Executive Legal Secretary 26. Executive Assistant

13 Affected Positions Classification # LACOE Positions % of Clerical Positions Senior School Clerk 11027% Secretary7819% Division Secretary 4611% Senior Typist Clerk 359% School Administrative Secretary 307% Intermediate Typist Clerk 287% Senior Division Secretary 246% TOTAL35187%

14 Administrative Practices Score Life: Score Life: 2 years 2 years Test Administration: Test Administration: Every 3 months Every 3 months Test Retake: Test Retake: Once every 6 months Once every 6 months Retake Scope: Retake Scope: Whole Battery – not individual tests for logistical reasons Whole Battery – not individual tests for logistical reasons Weighted or Qualifying-Only: Weighted or Qualifying-Only: Qualifying Pass/Fail-only for Promotional Exams Qualifying Pass/Fail-only for Promotional Exams Weighted for Open recruitment Weighted for Open recruitment

15 Effective Scores: Effective Scores: Only the candidates most recent score, not the highest score, can be certified to a list. Only the candidates most recent score, not the highest score, can be certified to a list. For candidates whose scores enable them to be placed on an eligibility list (pass the exam), the certified scores stands for the duration of eligibility on the respective list. For candidates whose scores enable them to be placed on an eligibility list (pass the exam), the certified scores stands for the duration of eligibility on the respective list. Scores already certified are not updated by retakesScores already certified are not updated by retakes Ones score (and relative ranking) on a list can not be improved until eligibility expires (one year).Ones score (and relative ranking) on a list can not be improved until eligibility expires (one year). Multiple (10) Pass Points Multiple (10) Pass Points Low individual test pass points Low individual test pass points Reduced Adverse Impact Reduced Adverse Impact 3 apparent factors: 3 apparent factors: Computer skills, speed and accuracy, verbalComputer skills, speed and accuracy, verbal Administrative Practices

16 Continuous offering of the BBC Continuous offering of the BBC Continuous recruitment for all affected classifications Continuous recruitment for all affected classifications Establishes a pre-tested pool of potential candidates for the affected classes Establishes a pre-tested pool of potential candidates for the affected classes For most classifications, limited or no public posting for job specific recruitments For most classifications, limited or no public posting for job specific recruitments Notifications sent to pre-tested pool, based on test cut-off score Notifications sent to pre-tested pool, based on test cut-off score Invitations to apply to take the specialized exam parts for the classification Invitations to apply to take the specialized exam parts for the classification Recruitment

17 No need to go to the general population for each recruitment

18 Benefits Received and Expected Test quality improvement through Test quality improvement through Data monitoring and psychometric analysis Data monitoring and psychometric analysis Empirical validation research Empirical validation research Development of alternate forms Development of alternate forms Administration efficiencies through Administration efficiencies through Managed efficiencies in test administration and score managements Managed efficiencies in test administration and score managements Minimizing retesting of the same candidates for different classifications Minimizing retesting of the same candidates for different classifications Improved communications with candidates Improved communications with candidates Recruitment enhancement through Recruitment enhancement through Maintaining a pre-tested pool of applicants Maintaining a pre-tested pool of applicants Having something to offer at job fares Having something to offer at job fares Reduced eligibility list production cycle time Reduced eligibility list production cycle time

19 Broad Based Administrative Classes (Round 1) ADMINISTRATIVE ANALYST ADMINISTRATIVE ANALYST ADMINISTRATIVE ASSISTANT ADMINISTRATIVE ASSISTANT ADMINISTRATIVE AIDE ADMINISTRATIVE AIDE ASSISTANT ADMINISTRATIVE ANALYST ASSISTANT ADMINISTRATIVE ANALYST RESOURCE & DEVELOPMENT ANALYST RESOURCE & DEVELOPMENT ANALYST PROJECT COORDINATOR PROJECT COORDINATOR COMPENSATION ANALYST COMPENSATION ANALYST RESEARCH ANALYST RESEARCH ANALYST LEGISLATIVE ANALYST LEGISLATIVE ANALYST BUDGET ANALYST BUDGET ANALYST HEAD START PROGRAM RESULTS SPECIALIST HEAD START PROGRAM RESULTS SPECIALIST HUMAN RESOURCES AIDE HUMAN RESOURCES AIDE HUMAN RESOURCES ANALYST HUMAN RESOURCES ANALYST HS PROGRAM DEVELOPMENT SPECIALIST HS PROGRAM DEVELOPMENT SPECIALIST ASSISTANT HUMAN RESOURCES ANALYST ASSISTANT HUMAN RESOURCES ANALYST LABOR RELATIONS SPECIALIST LABOR RELATIONS SPECIALIST

20 Broad Based Administrative Tests ComputerWrittenSJTTE Gathering & Analyzing Data XX X Attention to Detail X X Critical Thinking & Problem Solving X Mathematical Agility X Using Technology XX X Reading Comprehension X Writing XX Oral Communication* X Informing X Professional Impact X Relationship Building X Managing Performance XX Developing Others XX Project Management X X Leadership X Group Facilitation Position Relevant Oral Exam (role-play exam). Presentation Skill

21 Thank you!


Download ppt "Broad-Based Testing Los Angeles County Office of Education PERSONNEL COMMISSION."

Similar presentations


Ads by Google