Presentation is loading. Please wait.

Presentation is loading. Please wait.

All About Performance www.allaboutperformance.biz Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. All About.

Similar presentations


Presentation on theme: "All About Performance www.allaboutperformance.biz Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. All About."— Presentation transcript:

1 All About Performance www.allaboutperformance.biz Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. All About Performance, LLC warren@allaboutperformance.biz (310) 670-4175

2 All About Performance www.allaboutperformance.biz Some History In Personnel Selection Personality Now Of Great Interest to I/O PsychologistsPersonality Now Of Great Interest to I/O Psychologists Performance Testing Has a Long History in I/O PsychologyPerformance Testing Has a Long History in I/O Psychology Computer-Based Tests Are Increasingly PopularComputer-Based Tests Are Increasingly Popular

3 All About Performance www.allaboutperformance.biz Validity of Various Selection Procedures (Schmidt & Hunter, 1998) Personnel measureValidity (r)Personnel measureValidity (r) Work Sample Tests.54Biographical Data.35 Cognitive Ability (IQ).51Conscientiousness Tests.31 Interviews (structured).51Reference Checks.26 Peer Ratings.49Job Experience (years).18 Job Knowledge Tests.48Education (years).10 Integrity Tests.41Interests.10 Job Tryout Procedures.44Graphology (handwriting).02 Interviews (unstructured).38Age-.01

4 All About Performance www.allaboutperformance.biz What Well Be Addressing The Criterion Validity of Various Innovative Procedures.The Criterion Validity of Various Innovative Procedures. How Streamlining Assessments Can Increase ROI and Usability.How Streamlining Assessments Can Increase ROI and Usability.

5 All About Performance www.allaboutperformance.biz Comparison of Validity Between Live and Computer-Based Simulations Many organizations are looking to leverage computers in selectionMany organizations are looking to leverage computers in selection –More efficiency –More accurate data gathering –Projects a more positive image with applicants Are they getting good value?Are they getting good value?

6 All About Performance www.allaboutperformance.biz Why is This Important? If Computer-Based Simulations Are As Effective as Live Ones, Then:If Computer-Based Simulations Are As Effective as Live Ones, Then: –Objective Way To Measure Skill and Ability –Cost Savings Can Be Realized

7 All About Performance www.allaboutperformance.biz Live and Computer Based Simulations Live Simulations Have Been Shown To Be Valid Predictors of Job PerformanceLive Simulations Have Been Shown To Be Valid Predictors of Job Performance Computers Are Limited in Their Ability to Analyze Open-Ended ResponsesComputers Are Limited in Their Ability to Analyze Open-Ended Responses Is the Lower Cost of Computer Simulations Worth the (Presumed) Lower ValidityIs the Lower Cost of Computer Simulations Worth the (Presumed) Lower Validity

8 All About Performance www.allaboutperformance.biz Item Writing Possibilities: All Applicants Get the Same Test Item 1 Item 2

9 All About Performance www.allaboutperformance.biz Item Writing Possibilities: All Applicants Potentially Get A Unique Test Item 1 Item 2 Item 4 Item 3

10 All About Performance www.allaboutperformance.biz Item Writing Possibilities: All Applicants Get Similar But Different Tests Item 1 Item 2 Item 3 Item 4

11 All About Performance www.allaboutperformance.biz Simulation Demonstrations Supervisor In-BasketSupervisor In-Basket Supervisor CoachingSupervisor Coaching The CSR Computer Based Simulation TestThe CSR Computer Based Simulation Test The CSR Live Simulation TestThe CSR Live Simulation Test

12 All About Performance www.allaboutperformance.biz Comparison But Do These Innovative Methods work as well (and have the same ROI) as Traditional Ones?But Do These Innovative Methods work as well (and have the same ROI) as Traditional Ones? Same Construct Validity?Same Construct Validity? Worse/Equal/Better Criterion-Related Validity?Worse/Equal/Better Criterion-Related Validity?

13 All About Performance www.allaboutperformance.biz What the CBT Measures

14 All About Performance www.allaboutperformance.biz Live Simulations Designed as a Traditional Simulation ExerciseDesigned as a Traditional Simulation Exercise Trained Role-Players/RatersTrained Role-Players/Raters 1 Practice and 2 Real Calls1 Practice and 2 Real Calls

15 All About Performance www.allaboutperformance.biz Live Simulation Factor Structure

16 All About Performance www.allaboutperformance.biz Validities: Computer vs. Live Live k=3, Computer k=21

17 All About Performance www.allaboutperformance.biz Moral to the Story Computer Based Simulations Have the Same Construct Validity as Their Traditional CounterpartsComputer Based Simulations Have the Same Construct Validity as Their Traditional Counterparts Multiple Choice Format Does Not Lead to a Decrement in ValidityMultiple Choice Format Does Not Lead to a Decrement in Validity Innovative Methods Provided Higher ROIInnovative Methods Provided Higher ROI

18 All About Performance www.allaboutperformance.biz Improvements to Computer Tests Better, More Sophisticated Branching TechniquesBetter, More Sophisticated Branching Techniques Voice Recognition of Tone, Not Just WordsVoice Recognition of Tone, Not Just Words


Download ppt "All About Performance www.allaboutperformance.biz Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. All About."

Similar presentations


Ads by Google