Presentation is loading. Please wait.

Presentation is loading. Please wait.

The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context.

Similar presentations


Presentation on theme: "The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context."— Presentation transcript:

1 The Context Group Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context Group (310)

2 The Context Group Some History In Personnel Selection Personality Now Of Great Interest to I/O PsychologistsPersonality Now Of Great Interest to I/O Psychologists Performance Testing Has a Long History in I/O PsychologyPerformance Testing Has a Long History in I/O Psychology Computer-Based Tests Are Increasingly PopularComputer-Based Tests Are Increasingly Popular

3 The Context Group Validity of Various Selection Procedures (Schmidt & Hunter, 1998) Personnel measureValidity (r)Personnel measureValidity (r) Work Sample Tests.54Biographical Data.35 Cognitive Ability (IQ).51Conscientiousness Tests.31 Interviews (structured).51Reference Checks.26 Peer Ratings.49Job Experience (years).18 Job Knowledge Tests.48Education (years).10 Integrity Tests.41Interests.10 Job Tryout Procedures.44Graphology (handwriting).02 Interviews (unstructured).38Age-.01

4 The Context Group What Well Be Addressing The Criterion Validity of Various Innovative Procedures.The Criterion Validity of Various Innovative Procedures. How Streamlining Assessments Can Increase ROI and Usability.How Streamlining Assessments Can Increase ROI and Usability.

5 The Context Group Comparison of Validity Between Live and Computer-Based Simulations Many organizations are looking to leverage computers in selectionMany organizations are looking to leverage computers in selection –More efficiency –More accurate data gathering –Projects a more positive image with applicants Are they getting good value?Are they getting good value?

6 The Context Group Why is This Important? If Computer-Based Simulations Are As Effective as Live Ones, Then:If Computer-Based Simulations Are As Effective as Live Ones, Then: –Objective Way To Measure Skill and Ability –Cost Savings Can Be Realized

7 The Context Group Live and Computer Based Simulations Live Simulations Have Been Shown To Be Valid Predictors of Job PerformanceLive Simulations Have Been Shown To Be Valid Predictors of Job Performance Computers Are Limited in Their Ability to Analyze Open-Ended ResponsesComputers Are Limited in Their Ability to Analyze Open-Ended Responses Is the Lower Cost of Computer Simulations Worth the (Presumed) Lower ValidityIs the Lower Cost of Computer Simulations Worth the (Presumed) Lower Validity

8 The Context Group Item Writing Possibilities: All Applicants Get the Same Test Item 1 Item 2

9 The Context Group Item Writing Possibilities: All Applicants Potentially Get A Unique Test Item 1 Item 2 Item 4 Item 3

10 The Context Group Item Writing Possibilities: All Applicants Get Similar But Different Tests Item 1 Item 2 Item 3 Item 4

11 The Context Group Simulation Demonstrations Supervisor In-BasketSupervisor In-Basket Supervisor CoachingSupervisor Coaching The CSR Computer Based Simulation TestThe CSR Computer Based Simulation Test The CSR Live Simulation TestThe CSR Live Simulation Test

12 The Context Group Comparison But Do These Innovative Methods work as well (and have the same ROI) as Traditional Ones?But Do These Innovative Methods work as well (and have the same ROI) as Traditional Ones? Same Construct Validity?Same Construct Validity? Worse/Equal/Better Criterion-Related Validity?Worse/Equal/Better Criterion-Related Validity?

13 The Context Group What the CBT Measures

14 The Context Group Live Simulations Designed as a Traditional Simulation ExerciseDesigned as a Traditional Simulation Exercise Trained Role-Players/RatersTrained Role-Players/Raters 1 Practice and 2 Real Calls1 Practice and 2 Real Calls

15 The Context Group Live Simulation Factor Structure

16 The Context Group Validities: Computer vs. Live Live k=3, Computer k=21

17 The Context Group Moral to the Story Computer Based Simulations Have the Same Construct Validity as Their Traditional CounterpartsComputer Based Simulations Have the Same Construct Validity as Their Traditional Counterparts Multiple Choice Format Does Not Lead to a Decrement in ValidityMultiple Choice Format Does Not Lead to a Decrement in Validity Innovative Methods Provided Higher ROIInnovative Methods Provided Higher ROI

18 The Context Group Improvements to Computer Tests Better, More Sophisticated Branching TechniquesBetter, More Sophisticated Branching Techniques Voice Recognition of Tone, Not Just WordsVoice Recognition of Tone, Not Just Words


Download ppt "The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context."

Similar presentations


Ads by Google