Presentation is loading. Please wait.

Presentation is loading. Please wait.

The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context.

Similar presentations


Presentation on theme: "The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context."— Presentation transcript:

1 The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context Group warrenb@contextgroup.com (310) 670-4175 warrenb@contextgroup.com

2 The Context Group www.contextgroup.com/hr.htm Some History In Personnel Selection Personality Now Of Great Interest to I/O PsychologistsPersonality Now Of Great Interest to I/O Psychologists Performance Testing Has a Long History in I/O PsychologyPerformance Testing Has a Long History in I/O Psychology Computer-Based Tests Are Increasingly PopularComputer-Based Tests Are Increasingly Popular

3 The Context Group www.contextgroup.com/hr.htm Validity of Various Selection Procedures (Schmidt & Hunter, 1998) Personnel measureValidity (r)Personnel measureValidity (r) Work Sample Tests.54Biographical Data.35 Cognitive Ability (IQ).51Conscientiousness Tests.31 Interviews (structured).51Reference Checks.26 Peer Ratings.49Job Experience (years).18 Job Knowledge Tests.48Education (years).10 Integrity Tests.41Interests.10 Job Tryout Procedures.44Graphology (handwriting).02 Interviews (unstructured).38Age-.01

4 The Context Group www.contextgroup.com/hr.htm What Well Be Addressing The Criterion Validity of Various Innovative Procedures.The Criterion Validity of Various Innovative Procedures. How Streamlining Assessments Can Increase ROI and Usability.How Streamlining Assessments Can Increase ROI and Usability.

5 The Context Group www.contextgroup.com/hr.htm Comparison of Validity Between Live and Computer-Based Simulations Many organizations are looking to leverage computers in selectionMany organizations are looking to leverage computers in selection –More efficiency –More accurate data gathering –Projects a more positive image with applicants Are they getting good value?Are they getting good value?

6 The Context Group www.contextgroup.com/hr.htm Why is This Important? If Computer-Based Simulations Are As Effective as Live Ones, Then:If Computer-Based Simulations Are As Effective as Live Ones, Then: –Objective Way To Measure Skill and Ability –Cost Savings Can Be Realized

7 The Context Group www.contextgroup.com/hr.htm Live and Computer Based Simulations Live Simulations Have Been Shown To Be Valid Predictors of Job PerformanceLive Simulations Have Been Shown To Be Valid Predictors of Job Performance Computers Are Limited in Their Ability to Analyze Open-Ended ResponsesComputers Are Limited in Their Ability to Analyze Open-Ended Responses Is the Lower Cost of Computer Simulations Worth the (Presumed) Lower ValidityIs the Lower Cost of Computer Simulations Worth the (Presumed) Lower Validity

8 The Context Group www.contextgroup.com/hr.htm Item Writing Possibilities: All Applicants Get the Same Test Item 1 Item 2

9 The Context Group www.contextgroup.com/hr.htm Item Writing Possibilities: All Applicants Potentially Get A Unique Test Item 1 Item 2 Item 4 Item 3

10 The Context Group www.contextgroup.com/hr.htm Item Writing Possibilities: All Applicants Get Similar But Different Tests Item 1 Item 2 Item 3 Item 4

11 The Context Group www.contextgroup.com/hr.htm Simulation Demonstrations Supervisor In-BasketSupervisor In-Basket Supervisor CoachingSupervisor Coaching The CSR Computer Based Simulation TestThe CSR Computer Based Simulation Test The CSR Live Simulation TestThe CSR Live Simulation Test

12 The Context Group www.contextgroup.com/hr.htm Comparison But Do These Innovative Methods work as well (and have the same ROI) as Traditional Ones?But Do These Innovative Methods work as well (and have the same ROI) as Traditional Ones? Same Construct Validity?Same Construct Validity? Worse/Equal/Better Criterion-Related Validity?Worse/Equal/Better Criterion-Related Validity?

13 The Context Group www.contextgroup.com/hr.htm What the CBT Measures

14 The Context Group www.contextgroup.com/hr.htm Live Simulations Designed as a Traditional Simulation ExerciseDesigned as a Traditional Simulation Exercise Trained Role-Players/RatersTrained Role-Players/Raters 1 Practice and 2 Real Calls1 Practice and 2 Real Calls

15 The Context Group www.contextgroup.com/hr.htm Live Simulation Factor Structure

16 The Context Group www.contextgroup.com/hr.htm Validities: Computer vs. Live Live k=3, Computer k=21

17 The Context Group www.contextgroup.com/hr.htm Moral to the Story Computer Based Simulations Have the Same Construct Validity as Their Traditional CounterpartsComputer Based Simulations Have the Same Construct Validity as Their Traditional Counterparts Multiple Choice Format Does Not Lead to a Decrement in ValidityMultiple Choice Format Does Not Lead to a Decrement in Validity Innovative Methods Provided Higher ROIInnovative Methods Provided Higher ROI

18 The Context Group www.contextgroup.com/hr.htm Improvements to Computer Tests Better, More Sophisticated Branching TechniquesBetter, More Sophisticated Branching Techniques Voice Recognition of Tone, Not Just WordsVoice Recognition of Tone, Not Just Words


Download ppt "The Context Group www.contextgroup.com/hr.htm Innovative Methods of Selecting New Employees: Simulations and In-Baskets Warren Bobrow, Ph.D. The Context."

Similar presentations


Ads by Google