Contact Info: www.ecu.edu.au/research/week Improving Decision Making: The use of simple heuristics Dr. Guillermo Campitelli Cognition Research Group Edith.

Slides:



Advertisements
Similar presentations
Chapter 14: Usability testing and field studies
Advertisements

Significance testing Ioannis Karagiannis (based on previous EPIET material) 18 th EPIET/EUPHEM Introductory course
The Recognition Heuristic Goldstein and Gigerenzer (2002)Goldstein and Gigerenzer (2002) presented evidence that people can profit from inferences from.
Bayesian Inference Chris Mathys Wellcome Trust Centre for Neuroimaging UCL SPM Course London, May 12, 2014 Thanks to Jean Daunizeau and Jérémie Mattout.
Session 8b Decision Models -- Prof. Juran.
Hypothesis Testing making decisions using sample data.
Review You run a t-test and get a result of t = 0.5. What is your conclusion? Reject the null hypothesis because t is bigger than expected by chance Reject.
Decision Errors and Power
Robust decision making in uncertain environments Henry Brighton.
Visual Recognition Tutorial
Minority Games A Complex Systems Project. Going to a concert… But which night to pick? Friday or Saturday? You want to go on the night with the least.
Review: What influences confidence intervals?
1 Practicals, Methodology & Statistics II Laura McAvinue School of Psychology Trinity College Dublin.
Basic Logic of Experimentation The design of an Internally valid experimental procedure requires us to: Form Equivalent Groups Treat Groups Identically.
Inference.ppt - © Aki Taanila1 Sampling Probability sample Non probability sample Statistical inference Sampling error.
Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides
Inferences About Process Quality
Models of Ecological Rationality: The Recognition Heuristic Daniel G. Goldstein and Gerd Gigerenzer Psychological Review 2002, Vol. 109, No. 1, 75–90.
Determining the Size of
Statistical Inference Dr. Mona Hassan Ahmed Prof. of Biostatistics HIPH, Alexandria University.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Hypothesis Testing:.
1 © Lecture note 3 Hypothesis Testing MAKE HYPOTHESIS ©
1 Dr. Jerrell T. Stracener EMIS 7370 STAT 5340 Probability and Statistics for Scientists and Engineers Department of Engineering Management, Information.
HYPOTHESIS TESTING Dr. Aidah Abu Elsoud Alkaissi
Hypothesis Testing.
Bayesian Hierarchical Models of Individual Differences in Skill Acquisition Dr Jeromy Anglim Deakin University 22 nd May 2015.
Perfection and bounded rationality in the study of cognition Henry Brighton.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Inferential Statistics.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
User Study Evaluation Human-Computer Interaction.
Testing & modeling users. The aims Describe how to do user testing. Discuss the differences between user testing, usability testing and research experiments.
Probability level 8 NZC AS91585 Apply probability concepts in solving problems.
Academic Research Academic Research Dr Kishor Bhanushali M
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Welcome to MM570 Psychological Statistics
Inferring the Mean and Standard Deviation of a Population.
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
When “Less Is More” – A Critique of the Heuristics & Biases Approach to Judgment and Decision Making Psychology 466: Judgment & Decision Making Instructor:
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 10 Comparing Two Groups Section 10.1 Categorical Response: Comparing Two Proportions.
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
Lecture №4 METHODS OF RESEARCH. Method (Greek. methodos) - way of knowledge, the study of natural phenomena and social life. It is also a set of methods.
Jump to first page Inferring Sample Findings to the Population and Testing for Differences.
The Practice of Statistics Third Edition Chapter 11: Testing a Claim Copyright © 2008 by W. H. Freeman & Company Daniel S. Yates.
Hypothesis Testing. Statistical Inference – dealing with parameter and model uncertainty  Confidence Intervals (credible intervals)  Hypothesis Tests.
Uncertainty and confidence Although the sample mean,, is a unique number for any particular sample, if you pick a different sample you will probably get.
Hypothesis Tests. An Hypothesis is a guess about a situation that can be tested, and the test outcome can be either true or false. –The Null Hypothesis.
The relationship between Psychology and Economics: The case of Behavioural Finance Dr. Guillermo Campitelli.
Uncertainty and controversy in environmental research
By Arijit Chatterjee Dr
Unit 3 Hypothesis.
STA 291 Spring 2010 Lecture 18 Dustin Lueker.
Review You run a t-test and get a result of t = 0.5. What is your conclusion? Reject the null hypothesis because t is bigger than expected by chance Reject.
This Week Review of estimation and hypothesis testing
Understanding Results
The Matching Hypothesis
Inferential statistics,
Chapter 9 Hypothesis Testing.
Inferences on Two Samples Summary
Scientific Method Section 1.2 & 1.3.
Stat 217 – Day 28 Review Stat 217.
I. Statistical Tests: Why do we use them? What do they involve?
PSY 626: Bayesian Statistics for Psychological Science
TESTs about a population mean
STA 291 Spring 2008 Lecture 18 Dustin Lueker.
Testing & modeling users
Research Design Research Methodology and Methods of Social Inquiry
STA 291 Summer 2008 Lecture 18 Dustin Lueker.
Tests of Significance Section 10.2.
Presentation transcript:

Contact Info: Improving Decision Making: The use of simple heuristics Dr. Guillermo Campitelli Cognition Research Group Edith Cowan University

Contact Info: 3 ways of improving decision making Acquiring knowledge (specific) –Example: chess grand masters Using formal methods –Example: Rules of logic, Statistics, Decision Theory Using simple heuristics –Example: Recognition Heuristic

Contact Info: Simple heuristics Is using simple heuristics a sound strategy? –Research by Gigerenzer and others presents evidence that people use simple heuristics –There is also evidence that using simple heuristics, in some circumstances, is better than using complex strategies

Contact Info: Simon’s (1955) bounded rationality –Limitations of the cognitive system –Good adaptation to the environment People use fast-and-frugal heuristics that “make us smart” (Gigerenzer et al., 1999) Ecological rationality (Gigerenzer and colleagues)

Contact Info: If one of two objects is recognised and the other is not, then infer that the recognised object has the higher value with respect to the criterion Which city has more inhabitants: –Hamburg or Solingen? Recognition Heuristic: If Hamburg is recognised and Solingen is nor recognised, choose Hamburg as the city with more inhabitants. Recognition Heuristic

Contact Info: What happens when using the RH is clearly a bad strategy? –Example: Vatican City against an unrecognised city Recognition Heuristic

Contact Info: RH is the default strategy Hypotheses of why RH is not always used: –H1: Threshold hypothesis –H2: Matching hypothesis –H3: Suspension hypothesis: –The non-use of RH is related to object-specific knowledge that is at odds with recognition (e.g., recognition of a city with a very small population) Suspension of the Recognition Heuristic (Pachur & Hertwig, 2006)

Contact Info: Cities environment –Investigate the non-use of RH –Run a model comparison between models that involve RH, suspension of RH, and knowledge beyond recognition Goals of the study

Contact Info: Cities environment –Creation of an environment of low recognition validity Mean recognition validity =.47 Recognition correlation =.04 –Material 8 cities 28 pairs –Tasks Choice: “Which of these cities has a higher number of inhabitants?” Recognition: “Did you know that there was a city with such name, before participating in the experiment?” –Participants 59 psychology students at Universidad Abierta Interamericana, Buenos Aires, Argentina –Variables Popularity (high, low) Population (large, small) Methods

Contact Info: Analyses χ 2 analyses of choices of each city as a function of population and popularity Model comparison Maximum Likelihood Estimation (MLE), Bayesian Inference Criterion (BIC) Deterministic Probabilistic Methods

Contact Info: Cities: Design Population of each city in millions of inhabitants.

Contact Info: Cities-Results: Recognition Proportion of participants that recognise each city

Contact Info: Cities-Results: Choices Proportion of choices of each city across all participants (59) and pairs (7) | Χ 2 (1) = , p <.0007

Contact Info: Number of choices as a function of popularity and size

Contact Info: Results averaged across participants: –Recognition: M =.57 (SD =.12) –Choice accuracy: M =.54 (SD =.10) Use of RH –78 % of choices across participants and pairs Results

Contact Info: RHg –Recognition heuristic + guess RHsg –Recognition heuristic + suspension + guess RHsur –Recognition heuristic + suspension + unrecognised KH –Knowledge Heuristic If one knows more about one city than the other, one should choose the city that one knows as the one with the higher value in the criterion CK –Criterion Knowledge RND –Random Models

Contact Info: Knowledge Heuristic: Yahoo Log 10 of number of pages the name of the city appears in the internet, using Yahoo search engine

Contact Info: Values of both items in each pair Difference between values Probability of choosing Item 1 given the model Probability of actual choice given the model –2 types of probability models: All or none Probabilistic Log-likelihood BIC All the previous calculations in each participant Classification of participants as users of the model with lower BIC Procedure of calculations

Contact Info: All or none Probabilistic Probability of choosing Item 1 in pair j, given model k

Contact Info: All or none Probabilistic Probability of actual choice in pair j given model k

Contact Info: Sd.1

Contact Info: Sd.5

Contact Info: Sd 1

Contact Info: Log-Likelihood Bayesian Information Criterion (BIC) Model comparison

Contact Info: Model comparison: Results Models TypeMeasureRHgRHsgRhsurKHCKRND All or NoneMean LL MeanBIC # wins ProbabilisticMean LL MeanBIC Mean σ NA # wins

Contact Info: RH was the most popular strategy The use of RH was not adaptive The use of strategies is independent from the ecological validity of the strategy Discussion

Contact Info: People sometimes use available strategies, and sometimes guess RH is one of these strategies The use of strategies does not seem to be related to their usefulness Conclusion

Contact Info: Can we improve decision making by using simple heuristics? –Yes, but a degree of knowledge is required to successfully decide when it is appropriate to use the simple heuristic Conclusion

Contact Info: Thank you!