1. Reinforcers and Punishers versus Incentives Reinforcers and punishers refer to good and bad behavior consequences

2. Selecting versus Motivating Behavior Reinforcers: behavioral consequences that select behavior, i.e., increase the frequency of behavior Punishers: behavioral consequences that deselect behavior, i.e., decrease the frequency of behavior

3. Selecting versus Motivating Behavior, continued Incentives: Anticipated external stimuli that motivate behavior to occur Positive incentives motivate approach behavior, i.e., behavior to attain the incentive Negative incentives motivate avoidance behavior, i.e., behavior to prevent the incentive from occurring

4. Past versus Future Reinforcers and punishers are actual consequences of behavior Positive and negative incentives are anticipated consequences

5. Objective and Subjective Incentive Value Incentive value: attractiveness of an incentive based on objective properties, e.g., number or amount Utility: subjective value of an incentive, based on it providing satisfaction, pleasure, and usefulness

6. Relationship between Objective and Subjective Value Fechner’s Law: relationship between objective and subjective incentive value (utility) such that equal increases in objective value, produce smaller and smaller increases in subjective value (utility)

7. Figure 10.1. Dollars and Utility. The relationship between the number of dollars and their utility is such that as the dollar amount increases, utility increases, but in smaller and smaller amounts. The graph is only an approximation of the true dollar-utility relationship.

8. Incentives as Losses and Gains Anticipated gains equal positive incentives Anticipated losses equal negative incentives

9. Losses Loom Larger Than Gains Losses loom larger than gains: the loss of something is more dissatisfying than the gain of it Losing $10 is more dissatisfying than gaining $10 is satisfying

10. Figure 10.3. Loss/Gain and Seller/Buyer Behavior. Typical median willingness-to-accept (sell) prices were greater than median willingness-to-pay (buy) prices for mugs, pens, and binoculars. When seller and buyer agreed on a price, money and goods exchanged hands. Source: “Experimental Tests of the Endowment Effect and the Coase Theorem” by D. Kahneman et al., 1990, Journal of Political Economy, 98, table 2, p. 1332, and table 3, p. 1334.

11. Factors that Affect Incentive Value There are a number of variables that affect the subjective value or utility of an incentive More valuable incentives are described by more, bigger, and better and less valuable incentives by less, smaller, and worse

12. Amount Incentive amount: quantity or number of incentives increases their value A grade of A is valued more than a grade of B $20 is more valued than $10 As incentive value increases, motivation increases

13. Rate of Reinforcement As the rate of reinforcement increases, rate of responding increases Given a choice, an animal or person selects the activity that produces a higher rate of reinforcement

14. Rate of Reinforcement, continued Melioration: the shift toward an activity that is more lucrative or provides a greater rate of reinforcement

15. Contrast of Incentive Amount Contrast effect: change in motivation that depends on how the current incentive differs from prior incentives Positive incentive contrast: an upward shift in incentive value, motivated behavior increases Negative contrast: a downward shift in incentive value, motivated behavior decreases

16. Temporal Motivation Theory How far an incentive is situated in the future determines the value or utility of that incentive

17. Incentive Utility from Amount and Delay, continued (Expected incentive value) (1 + Delay Interval) Incentive-delay interval is time when the incentive becomes available Utility =

18. Delay Discounting Delay discounting: process by which a future incentive is represented in the present at a marked down value, e.g., $10 delayed by one month is discounted to be worth $1 right now Person decides between incentives based on their discounted values

19. Preference Reversal Preference reversal: a change in preference from one incentive to another as a result of a change in their discounted values based on changes in the incentive-delay intervals

20. Preference Reversal, continued Decide between each of the eight choices 1.$25 now versus $50 now 2.$25 now versus $50 in 2 weeks 3.$25 now versus $50 in 4 weeks 4.$25 now versus $50 in 6 weeks 5.$25 now versus $50 in 8 weeks 6.$25 now versus $50 in 12 weeks 7.$25 now versus $50 in 20 weeks 8.$25 now versus $50 in 52 weeks (one year)

21. Figure 10.5. Changes in Incentive Value or Utility over Time. During time x, the larger incentive has greater utility than the smaller incentive. As the delay interval decreases, the smaller incentive attains a higher utility during time y. Preference reversal occurs at the division of time x and time y.

22. Procrastination Procrastination refers to delay in goal-directed behavior despite knowing that one will be worse off as a result For example, delay work on a paper knowing that a lower grade will be the result

23. Figure 10.7. Changes in Utility of Socializing versus Essay Writing. A student’s utility estimation of socializing versus writing an essay changes over the semester. The utility of socializing remains constant, since that is always available. The utility of writing an essay increases as its due date approaches (delay interval decreases). Source: “The Nature of Procrastination: A Meta-Analytic and Theoretical Review of Quintessential Self-Regulatory Failure” by P. Steel, 2007, Psychological Bulleting, 133, figure 2, p. 72. Copyright 2007 by APA. Reprinted by permission.

24. Intrinsic Motivation Motivated behavior that occurs when there is no obvious external consequence as a result of the behavior

25. Differences Between Extrinsic and Intrinsic Motivation Extrinsic motivation: behavior is coerced by external sources, e.g., grades, money, or approval of others Intrinsic motivation: behavior is not coerced by external sources, motivation is inherent in the activity

26. Differences Between Extrinsic and Intrinsic Motivation, continued Functional autonomy: outcome of a process that involved the transition from extrinsically motivated behavior to intrinsically motivated behavior For example, you started running for exercise but now run for the pleasure of it

27. Purpose of Intrinsically Motivated Behavior Intrinsically motivated behavior may occur for several reasons or be based on different sources: curiosity, effectance, and flow

28. Extrinsic Reward and Intrinsic Motivation An extrinsic incentive can decrease the intrinsic value or interest in an activity Cognitive evaluation theory: person evaluates reason for his/her behavior If behavior is attributed to external incentive, then when incentive is removed, intrinsic interest declines

29. Extrinsic Reward, Intrinsic Motivation, and Performance Although extrinsic incentives can decrease intrinsic interests, incentives can also increase performance Professional athletes play games because they enjoy doing so but also because they are paid well Students attend class because they enjoy the course and because of expecting a good grade

30. Extrinsic and Intrinsic Motivational Orientations Motivational orientation: when a person is consistently directed toward an extrinsic or intrinsic source of motivation A person can be motivated by both intrinsic and extrinsic sources of motivation