1. Markov Chains Applications

2. Brand Switching  100 customers currently using brand A 84 will stay with A, 9 will switch to B, 7 will switch to C  100 customers currently using brand B 78 will stay with B, 14 will switch to A, 8 will switch to C  100 customers currently using brand C 90 will stay with c, 4 will switch to A, 6 will switch to B

3. Brand Switching  States Brands of product  Time Period Interval between purchases  Transition Probabilities

4. Brand Switching  States Brands of product  Time Period Interval between purchases  Transition Probabilities ABC P  F H G G I K J J 084009007 014078008 004006090.........

5. Brand Switching If the current market share is given by: a.What is the market share after one time period ? b.What is long term market share ? P () (...) 0 039032029 

6. Brand Switching Market share in 1 time period P () (...)......... (...) 1 039032029 084009007 014078008 004006090 038403020314  F H G G I K J J 

7. Brand Switching Long term market share

8. Brand Switching Long term market share P n () (...)......... (.  F H G G I K J J  039032029 032502450425 032502450425 032502450425 0325 0.245 0.425 )

9. Brand Switching PPP P nn ABC ABC ABC ()()() ()   F H G G I K J J 0 0    P A n AAA A A ().().().() (...)    039032029 039032029   

10. Brand Switching  Assumptions  Markovian Property Brand switching might take into consideration more than just the past brand; e.g. customer dissatisfaction with brand A led to B, marketing lead in led to C  Stationarity Property Marketing strategies may change transition probabilities over time

11. Stock Market Analysis  States Price of Stock: $0, 5, 10, 15, 20  Time increment Opening price on successive trading days  Transition Probabilities Prob going up 5 = a i = ¼ Prob going down 5 = b i = ¼ Prob staying same = c i = ½

12. Stock Market Analysis  Transition Probabilities FI 11 111 111 111 P  H G G G G G G G G G G G K J J J J J J J J J J J 10000 424 00 0 424 0 00 424 000 22

13. Stock Market Analysis  Assumptions  Markovian Property  Stationarity Property

14. Equipment Replacement  States State 1: New Filter State 2: One year old, no repairs State 3: Two years old, no repairs State 4: Repaired once  Time Period One year  Transition Probabilities Repaired filter will be replaced after one year Filters scrapped after 3 years use

15. Equipment Replacement  Transition Probabilities 1 32 1 4 4 4 1 1 1

16. Equipment Replacement  Transition Probabilities 1 32 1 4 4 4 1 1 1 P  F H G G G G I K J J J J 00070003 00000406 05000005 10000000................

17. Equipment Replacement  Steady State Probabilities P  F H G G G G I K J J J J 00070003 00000406 05000005 10000000................     134 21 32 4123 5 7 4 365    ......

18. Equipment Replacement  Steady State Probabilities P  F H G G G G I K J J J J 00070003 00000406 05000005 10000000................     134 21 32 4123 5 7 4 365    ......     1 2 3 4 0352 0246 0098 0304    ....

19. Equipment Replacement

20.  Suppose that the following costs apply  New Filters$ 500  Repair Filter$ 150  Scrap filters ($ 50)(scrap salvage)  For a pool of 100 filters, on average, what is the expected cost of our repair policy ?

21. Equipment Replacement  Suppose that the following costs apply  New Filters$ 500  Repair Filter$ 150  Scrap filters ($ 50)(scrap salvage) ECostCj buyrepairsalvage j []() ()()()().().()(..)() $201.        1434 0352500030415009830450 50 / filter

22. Population Mobility  Forest consists of 4 major species  Aspen  Birch  Oak  Maple ABOM P  F H G G G G I K J J J J................ 05080384 00 8020 00083553 05001085 ABOMABOM

23. Population Mobility  States State 1: No movement State 2: Movement within region State 3: Movement out of a region State 4: Movements into a region  Time period  Transition Probabilities

24. Population Mobility  States: Movement at SDSM&T State 1: Student remains in major State 2: Student switches major State 3: Student leaves school (transfer out, matriculates) State 4: Student enters school (transfer in, first year studs.)  Time period Semester  Transition Probabilities

25. Population Mobility  States: Movement at SDSM&T State 1: Student in IE State 2: Student in other major State 3: Student leaves school (transfer out, matriculates) State 4: Student enters school (transfer in, first year studs.)  Time period Semester  Transition Probabilities P  F H G G G G I K J J J J 08500501000 03040300 00000901 0200700100................