Presentation is loading. Please wait.

Presentation is loading. Please wait.

Beyond Monte Carlo An Algorithmic Replacement for a Misunderstood Practice Shawn Brayman President, PlanPlus Inc.

Similar presentations


Presentation on theme: "Beyond Monte Carlo An Algorithmic Replacement for a Misunderstood Practice Shawn Brayman President, PlanPlus Inc."— Presentation transcript:

1 Beyond Monte Carlo An Algorithmic Replacement for a Misunderstood Practice Shawn Brayman President, PlanPlus Inc.

2 Beyond Monte Carlo Shawn Brayman President PlanPlus Inc. PlanPlus Founder 20+ years experience in financial services IT sector B.Sc. (Applied & Computational Math), MES (Expert Systems) York University Canadian Institute of Financial Planning (1994) prescribed course of study Software, training, speaking on financial planning in 9 countries

3 Beyond Monte Carlo Our industry is filled with conflicting information. Our industry is filled with conflicting information. For both advisors and clients it is almost impossible to sort out “truth” from “fiction”.

4 Beyond Monte Carlo Executive Summary SECTION ONE – MCS Myths MCS challenges on assumptions MCS challenges on assumptions MCS tests higher & lower returns MCS tests higher & lower returns MCS tests bad years, client goals (sequence risk) MCS tests bad years, client goals (sequence risk) Randomizing life expectancy tests longevity risk Randomizing life expectancy tests longevity risk

5 Beyond Monte Carlo Executive Summary SECTION TWO – Reliability Forecast Precision challenges with MCS Precision challenges with MCS Creating an algorithmic solution Creating an algorithmic solution Validating the algorithmic solution Validating the algorithmic solution Improved sensitivity analysis for a financial plan Improved sensitivity analysis for a financial plan

6 Beyond Monte Carlo Disclaimer! 1. MCS is simply a statistical procedure and as such cannot “be wrong”. It is how it is applied and interpreted that there may be issues. 2. My research specifically looked at MCS for long- term financial planning. I am sure many academics and researchers have valid applications of MCS in specific instances.

7 Beyond Monte Carlo A Last Aside FPA Seattle had 7 of 30 sessions that deal directly with Monte Carlo or aspects of it (just over 23%) FPA Seattle had 7 of 30 sessions that deal directly with Monte Carlo or aspects of it (just over 23%) 3 are supportive/use it, 3 question it and 1 is “yes, but buyer beware” 3 are supportive/use it, 3 question it and 1 is “yes, but buyer beware” I went back and to FPA conference programs from Nashville, San Diego and Denver I went back and to FPA conference programs from Nashville, San Diego and Denver Did a randomization with 100,000 simulations and determined in 4 years the entire FPA conference will be about MCS with no “winner” Did a randomization with 100,000 simulations and determined in 4 years the entire FPA conference will be about MCS with no “winner”

8 Beyond Monte Carlo A Last Aside FPA Seattle had 7 of 30 sessions that deal directly with Monte Carlo or aspects of it (just over 23%) FPA Seattle had 7 of 30 sessions that deal directly with Monte Carlo or aspects of it (just over 23%) 3 are supportive/use it, 3 question it and 1 is “yes, but buyer beware” 3 are supportive/use it, 3 question it and 1 is “yes, but buyer beware” I went back and to FPA conference programs from Nashville, San Diego and Denver I went back and to FPA conference programs from Nashville, San Diego and Denver Did a randomization with 100,000 simulations and determined in 4 years the entire FPA conference will be about MCS with no “winner” Did a randomization with 100,000 simulations and determined in 4 years the entire FPA conference will be about MCS with no “winner”

9 Beyond Monte Carlo A Last Aside

10 Beyond Monte Carlo Financial Planning is a Balancing Act

11 Beyond Monte Carlo Financial Planning is a Balancing Act Sequence Risk Return Risk

12 Beyond Monte Carlo Financial Planning is a Balancing Act Longevity Risk Sequence Risk Return Risk

13 Beyond Monte Carlo Financial Planning is a Balancing Act Longevity Risk Sequence Risk Return Risk

14 Beyond Monte Carlo Inflation & Return Assumptions

15 Beyond Monte Carlo Case 1: Tom and Mary Both age 60 Both age 60 Assume mortality at age 85; Assume mortality at age 85; Indexed pensions of $5,675 at age 60, $4,653 at 65 Indexed pensions of $5,675 at age 60, $4,653 at 65 Both have $400,000 in retirement savings Both have $400,000 in retirement savings They have $5,000 in a joint savings They have $5,000 in a joint savings Goal $60,000 after-tax during their lifetime; Goal $60,000 after-tax during their lifetime; Assume a 15% average tax rate Assume a 15% average tax rate

16 Beyond Monte Carlo Case 1: Tom and Mary Portfolio is Cash 15% Cash 15% Fixed income 40% Fixed income 40% Canadian equity 25% Canadian equity 25% US equity 20% US equity 20%

17 Beyond Monte Carlo What Have the Returns Looked Like?

18 Beyond Monte Carlo Case 1: Tom and Mary Based on data from 1950 to 2005 (56 years) Inflation averaged 3.94% (geometric mean) Inflation averaged 3.94% (geometric mean) Return on this mix averaged 8.96% (geometric mean) Return on this mix averaged 8.96% (geometric mean) Real Return is Real Return is (Nominal-Inflation)/(1+inflation) = 4.83%

19 Beyond Monte Carlo Case 1: Tom and Mary Results Tom and Mary’s plan is perfect and they run out of money at the end of age 85, leaving an estate of $0 to their cat. Tom and Mary’s plan is perfect and they run out of money at the end of age 85, leaving an estate of $0 to their cat.

20 Beyond Monte Carlo Monte Carlo

21 Beyond Monte Carlo What is Monte Carlo? A statistical procedure where we pass an expected return and standard deviation and get random series of returns that “average” to our assumptions. A statistical procedure where we pass an expected return and standard deviation and get random series of returns that “average” to our assumptions. If we passed a standard deviation of 0%, it would be identical to an algorithmic solution. If we passed a standard deviation of 0%, it would be identical to an algorithmic solution.

22 Beyond Monte Carlo Monte Carlo and Returns – 3 Benefits It tests different returns – higher and lower? It tests different returns – higher and lower? It tests for bad years up front or the impact of the order of returns? (Sequence risk) It tests for bad years up front or the impact of the order of returns? (Sequence risk) Gives an overall chance of success? Gives an overall chance of success?

23 Beyond Monte Carlo Run a Monte Carlo Enter 8.96% with standard deviation of 8.07% Enter 8.96% with standard deviation of 8.07% Results indicate 65% failure – timing? Results indicate 65% failure – timing?

24 Beyond Monte Carlo Run a Monte Carlo Enter 8.96% with standard deviation of 8.07% Enter 8.96% with standard deviation of 8.07% Results indicate 65% failure – timing? Results indicate 65% failure – timing? NO You just entered a different return than your plan (8.55%)You just entered a different return than your plan (8.55%)

25 Beyond Monte Carlo Geometric vs. Arithmetic Mean Planning uses geometric means Planning uses geometric means Monte Carlo uses arithmetic mean Monte Carlo uses arithmetic mean G approx R – V/(2(1+R)) G approx R – V/(2(1+R)) Many advisors attribute increased failures to timing when really different assumptions! Many advisors attribute increased failures to timing when really different assumptions!

26 Beyond Monte Carlo Test Higher and Lower Returns? For Tom and Mary, 8.96% return was “perfect”. For Tom and Mary, 8.96% return was “perfect”. The geometric mean is by definition the point of 50/50 probability. The geometric mean is by definition the point of 50/50 probability.

27 Beyond Monte Carlo Test Higher and Lower Returns? Enter proper 9.26% rate, 50.5% failures Enter proper 9.26% rate, 50.5% failures

28 Beyond Monte Carlo Test Higher and Lower Returns? What if we increase arithmetic return and standard deviation with maintain the same 8.96% geometric mean? What if we increase arithmetic return and standard deviation with maintain the same 8.96% geometric mean? ?

29 Beyond Monte Carlo Test Higher and Lower Returns? What if we increase arithmetic return and standard deviation with maintain the same 8.96% geometric mean? What if we increase arithmetic return and standard deviation with maintain the same 8.96% geometric mean? !

30 Beyond Monte Carlo Test Higher and Lower Returns? Conclusions: MCS results are strictly a function of the geometric mean and not sensitive to the level of risk. MCS results are strictly a function of the geometric mean and not sensitive to the level of risk. If MCS reports a single “probability of success”, it will average out results so no “test” of the range of returns is occurring. If MCS reports a single “probability of success”, it will average out results so no “test” of the range of returns is occurring. Recommendation: The success/failure result must be subtotaled to allow reporting based on higher or lower returns. The success/failure result must be subtotaled to allow reporting based on higher or lower returns.

31 Beyond Monte Carlo Does MCS Test Sequence Risk? 1. Even withdrawal of $52,159 indexed; 2. $57,423 for the first 5 years (10% increase) then reduce the withdrawal to $49,932 for the duration of the plan. 3. $65,000 for the first 5 years (25% more); 4. $78,000 for the first 5 years (50% more); 5. $104,300 for the first 5 years (100% more); 6. Withdraw an additional lump sum of $100,000 in the 12 th year of the plan; 7. Withdraw an additional lump sum of $100,000 in the 20 th year of the plan. All scenarios have the same PV for the withdrawals.

32 Beyond Monte Carlo Test Sequence Risk?

33 Beyond Monte Carlo Test Sequence Risk? So all withdrawal strategies with same PV of withdrawals resulted in the same 52% failure rate. So all withdrawal strategies with same PV of withdrawals resulted in the same 52% failure rate. Repeated the same 7 withdrawal strategies using 11% return +/- 20.63% (8.96% geometric mean). From 51.8% to 52.1% failures. No change. Repeated the same 7 withdrawal strategies using 11% return +/- 20.63% (8.96% geometric mean). From 51.8% to 52.1% failures. No change. Why?? Why??

34 Beyond Monte Carlo Test Poor Initial Returns? Same PV of withdrawal and geometric mean results in same failures Same PV of withdrawal and geometric mean results in same failures

35 Beyond Monte Carlo Test Poor Initial Returns? Same PV of withdrawal and geometric mean results in same failures Same PV of withdrawal and geometric mean results in same failures

36 Beyond Monte Carlo Test Poor Initial Returns? Conclusion: If the PV of the withdrawals is constant, no difference in success/failure. Conclusion: If the PV of the withdrawals is constant, no difference in success/failure. Yes MCS can creates initial poor returns but no more so than great returns. If reports a single “probability of success”, it will average out results so no “test” regardless. Yes MCS can creates initial poor returns but no more so than great returns. If reports a single “probability of success”, it will average out results so no “test” regardless. Observation: Unless strategies exist to deal with initial poor returns without compromising initial great returns – so what? Observation: Unless strategies exist to deal with initial poor returns without compromising initial great returns – so what?

37 Beyond Monte Carlo Sidebar on Inflation Given consistent indexation of revenues and goals, planning is totally driven by the real rate of return. Given consistent indexation of revenues and goals, planning is totally driven by the real rate of return. Changing inflation assumptions and return assumptions only matter to the extent they change the real rate of return. Changing inflation assumptions and return assumptions only matter to the extent they change the real rate of return. 10,000 simulations of inflation at 3.99% +/- 3.3% resulted in 49.1 success, assuming savings & withdrawals use the random variable for the indexation rate and constant real return. 10,000 simulations of inflation at 3.99% +/- 3.3% resulted in 49.1 success, assuming savings & withdrawals use the random variable for the indexation rate and constant real return.

38 Beyond Monte Carlo Mortality Assumptions/Longevity Risk

39 Beyond Monte Carlo Mortality Assumptions What mortality assumption would you use in financial plans? Mortality tables (77 for Tom) Age 85Age 85 Age 90Age 90 Age 99Age 99

40 Beyond Monte Carlo Mortality Tom and Mary are 60 Tom and Mary are 60 Tom’s life expectancy is age 77 Tom’s life expectancy is age 77 Mary’s life expectancy is age 85 Mary’s life expectancy is age 85

41 Beyond Monte Carlo What is the Impact of Mortality? MortalityCapital Required 85$0 90$69,000 95$122,500 99$158,200

42 Beyond Monte Carlo How do we Randomize? 1. Select a random number between 1 and the number of lives (i.e. 87,813) 2. Map to the tables to determine mortality

43 Beyond Monte Carlo Results of Randomized Mortality When we randomize mortality, ½ will be less than expected mortality and ½ will be more. When we randomize mortality, ½ will be less than expected mortality and ½ will be more. If we average the results, we have generated a plan based on the average life expectancy. If we average the results, we have generated a plan based on the average life expectancy. If we sum Success/Failure, any scenario with mortality 85 or less succeeds, 86 or more fails If we sum Success/Failure, any scenario with mortality 85 or less succeeds, 86 or more fails Our results are 31% failure, 69% success – the same as the initial mortality assumption Our results are 31% failure, 69% success – the same as the initial mortality assumption

44 Beyond Monte Carlo Another Planning Risk In respect to life expectancy, aside from longevity risk, need to consider RAK-IT Risk In respect to life expectancy, aside from longevity risk, need to consider RAK-IT Risk Retire And Kick IT (IT = The Bucket!) Retire And Kick IT (IT = The Bucket!) When we obsess on Longevity Risk we may be planning for our compliance department, not the client When we obsess on Longevity Risk we may be planning for our compliance department, not the client I would say “Forget longevity risk if it means delaying my retirement and getting to my boat!” I would say “Forget longevity risk if it means delaying my retirement and getting to my boat!”

45 Beyond Monte Carlo Another Planning Risk

46 Beyond Monte Carlo Longevity Risk Conclusion:By randomizing mortality to represent longevity, advisors are, on average, basing their planning on a lower mortality assumption than would be used in traditional plans. Conclusion:By randomizing mortality to represent longevity, advisors are, on average, basing their planning on a lower mortality assumption than would be used in traditional plans. The success/failure is identical to initial mortality assumptions The success/failure is identical to initial mortality assumptions Observation: Results can be subtotaled based on the age parameter, which would allow reporting based on mortality bands. Observation: Results can be subtotaled based on the age parameter, which would allow reporting based on mortality bands.

47 Beyond Monte Carlo Section One Summary Use of arithmetic means is subject to error and misinterpretation Use of arithmetic means is subject to error and misinterpretation The practice of reporting a single result washes out all concept of testing extremes and results in a plan based on the mean. The practice of reporting a single result washes out all concept of testing extremes and results in a plan based on the mean. People talk as if randomization tested only a portion of the distribution – poor returns initially, living longer than planned, but it is a statistical process that equally looks at great initial returns or dieing sooner. People talk as if randomization tested only a portion of the distribution – poor returns initially, living longer than planned, but it is a statistical process that equally looks at great initial returns or dieing sooner. MCS returns the same results as the geometric mean when consistent assumptions are maintained. MCS returns the same results as the geometric mean when consistent assumptions are maintained.

48 Beyond Monte Carlo Section 2: Reliability Forecasts Pre-Decease Age 85 (69%) Outlive Age 85 (31%) Returns Above 8.96 (50%) A 34 ½ % chance the client will die before age 85 and have higher than projected returns (Surplus – Success) A 15 ½ % chance the client will outlive age 85 with higher than projected returns (Unclear outcome) Returns Below 8.96 (50%) A 34 ½ % chance the client will die before age 85 but have lower than projected returns (Unclear outcome) A 15 ½ % chance the client will outlive age 85 with lower than projected returns (Capital shortfall – Failure) MCS provides an interesting “partial probabilities” removing ambiguity around the “unclear outcomes”

49 Beyond Monte Carlo MCS for Returns & Mortality 1. 10,000 simulations 2. 9.26% return +/- 8.07% or 8.96% geometric 3. Randomized mortality 4. 72.9% successful and 27.1 failed sims Is this good? Dying at age 61 is success because $ remainDying at age 61 is success because $ remain Living to 105 with funds exhausted at 103 is a failureLiving to 105 with funds exhausted at 103 is a failure

50 Beyond Monte Carlo A Challenge with Precision… Planning Tool Simulated Returns/Age

51 Beyond Monte Carlo A Challenge with Precision… Planning Tool Simulated Returns/Age Win/Loose Count

52 Beyond Monte Carlo A Challenge with Precision… Planning Tool Simulated Returns/Age Win/Loose Count

53 Beyond Monte Carlo A Challenge with Precision… Planning Tool Simulated Returns/Age Win/Loose Count The more comprehensive the planning algorithm, the longer per trial

54 Beyond Monte Carlo A Challenge with Precision… Planning Tool Simulated Returns/Age Win/Loose Count The more comprehensive the planning algorithm, the longer per trial “While running the requisite 100,000 scenarios that would provide a minimal margin of error is computationally not feasible within most real-time engines, running as little as a few hundred scenarios can be woefully inadequate.”

55 Beyond Monte Carlo 100 Sims Distribution

56 Beyond Monte Carlo Goals for an Algorithmic Solution 1. To generate partial probabilities like MCS 2. To remove issues of speed and therefore precision 3. To generate more usable results than a single likelihood of success 4. To make the model easier to maintain

57 Beyond Monte Carlo 2 Critical Observations Planning Tool Simulated Returns/Age The randomized variables are independent of the plan! (This does not mean the plan is independent of these variables.)The randomized variables are independent of the plan! (This does not mean the plan is independent of these variables.) MCS returns the same cumulative result as the geometric mean assumption, so…MCS returns the same cumulative result as the geometric mean assumption, so…

58 Beyond Monte Carlo So…

59 So… X=

60 Likelihood of Age x ROI 0.1% to 0.15% chance of dieing at 93 with a 10.46% to 10.96% return 0.35% to 0.4% chance of dieing at 87 with a 8.46% to 8.96% return

61 Beyond Monte Carlo Return8.468.969.469.9610.4610.96 Age Funds Depleted 8485899399100+ Return4.965.465.966.466.967.467.96 Age Funds Depleted 76.5777879808182.5 At each return, when are $ exhausted? Remember age 85 and 8.96% return? So we run our planning model (in this case 13 times) to calculate the boundary for success and failure

62 Beyond Monte Carlo Our Reliability Forecast Success Failure

63 Beyond Monte Carlo Reliability Forecast Results 1. Subtotal of cells in the “Success” region is 74.5% 2. This compares to 72.9% +/- 1.57% with MCS and 10,000 simulations

64 Beyond Monte Carlo Reliability Forecast Results (2) 1. Tested with withdrawal of $78,000 for 5 years and reduced $ thereafter. No change in RF solution (74.5%), 73.7% success with MCS. 2. Tested with $100,000 withdrawal in 12 th year of plan. Same for RF (74.5%), 73.5% success for MCS.

65 Beyond Monte Carlo Reliability Forecast Results (3) 1. Tested accelerated withdrawal of $58,633 and funds gone at age 80. 2. RF with new boundary gave 59.5% success. MCS resulted in 60.3% success.

66 Beyond Monte Carlo Reliability Forecast Results (4) 1. Tested withdrawal of $65,000, 10% return and 11% standard deviation (9.5% geometric mean). 2. RF with new boundary gave 51.6% success. MCS resulted in 51.2% success with 10,000 sims. The Reliability Forecast provides the same partial probabilities as MCS with a dozen iterations of the planning model.

67 Beyond Monte Carlo Subtotaling Results What if the client lives to age 90?

68 Beyond Monte Carlo Subtotaling Results What if the client averages at least 6.96% return?

69 Beyond Monte Carlo Improved Distribution Matrix

70 Beyond Monte Carlo Sensitivity Analysis

71 Beyond Monte Carlo Sensitivity Analysis

72 Beyond Monte Carlo Sensitivity Analysis

73 Beyond Monte Carlo Sensitivity Analysis Bad!

74 Beyond Monte Carlo Sensitivity Analysis Annual Reviews

75 Beyond Monte Carlo Summary of Findings IssueMonte CarloReliability Forecast Return assumptionsBased on arithmetic mean. Estimation technique can convert. Advisors do not understand Based on geometric mean, same as financial plan Test higher and lower returnsNot as utilized. Requires additional computation and subtotaling of results in return bands. Misunderstood. Easily subtotaled. Test impact of withdrawals and order of returns (sequence risk) Misunderstanding. Does not occur.Not calculated. Test longevity using randomized mortality Not as utilized. Could add additional layer of subtotaling. Easily subtotaled. PrecisionPoor due to computational load. Require 100,000 simulations. High. 12 calculations are necessary to generate the boundary line. Ability to generate overall probabilities of success Yes Ability to provide improved granularity on sensitivity analysis Requires additional computation and subtotaling logic. Yes, easily subtotaled. Ability to maintain the planning toolComplex.May restrict certain capabilities. Simpler. The algorithmic solution is easier to maintain and audit.

76 Beyond Monte Carlo Conclusion The Reliability Forecast approach outlined provides all the analytical results available using MCS in a fraction of the calculations, using more common assumptions, leading to higher precision.

77 Beyond Monte Carlo Questions ?


Download ppt "Beyond Monte Carlo An Algorithmic Replacement for a Misunderstood Practice Shawn Brayman President, PlanPlus Inc."

Similar presentations


Ads by Google