Presentation is loading. Please wait.

Presentation is loading. Please wait.

TreeAge Pro 2-Day Healthcare Training Day 1 Using TreeAge Pro for Health Economic Modeling © 2013 TreeAge Software, Inc.

Similar presentations


Presentation on theme: "TreeAge Pro 2-Day Healthcare Training Day 1 Using TreeAge Pro for Health Economic Modeling © 2013 TreeAge Software, Inc."— Presentation transcript:

1 TreeAge Pro 2-Day Healthcare Training Day 1 Using TreeAge Pro for Health Economic Modeling © 2013 TreeAge Software, Inc.

2 2 2 Introduction 1.Build Cost-Effectiveness Model 2.Analyze a Cost-Effectiveness Model 1.Clones 3.Sensitivity Analysis 1.Exercise – Build Decision Tree 4.Variable Expressions and Arrays Day 2 will focus on Markov models TreeAge Pro Healthcare Training Agenda – Day 1

3 3 3 Modeling/analysis goals Create a model to represent a disease process and available treatment options Evaluate treatment options independently and choose the optimal path Measure effects of uncertainty on treatment strategy selection TreeAge Pro Healthcare Training – Introduction Introduction

4 4 4 Benefits of TreeAge Pro Visual modeling tool for easier model building and presentation Healthcare modeling analysis and reporting Sensitivity analysis Monte Carlo simulation Multiple measurements can be used to evaluate the same model Cost, effectiveness, cost-effectiveness, other TreeAge Pro Healthcare Training – Introduction Introduction

5 5 5 TreeAge Pro Healthcare Training – Introduction TreeAge Pro User Interface Tree Diagram Editor Projects View Model Input Views Perspectives

6 6 6 Tree Diagram Editor Primary modeling window for building model structure Multiple tabs for models and analysis output Zoom in/out, multi-select, noteboxes Views For editing/viewing components of the model (e.g., parameters) Open via Views toolbar list Move, maximize, minimize, detach Perspectives Collection of views’ orientation stored when you exit software Can reset to original orientation or overwrite saved orientation TreeAge Pro Healthcare Training – Introduction TreeAge Pro Interface

7 7 7 Model Input Views: Specific view(s) for each model input Some tied to tree (e.g., tree properties, variable properties) Some tied to node (e.g., node properties, variable definitions) Other Views: Projects View for managing files Model Overview/Tree Explorer for navigating in large trees Evaluator for testing calculations Context-sensitive help Many more TreeAge Pro Healthcare Training – Introduction TreeAge Pro Interface

8 8 8 Module 1: Build Cost-Effectiveness Model Goals: Build model structure Create and use variables Set tree preferences TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

9 9 9 Primary elements of a model Model structure Mimic everything that could happen Numeric values Add probabilities and values Tree Preferences Control how you want to evaluate/view the model TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

10 10 Recreates the complete path of a patient Includes all possible events and outcomes Consists of a collection of nodes, where each one represents one step within the overall model flow Starts with a single root node Usually a decision node Facilitates comparison of treatment strategies Each node can have multiple branches to the right, but only a single parent TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Model Structure

11 11 Decision Node: Branches are alternative strategies Run analyses here to compare strategies Chance Node: Branch for each possible outcome Probabilities are associated with each branch Mutually exclusive and exhaustive (∑ = 100%) Use “#” for complementary probability (once) Terminal Node: Complete the scenario (root to terminal node) Payoffs place a value on all events within that scenario TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Node Types

12 12 Logic Node: Like a chance node but with logical expressions (true/false) instead of probabilities Expressions checked from top down until one is true Label Node: Like a chance node with a single branch with probability 100% Markov Node: Start of Markov model Will discuss in later module TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Node Types

13 13 Decision NodeChance Nodes Terminal Nodes TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Model Structure Probabilities Payoffs Root node Strategies

14 14 Required for probabilities, payoffs, etc. Consist of any combination of… Numbers Model inputs: Variables, distributions, tables, trackers Built-in functions: If, Discount, Min, Max, etc. Operators: +, -, *, /, ^, &, | TreeAge Pro cannot determine numeric values for your projects Sources: medical literature, trials, NIH, AHRQ, CDC Some must be estimated TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Numeric Values

15 15 Control how a model is… Calculated Calculation method Active, enabled payoff sets Optimal path - min vs. max Etc. Displayed Show variables in tree Numeric formatting Fonts Etc. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Tree Preferences

16 16 Model we will build The current standard is to treat a specific type of tumor with radiation We want to study a new treatment that combines surgery and radiation We estimate that the new treatment will increase the probability of eradicating the tumor from 60% to 80% A person’s life expectancy is 10 years if the tumor is eradicated, but only 3 years if not The costs associated with radiation and surgery are $30K and $50K respectively The follow-up costs post-treatment are $2K per year TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

17 17 How do we create a model from the information we have? Look for the decision Two treatment options indicates root decision node with branch for each strategy Possible outcomes Either treatment could eradicate the tumor or not Chance node with branches for two results Life expectancy provided Becomes measurement of effectiveness Markov model is not necessary Numbers Become parameters for probabilities or values TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

18 18 Information: The current standard is to treat a specific type of tumor with radiation We want to study a new treatment that combines surgery and radiation Model: Root node is decision with a branches for each treatment option TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

19 19 Instructions: 1.Create new model from toolbar icon (blank tree). 2.Enter node label text for the root decision node. 3.Double-click on root node to add two branches. 4.Enter node label text for each strategy. 5.Adjust width of node as desired for text formatting. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

20 20 Information: We estimate that the new treatment will increase the probability of eradicating the tumor from 60% to 80% Model: Both strategies are chance nodes with branches for tumor eradicated or tumor not eradicated Different probabilities for each set of branches TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

21 21 Instructions: 1.Double-click on top strategy node to add two branches. 2.Enter node labels. 3.Ignore the bottom strategy for now; we will create it later. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

22 22 Information: A person’s life expectancy is 10 years if the tumor is eradicated, but only 3 years if not The costs associated with radiation and surgery are $30K and $50K respectively The follow-up costs post-treatment are $2K per year Model: Each of these numeric parameter values factors into the payoffs (scenario values) All parameters should be entered as variables TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

23 23 Why use variables? Clarity – Isolate your parameters and formulas Consistency – define once, use many times Efficiency – changing a single variable can affect multiple numeric expressions in the model Transparency – easier to understand the meaning of each value Sensitivity analysis – covered later Clones – covered later Always use variables! TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Variables

24 24 Variables are named values like in algebra Variable name: Each variable has a single name Reference the variable name anywhere in the model to calculate and return its value Calculated dynamically during analysis when referenced 32 letters/numbers/underscores (no punctuation) Stick to a naming style/convention Not case sensitive although you can enter case TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Variables

25 25 Variable definitions: Displayed beneath node within box Variable definitions evaluated when referenced Most variables will be defined once at the root node Reference anywhere in the model using the same definition Variables can be defined at any node Use different definitions for different parts of the model Useful for clones – covered later Variable reference looks for closest definition from that node to the left TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Variables MyVar2 = 20 at terminal node

26 26 Instructions: 1.Right-click on root node and choose Define Variable > New Variable from the context menu. 2.Enter variable name “cFollowupAnnual”. 3.Enter a description and comment if desired. 4.Click OK. 5.Enter definition “2K” in the Define Variable dialog and click OK. 6.You will see the variable definition beneath the root node. 7.Repeat steps 2-5 for the variables below. cRadiation = 30K cSurgery = 50K TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

27 27 Variable Properties View: Maintain variables in the tree Options to edit, add, delete, categorize, report variables Edit in Excel available with Excel Module (in TP Suite) Variable Definitions View: Maintain variable definitions Contents change with selected node Defined vs. Undefined vs. Inherited Cut/Copy/Paste to copy or move variable definitions to other nodes TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Variables

28 28 Instructions: 1.Select root node. 2.Select or open the Variable Properties View. 3.Click the “+” icon. 4.Enter the variable name “effEradicated”. 5.Check the box Define numerically at root. 6.Enter 10 in the definition field and click OK. 7.Repeat steps 3-6 for the variable below. effNotEradicated = 3 pEradicateRad = 0.6 pEradicateRadSurg = Enter pEradicateRad as the probability value for the Eradicates tumor within the Radiation strategy. 9.Enter # for complementary probability. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

29 29 At this point, our model should look like this… We still need to… Setup tree preferences Terminate the scenarios for the top strategy Build the bottom strategy TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

30 30 Information: A person’s life expectancy is 10 years if the tumor is eradicated, but only 3 years if not The costs associated with radiation and surgery are $30K and $50K respectively The follow-up costs post-treatment are $2K per year Model: Change tree’s calculation method to cost-effectiveness Terminate the two scenarios in the top strategies Add the appropriate values for cost and effectiveness TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

31 31 Control calculation and display of model Many categories (see filter) Menu: Tree > Tree Preferences to open dialog Calculation Method: Determines which payoff sets will be used to evaluate the model and determine the optimal strategy Usually either simple or cost-effectiveness Numeric Formatting: Controls display of outputs (calculated payoffs and EVs) Set for units, decimal places, labels, etc. Many more TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Tree Preferences

32 32 Simple Calculation Method: Enter a single payoff at each terminal node Single expected value (EV) calculated at all upstream nodes Optimal decision is maximum (eff) or minimum (cost) EV Cost-effectiveness Calculation Method: Enter separate payoff values for cost and effectiveness at each terminal node Cost and effectiveness EVs calculated separately at all upstream nodes To select optimal strategy, must balance cost and effectiveness, looking at efficiency & tradeoffs Will examine further when analyzing model TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Tree Preferences

33 33 Not limited to two payoffs Only two are active for CE calc method Can use extra payoffs for different cost, effectiveness, other outcomes Same model can then be used to analyze problem with different outcome measurements Change active payoffs for different measurements and repeat analyses Cost: Total cost vs. patient cost vs. insurer cost, etc. Health/Utility: LY, QALY, etc. Other: Positive tests, cases avoided, cases identified, etc. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Tree Preferences

34 34 Instructions: 1.Choose Tree > Tree Preferences from the menu. 2.Select the category Calculation > Calculation Method. 3.Select Cost-effectiveness (use default active payoffs). 4.Select the category Calculation > Numeric Formatting. 5.Enter settings as seen below. 6.Click OK to save the changes. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

35 35 Terminal nodes terminate the scenario Must account for all values (cost, eff) that contribute to that scenario Any node on path from the root node to that terminal node For cost-effectiveness model, enter separate values for cost and effectiveness For top terminal node… Costs:Treatment Cost: cRadiation Followup Cost: cFollowupAnnual * effEradicated Effectiveness:effEradicated For second terminal node… Same except using effNotEradicated TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

36 36 Instructions: 1.Right-click on top node. 2.Choose Change Type > Terminal. Edit Payoff dialog opens automatically. 3.Enter expression for Cost: Click ellipsis button to open formula editor for Cost payoff. Select variables to enter the following expression… cRadiation + (cFollowupAnnual*effEradicated) 4.Enter expression for Effectiveness Type the following expression… effEradicated 5.Click OK. 6.Repeat steps 2-5 for second terminal node (effNotEradicated). TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

37 37 The formula editor is available anywhere you see the ellipsis button Create expressions by providing lists of Model inputs(variables, trackers, tables, distributions) Built-in functions (Discount, Round, ProbToProb, etc.) Operators (+, -, &&, etc.) Keywords (_stage, _trial, _sample, etc.) Value created in “Expression” field is passed back to the model TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Formula Editor

38 38 Content-Assist Enter partial text in model Press CONTROL+SPACEBAR to show all numerical elements (variables, functions, etc.) that match the partial text Select an item from the list Placed in expression within model TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Content-Assist

39 39 The two strategies are very similar… Why build it twice? Copy the top strategy’s subtree and paste it onto the bottom strategy Make necessary changes to the values used in the new treatment strategy TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

40 40 Instructions: 1.Select top strategy node. 2.Choose Subtree > Select Subtree from the menu. 3.Choose Edit > Copy from the menu. 4.Select bottom strategy node. 5.Choose Edit > Paste from the menu. An exact duplicate of the top strategy’s subtree will be copied to the bottom strategy. TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

41 41 Instructions (bottom strategy): 1.Change the probability for “Tumor eradicated” node to pEradicateRadSurg. 2.Add cSurgery to the cost payoff values at each terminal node. The model is now complete! Training model: Example02-Variables.trex TreeAge Pro Healthcare Training – Module 1 – Build Cost-Effectiveness Model Build Cost-Effectiveness Model

42 42 Module 2: Analyze Cost-Effectiveness Model Goals: Understand how each strategy’s expected value is calculated Compare strategies on basis of cost-effectiveness (which is best?) Consider dominance among strategies (which are rejected) Introduce net benefits calculations for CE analysis Introduce clones TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

43 43 Want to choose the optimal treatment strategy Must first calculate expected values (EVs) for each strategy Compare the strategies’ cost and effectiveness EVs using standard cost-effectiveness analysis techniques TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

44 44 Best estimate for the overall value of the strategy Reflects all possible outcomes based on each one’s likelihood Sum of each outcome’s value weighted by its probability Example: 20% chance of dying immediately 30% chance of living 10 years 50% chance of living 20 years EV = (0.2 * 0) + (0.3 * 10) + (0.5 * 20) = 13 For CE model, cost and effectiveness EVs are calculated separately TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Expected Value (EV)

45 45 TreeAge Pro calculates EVs at terminal nodes then calculates remaining EVs from right to left Terminal nodes EV: Calculate the payoff expressions Top terminal node… Cost: cRadiation + (cFollowupAnnual*effEradicated) = 30K + (2K * 10) = 50K Effectiveness: effEradicated = 10 TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

46 46 Path probability: Probability of reaching that node within the scenario Product of probabilities of every chance node branch in path from strategy to terminal node P = TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

47 47 Chance nodes: Weighted averages of the EVs of the node’s branches Top strategy/chance node… Cost: (0.6*50K) + (0.4*36K) = 30K K = 44.4K Eff: (0.6*10) + (0.4*3) = = 7.2 TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

48 48 Decision nodes: Compare EVs for all strategies and choose optimal path Simple calculation method: Minimum or maximum based on tree preferences Cost-effectiveness calculation method: Need to “balance” cost and effectiveness Rollback uses net benefits with willingness-to-pay (WTP) parameter from tree preferences Cost-effectiveness analysis TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

49 49 Cost-Effectiveness Analysis (CEA) Standard health economic theory Two goals: Optimize effectiveness (maximize usually) Optimize cost (minimize) CEA context: Efficient use of limited resources Recommend interventions if additional effectiveness comes at a reasonable cost TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

50 50 CEA: Calculate Incremental Cost-Effectiveness Ratio (ICER) How much are we paying for each additional unit of effectiveness? Compare to a willingness-to-pay (WTP) threshold Is the ICER too high? Budget constraints: Sometimes compare to ceiling cost value Overall cost of treatment may be too high TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

51 51 ICER Calculation: ICER = IC/IE = (C comparator – C baseline )/(E comparator – E baseline ) In our model… ICER= ($97.2K – $44.4K)/(8.6LY – 7.2LY) = ($52.8K)/(1.4LY) = ~ $37.7K/LY To switch from the standard treatment to the new treatment, it costs ~ $37.7 for each extra LY If we are willing to pay at least that much per extra LY, we can recommend the new treatment TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

52 52 Instructions: 1.Select root node. 2.Choose Analysis > Cost-Effectiveness Analysis from the menu. 3.Click Yes. A Cost-Effectiveness Analysis graph will be created. 4.Click the Text Report link. The cost-effectiveness calculations are displayed. TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

53 53 Cost-Effectiveness Analysis graph: Plots strategies on cost and effectiveness axes Line segments form the cost-effectiveness frontier Slope = ICER If ICER <= WTP, move to next strategy Want to be here Any strategies here would be dominated (rejected) TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

54 54 Edit Chart link – modify the appearance of any graph Text Report link – see the numeric data behind the graph File > Save allows you to save analysis output File type RPTX - graph and underlying data File types JPEG, PNG, etc. - image of the graph For publishing TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Graphs

55 55 Cost-Effectiveness Rankings report: Shows ICER calculations ICIEICER TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

56 56 Dominance: A strategy is dominated when other strategies provide better cost-effectiveness Dominated strategies are then rejected as treatment options Absolute Dominance: Less effective (IE < 0) More costly (IC > 0) Extended Dominance: More effective (IE > 0) More costly (IC > 0) Less efficient (ICER > ICER for other strategy) TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

57 57 Example 4 model demonstrates both types of dominance Same as the tree we built but with three new strategies to evaluate Top two strategies collapsed via… Subtree > Collapse Subtree TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

58 58 CEA with dominance Dominated strategies are above and to the left of the cost-effectiveness frontier TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

59 59 Other Tx 2 rejected by absolute dominance Less effective and more costly than Standard Treatment Other Tx 3 rejected by extended dominance Lower ICER, more efficient to move from Standard treatment to New Treatment Higher ICER, less efficient to move from Standard treatment to Other Tx 3 Blended combination of New Treatment and Standard Treatment would get more effectiveness at same cost TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

60 60 CE Rankings also shows dominance Absolute dominance – negative IE and ICER Extended dominance – ICER declines TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

61 61 Which strategy is preferred? First reject dominated strategies Then compare the ICERs to the WTP value If WTP < $37.7K, recommend Standard treatment If $37.7K < WTP < $132K, recommend New treatment If WTP > $132K, recommend Other Tx 1 TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

62 62 Net Benefits combines cost, effectiveness and WTP into a single measurement Builds the ICER threshold (WTP) into calculations, as the weight on effectiveness Strategy with largest NB is most cost-effective Calculations: NMB= (E * WTP) – C = (LY * $/LY) – $ = $ NHB= E – (C / WTP) = LY – ($ / ($/LY)) = LY Allows roll back to identify most cost-effective strategy Simplifies presentation of more complex analyses looking for most cost-effective strategy i.e., Sensitivity analysis TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Net Benefits

63 63 Note that we can identify the preferred strategy from roll back using CE parameters in Tree Preferences Optimal strategy identified by Net benefits calculations using WTP parameter Change to Invert incremental only if effectiveness should be minimized (e.g., # of infections or # of deaths) TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

64 64 TreeAge Pro allows you to exclude strategies from all analyses Only do if you are certain that a strategy could not possibly be optimal. Can speed up lengthy analyses. Instructions 1.Right click on Other Tx 2 node and choose Exclude Strategy from analysis. 2.Select the decision node. 3.Choose Analysis > Cost-Effectiveness from the menu. TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Analyze Cost-Effectiveness Model

65 65 Now that we have analyzed the model, we will introduce clones In our model, we copied the subtree from one strategy to the other What if the subtree was extremely complex and required significant revision? Clones create exact duplicates of a subtree that stay consistent even as the subtree is updated We will rebuild the second strategy of our tree using clones TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

66 66 Instructions: 1.Open the Example 2 model. 2.Select the New treatment node. 3.Choose Subtree > Select Subtree from the menu. 4.Choose Subtree > Delete from the menu. 5.Select the Standard treatment node. 6.Choose Subtree > Create Clone Master from the menu. 7.Enter the name “Treatment outcomes”. 8.Select the New treatment node. 9.Choose Subtree > Attach Clone. The clone copy will be attached. TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

67 67 You have now created a clone master and attached a clone copy The clone master is identified by a dark node line and a clone index number beneath the node marker The clone copy is identified with a reference to the clone master index TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

68 68 The Clones View allows you to view and edit the clone masters and copies When a clone master is destroyed, all clone copies are also destroyed When a clone copy is destroyed, you can replace it with an independent copy of the clone master TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

69 69 The values in the clone copy and master are now the same How can we really compare strategies? Variables allow you flexibility to send different values into clone master vs. clone copy Same variable references within clone master Pass different variable definitions from outside (to left) of clone into the clone master/copy Recommendation: Define strategy-specific parameters at root Define generic variables at strategy nodes using parameter variables from above Do not defined generic variables at root node TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

70 70 Two values need to be different for the clone master and clone copy Probability of eradicating the tumor Cost of treatment Note that the clone master now uses generic variables pEradicateGeneric and cTreatmentGeneric Each strategy’s parameters are passed to the clone master/copy via the generic variables defined at the strategy nodes TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

71 71 Now the treatment outcomes subtrees are linked Roll back generates the same values for the strategies as before the clones (next module) Clone copy subtrees cannot currently be expanded If needed, temporarily detach clone copy to see complete independent subtree (don’t save change) TreeAge Pro Healthcare Training – Module 2 – Analyze Cost-Effectiveness Model Clones

72 72 Module 3: Sensitivity Analysis Goals: Examine the effect of uncertainty on analysis results Study an individual parameter’s uncertainty and identify thresholds Modeling exercise Study combined parameter uncertainty to determine overall confidence in conclusions TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis

73 73 Sensitivity Analysis studies how uncertainty in a model’s parameter inputs affect its analysis outputs And by extension, your conclusions/strategy selection Two types of Sensitivity Analysis are supported by TreeAge Pro Deterministic Sensitivity Analysis Individual parameters via VARIABLES (range) Probabilistic Sensitivity Analysis Many parameters via DISTRIBUTIONS (samples) Both are recalculation “loops”, with uncertain parameters changing between recalculations TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis

74 74 One-Way Sensitivity Analysis: Identify a single parameter for analysis Must be a numeric parameter and not a formula Set a range (min, max) for the uncertainty related to its value Set the number of intervals for recalculations within the range Recalculate the model several times changing the parameter value from the bottom to the top of the range How do the results (and possibly conclusions) change? TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

75 75 Instructions: 1.Open Example 2 tree. 2.Select root node. 3.Choose Analysis > Sensitivity Analysis > 1 Way… from the menu. 4.Enter the sensitivity analysis parameters… Select the variable pEradicateRadSurg. Range: Intervals: 8. Click OK. TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

76 76 Generates EV calculations for each value of the variable given the range and intervals Cost, effectiveness for each strategy ICER for each parameter value TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic Threshold: var ~= 0.75, ICER ~= 50K

77 77 x vs. Avg. Eff. graph: Sensitivity analysis on effectiveness only Threshold at pEradicateRadSurg value 0.6 Point where effectiveness is equal for two strategies We really want threshold for cost-effectiveness TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

78 78 Sensitivity analysis on cost-effectiveness is more complex At what point in variable range do we have a change in the recommended strategy based on cost-effectiveness (threshold) Need to consider cost, effectiveness and WTP x. vs. ICER graph shows approximate threshold Net Benefits graph and thresholds report best identify threshold TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

79 79 X vs. ICER graph: Shows how ICER changes with variable ICER undefined when IE = 0, presented as zero Can approximate threshold where ICER = WTP TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

80 80 Net Benefits: Prompts for WTP, required for Net Benefits calcs Net benefits is higher for most cost-effective strategy (C, E, WTP combo) Identifies CE threshold If var >= 0.749, recommend surgery + radiation If var < 0.749, recommend radiation only Thresholds report TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

81 81 2-way sensitivity analysis: See how changing two parameters affects recommended strategy Requires Net Benefits Each axis taken by a variable Region patterns show recommended strategy TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

82 82 Instructions: 1.Open Example 2 tree. 2.Select root node. 3.Choose Analysis > Sensitivity Analysis > 2 Way… from the menu. 4.Enter the sensitivity analysis parameters… 1.Var1: pEradicateRadSurg; Range: 0 - 1; Intervals: Var2: pEradicateRad; Range: 0 - 1; Intervals: 5. 3.WTP: 50K 5.Click OK. TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

83 83 2-way sensitivity analysis: New treatment favored more with increased pEradicateRadSurg Standard treatment favored more with increased pEradicateRad TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

84 84 Tornado Diagram: Run a collection of 1-way sensitivity analyses See which variables have the largest impact on EV Uses Net Benefits with additional option for ICER Be careful: Do not overanalyze these graphs Details from 1-way sensitivity analyses are not fully presented in tornado diagram TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

85 85 Instructions: 1.Open Example 2 tree. 2.Select root node. 3.Choose Analysis > Sensitivity Analysis > Tornado Diagram… from the menu. 4.Enter the sensitivity analysis parameters… 1.Var1: pEradicateRad; Range: 0.5 – 0.7; Intervals: 4. 2.Var2: pEradicateRadSurg; Range: 0.7 – 0.9; Intervals: 5. 3.Var3: cRadiation; Range: 25K – 35K, Intervals: 4 4.Var4: cSurgery; Range: 40K – 60K, Intervals: 4 5.Var5: cFollowupAnnual; Range: 1.8K – 2.2K, Intervals: 4 6.WTP: 50K 5.Click OK. TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

86 86 Tornado Diagram: Shows band for range of EV for preferred strategy Dotted line shows base case EV Links for 1-way net benefit graphs Link for ICER graph Dark line indicates a strategy change TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Deterministic

87 87 We are studying treatments for a disease that affects only elderly individuals Without the disease or with the disease controlled, the average person will live for 10 years With the disease uncontrolled, the average person will live only 5 years We are studying two competing drugs for treating this disease For both drugs: It must be taken for at least 1 year If it controls the disease, it must be taken on an ongoing basis If it fails to control the disease, no further treatment can be provided (only 1 year of Tx) TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Modeling Exercise

88 88 Drug 1: Annual cost is $9K Controls disease in 70% of patients Drug 2: Annual cost is $12K Controls disease in 80% of patients Which, if either, drug is the most cost-effective treatment option given a WTP of $50K/LY? TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Modeling Exercise

89 89 How will the model structure begin to form the basis for the decision analysis? Start with decision node with branches for each of three strategies What are the important parameters? Life expectancy with disease = 5 Life expectancy if controlled = 10 Prob of control with Drug 1 = 0.7 Prob of control with Drug 2 = 0.8 Annual cost of Drug 1 = 9K Annual cost of Drug 2 = 12K TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Modeling Exercise

90 90 Given WTP = $50K/LY Which is the most cost-effective treatment option? CEA/Rankings Drug 1 – ICER = $18.8K Drug 2 – ICER = $65.4K At what price for Drug 1would there be a strategy change? Sensitivity analysis on cost of Drug 1 for range 7K-11K Drug 1 – at price $10,055, Drug 2 becomes favored Tx Assume we do not know the LY of no/controlled disease. Identify thresholds in the range Sensitivity analysis on life expectancy controlled Shift from No Tx to Drug 1 at 6.19 Shift from Drug 1 to Drug 2 at TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Modeling Exercise

91 91 Probabilistic Sensitivity Analysis (PSA): Consider the combined uncertainty related to any number of parameters How does this uncertainty affect the overall confidence in your base case conclusions? Percent of simulation iterations that confirm Confidence intervals around main outputs Like ICER No thresholds for individual parameters TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

92 92 Monte Carlo simulation: Introduces randomness, sampling into analysis Required for Probabilistic Sensitivity Analysis (PSA) TreeAge Pro supports several forms of simulation Probabilistic Sensitivity Analysis Samples: 2nd-order, parameter uncertainty Microsimulation, random walks Trials: 1st-order, individual variability Two-Dimensional Samples & Trials in same analysis Three-Dimensional Partial EVPI TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

93 93 Deterministic vs. Probabilistic TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic Deterministic Sensitivity AnalysisProbabilistic Sensitivity Analysis Parameter Variables: – range, intervals Parameter Distributions – random samples Usually focused on 1 uncertainty at a time All uncertainties sampled simultaneously Repeat analysis – Identical results Repeat analysis – Different individual results – Similar aggregate values

94 94 Prepare model for PSA: Set parameter values using distributions instead of simple variables Only create distributions for parameters you want to study via PSA PSA calculation loop: Sample parameter value from each distribution Substitute sampled values into the model Calculate expected values for strategies/payoff sets (C and E) Repeat for predefined number of samples Results: Set of EV calculations reflecting different parameter sets Mean EVs generally will confirm base case Individual EVs may not confirm base case Reflection of confidence in base case Confidence intervals TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

95 95 We will start with the Example 02 model Open and save under new name We will introduce distributions to measure parameter uncertainty for… Probability of eradicating tumor with radiation Probability of eradicating tumor with radiation + surgery Cost of surgery TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

96 96 Instructions: 1.Choose Views > Distributions from the toolbar. 2.Click the “+” icon in the Distributions View to create a new distribution. 3.Enter the distribution information at right. TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

97 97 Distribution type:  Shape of distribution  Required parameters are specific to each distribution type  Example: Normal - mean and standard deviation Parameters:  Numeric values for sampling (sort of like a range) Warning: It can be difficult to determine the appropriate type and parameters for each of your model’s uncertainties TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Distributions

98 98 Distribution type:  Shape of distribution  Required parameters are specific to each distribution type  Example: Normal - mean and standard deviation Parameters:  Numeric values for sampling (sort of like a range) Warning: It can be difficult to determine the appropriate type and parameters for each of your model’s uncertainties TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Distributions

99 99 Normal Standard bell curve Uniform Equal likelihood of all values in range Option to limit to integers Triangular Provide min, max and most likely Often easiest to create, understand Beta Frequently used for probabilities Restricted to between 0 and 1 Dirichlet Sample multiple complementary probabilities, like interrelated betas Table You determine each values that can be sampled and how frequently Good for known empirical data TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Distribution Types

100 100 Sampling rate: Resample per EV/group of trials… PSA parameter uncertainty Parameter sample affects entire cohort Resample per trial For Microsimulation New sample for each individual trial within the cohort Resample per Markov cycle For Microsimulation New sample for each cycle in Markov model (less common) TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Distributions

101 101 Must reference distribution within model for Monte Carlo simulation (PSA) Reference distribution by either index or name Recommend references by name Distribution functions require reference by index Example: DistForce(index), DistTrim(index; min; max) Parameter approximation: Certain distribution types’ parameters can be approximated from other statistics In our first distribution, we estimated the Alpha and Beta parameters from the mean and standard deviation TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Distributions

102 102 Use Graph icon to sample and graph distribution: Mimics sampling that will be performed during PSA Generates a histogram of samples Samples centered around mean (0.6) with variation Beta is not a normal bell curve TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Distributions

103 103 Instructions: 1.Open/select the Distributions View. 2.Click the “+” icon in the Distributions View to create a new distribution. 3.Create two more distributions. dist_pEradicateRadSurg Beta parameters approximated from mean 0.8 and std dev 0.1 dist_cSurgery Normal distribution with mean 50,000 and std dev 10,000 TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

104 104 Distributions created, but they need to be integrated into the model Two options… Replace references to variables with references to distributions within model Define existing referenced variables using distributions rather than numeric values Can still run deterministic sensitivity analysis TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

105 105 Instructions: 1.Select the root node. 2.Open/select the Variable Definitions View. 3.Redefine the following three variables… 1.cSurgery = dist_cSurgery 2.pEradicateRad = dist_pEradicateRad 3.pEradicateRadSurg = dist_pEradicateRadSurg TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

106 106 Non-PSA calculations will use mean values for distributions (no sampling) Our distributions’ means are equal to the original numeric estimates Our EV calculations will not change Be careful with non-PSA analyses after adding distributions TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

107 107 Instructions: 1.Select the root node. 2.Choose Analysis > Monte Carlo Simulation > Sampling. 3.Enter 1000 samples. 4.Click Begin. TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

108 108 How many iterations do you need for a Monte Carlo simulation? Is 1000 enough? Depends on number of distributions and complexity of model If successive simulations generate mean values that are “very close”  enough iterations Good rule for all simulation types (samples, trials, etc.) TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

109 109 Simulation results: Aggregate results: Mean Standard deviation % intervals Each iteration’s results May or may not confirm base case Outputs Text reports Graphs Provide interpretation Can save result set in *.rptx file (consistency in paper) TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

110 110 Selected PSA output options… Values, Distributions: Shows each strategy’s EV calculations and distribution samples for each iteration Output Distributions: Shows distribution of EV outputs for each strategy or for incrementals ICER distribution can be interesting Sometimes invalid in cases where IE can be zero (wild fluctuation in ICER) CE Analysis: CEA from simulation means ICER may not match regular non-PSA CEA ICER CE Scatterplot: Shows scatter of each iteration’s cost and effectiveness values for each strategy TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

111 111 Remember out goal – to see how combined uncertainty affects the overall confidence in our base case conclusions For this… ICE Scatterplot Strategy Selection Frequency Acceptability Curve TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

112 112 ICE Scatterplot Compares a pair of strategies showing IC and IE on graph Edit graph to change y-axis scale to include zero Line from origin to each point is like the ICER slope in CEA graph Points below-right of WTP line (64.9%) recommend New Treatment ICER <= WTP TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

113 113 Strategy Selection Frequency Shows the percentage of iterations that favor each strategy at single WTP ($50K) Shows same percentage as ICE scatterplot Easier to see using Net Ben Changed scale via Edit Chart options TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

114 114 CE Acceptability Curve Shows the percentage of iterations that favor each strategy over WTP range ($0-$100K) Added line via Edit Chart options TreeAge Pro Healthcare Training – Module 3 – Sensitivity Analysis Sensitivity Analysis – Probabilistic

115 115 Module 4: Variable Expressions and Arrays Goals: See how variables can… Simplify complex expressions Change multiple formulas all at once via switches Reference multiple definitions by index TreeAge Pro Healthcare Training – Module 4 – Variable Expressions and Arrays Variable Expressions and Arrays

116 116 Some expressions in models can get very complex Break down complex expressions into pieces For example If(var1+var2 0; var1+2; 0); var3+var4) Isolate specific portions of complex formula with additional variables sum_1_2 = var1+var2 sum_3_4 = var3+var4 adj_1_2 = if(sum_1_2 >0; sum_1_2; 0) If(sum_1_2 < sum_3_4; adj_1_2; sum_3_4) TreeAge Pro Healthcare Training – Module 4 – Variable Expressions and Arrays Variable Expressions and Arrays

117 117 Use “switch variable” to quickly change a bunch of values in model back and forth For PSA vs. base case… PSA_sw = 1 for PSA, = 0 for base case pCondition = if(PSA_sw = 1; dist_pCondition; 0.6) For different cohorts… country_US = 1 and country_UK = 2 country_sw = one of the above values for diff cohorts pCondition = Choose(country_sw; pCondition_US; pCondition_UK) TreeAge Pro Healthcare Training – Module 4 – Variable Expressions and Arrays Variable Expressions and Arrays

118 118 Variable Arrays See example model “Variable Definition Array” Series of variable definitions referenced by index (1, 2, etc.) Can use for different values associated with subgroups TreeAge Pro Healthcare Training – Module 4 – Variable Expressions and Arrays Variable Expressions and Arrays

119 119 Recursive Variables Can redefine a variable to add to its value at different points in model See example model “Recursive Variables” TreeAge Pro Healthcare Training – Module 4 – Variable Expressions and Arrays Variable Expressions and Arrays costX = =20 costX = 5+5=10 costX cannot be calculated


Download ppt "TreeAge Pro 2-Day Healthcare Training Day 1 Using TreeAge Pro for Health Economic Modeling © 2013 TreeAge Software, Inc."

Similar presentations


Ads by Google