Presentation is loading. Please wait.

Presentation is loading. Please wait.

Statistical Fridays J C Horrow, MD, MSSTAT

Similar presentations


Presentation on theme: "Statistical Fridays J C Horrow, MD, MSSTAT"— Presentation transcript:

1 Statistical Fridays J C Horrow, MD, MSSTAT
Clinical Professor, Anesthesiology Drexel University College of Medicine

2 Goals Introduce / reinforce statistical thinking
Understand statistical models Appreciate model assumptions Perform simple statistical tests

3 What topics will we cover?
Statistical concepts. Sensitivity/Specificity Descriptive statistics. Hypothesis Formulation Hypothesis testing. Normal Distribution. a and b errors. Student’s t distribution. Paired /unpaired tests. Categorical data. Chi square tests.

4 Session #1: Summary Sensitivity / specificity Predictive value
Effect of disease prevalence The ROC curve

5 Sensitivity / Specificity
Given the following: N independent events A test with a dichotomous result (Y/N) Known “truth” for each event

6 Sensitivity / Specificity
We can set up a 2x2 square describing how successful the test has been: Truly YES Truly NO TOTAL Tested YES True Pos False Pos TP+FP TestedNO False Neg True Neg FN+TN TP+FN FP+TN N

7 Sensitivity = TP / (TP+FN)
Truly YES Truly NO TOTAL Tested YES True Pos False Pos TP+FP TestedNO False Neg True Neg FN+TN TP+FN FP+TN N Sensitivity = TP / (TP+FN)

8 Specificity = TN / (FP+TN)
Truly YES Truly NO TOTAL Tested YES True Pos False Pos TP+FP TestedNO False Neg True Neg FN+TN TP+FN FP+TN N Specificity = TN / (FP+TN)

9 Positive Predictive Value
Truly YES Truly NO TOTAL Tested YES True Pos False Pos TP+FP TestedNO False Neg True Neg FN+TN TP+FN FP+TN N PPV = TP / (TP+FP)

10 Negative Predictive Value
Truly YES Truly NO TOTAL Tested YES True Pos False Pos TP+FP TestedNO False Neg True Neg FN+TN TP+FN FP+TN N NPV = TN / (FN+TN)

11 Worked Example 50 patients are tested for hyperlipidemia.
Of the 10 with the disorder, 8 test positive. Of the 40 without the disorder, 4 test positive. Calculate sensitivity, specificity, and positive and negative predictive values.

12 Sensitivity / Specificity
First, set up the 2x2 square : Truly YES Truly NO TOTAL Tested YES 8 4 12 TestedNO 2 36 38 10 40 50

13 Worked Example Now calculate the values: Truly YES Truly NO TOTAL
Test YES 8 4 12 Test NO 2 36 38 10 40 50 Sensitivity = 8/10 = 80% Specificity = 36/40 = 90% PPV = 8/12 = 67% NPV = 36/38 = 95% What do you think of this test? Is it a “good” test? When?

14 Effect of Disease Prevalence
Assume that a serum potassium < 4.0 mEq/L predicts dysrhythmia 80% of the time. However, 20% of patients without dysrhythmia also have values < 4 mEq/L. Note: sensitivity = specificity = 80%

15 Effect of Disease Prevalence
We will find the PPV and NPV of this test (serum K < 4.0 mEq/L) if the prevalence of dysrhythmia is 10%. Then we will do the same for prevalence of 70%, and see how the results differ.

16 Effect of Disease Prevalence
Assume 100 patients. 10 have dysrhythmia. Truly YES Truly NO TOTAL Test YES 8 18 26 Test NO 2 72 74 10 90 100 PPV = 8/26 = 31%  a useless test to predict dysrhythmia. NPV = 72/74 = 97% a good test to rule out dysrhythmia.

17 Effect of Disease Prevalence
For the same 100 patients, 70 have dysrhythmia : Truly YES Truly NO TOTAL Test YES 56 6 62 Test NO 14 24 38 70 30 100 PPV = 56/62 = 62%  a better test to predict dysrhythmia NPV = 24/38 = 63% not as good a test to rule out dysrhythmia

18 Effect of Disease Prevalence
Why pick serum K < 4.0 mEq/L? Would another discriminant yield better sensitivity and specificity (and therefore better PPV and NPV)? Which discriminant is the best?

19 Receiver Operating Characteristic Curve
Vary the discriminant throughout the range of possible test result values… Calculate the sensitivity and specificity at each value… Plot sensitivity v. (1-specificity)

20 ROC Curve

21 Session #1: Review Sensitivity / specificity Predictive value
Effect of disease prevalence The ROC curve

22

23 ROC Curve


Download ppt "Statistical Fridays J C Horrow, MD, MSSTAT"

Similar presentations


Ads by Google