1. SAS/INSIGHT Demonstration - Exploratory Data Analysis (EDA) techniques
David Lassman
Office of the Actuary
X7933
2/18/2019

2. Introduction
Apply exploratory data analysis techniques (using SAS/INSIGHT) to improve outlier detection
Demonstration
Datasets
Census Bureau
Service Annual Survey
Industry estimates
American Hospital Association
Annual hospital data
Baseball data – 1986 statistics
Hitters
2/18/2019

3. Exploratory Data Analysis(EDA)
“A set of tools for finding what we might have otherwise missed” in a set of data (Tukey, 1977)
Determine which cases are unusual with respect to the bulk of the cases and to follow-up those cases.
Limited time frame
2/18/2019

4. Data Review using Graphical Data Analysis-Benefits
Allows you to see the “big picture”
Research/explain data trends
Find patterns in your data
2/18/2019

5. Techniques Box plot Scatter plot Fitting Transformations
Location, spread, and shape of a distribution
Scatter plot
Fitting
Ordinary least squares regression
Transformations
Log
Square root
Other
2/18/2019

6. Demonstration datasets - Service Annual Survey
Collect financial data
Revenue
Expenses
Service Industries include:
Personal Services
Business Services
*Health Care and Social Assistance
Trucking and Warehousing
2/18/2019

7. Health Care and Social Assistance (NAICS 62)
Physicians - NAICS 6211
Dentists - NAICS 6212
Other health care practitioners - NAICS 6213
Chiropractors – NAICS 62131
Optometrists – NAICS 62132
Outpatient Care Centers – NAICS 6214
Home Health Care – NAICS 6216
Other Ambulatory Services – NAICS 6219 – examples: blood/organ banks, health screening services, hearing services
Hospitals – NAICS 622
Nursing and Residential Care Facilities – NAICS 623
2/18/2019

8. Health Care and Social Assistance (NAICS 62) con’t
Data items
Total Revenue
Source of payment
Medicare
Medicaid
Other Government
Patient (out-of-pocket)
Patient from family – NAICS 623 only
Patient from social security benefits – NAICS 623 only
Private insurance
All other patient care
All other services
Total Expenses
2/18/2019

9. -----Alphabetic List of Variables and Attributes-----#
Variable
Type
Len
Pos
Format
Informat
Label 17
Description
Char 47
135 2
ITEM 24
110
$24. 1
NAICS 6
104
$6. 3
Tax
134
$1. 15
ch_00_99
Num 8 88
PERCENT6.2 14
ch_01_00 80 13
ch_02_01 72 12
ch_03_02 64 11
ch_04_03 56 16
ch_99_98 96 10
r1998 48
DOLLAR12. 9
r1999 40
r2000 32 7
r2001
r2002 5
r2003 4
r2004
Service Annual Survey -
2/18/2019

10. -----Alphabetic List of Variables and Attributes-----
AHA hospital dataset
-----Alphabetic List of Variables and Attributes----- #
Variable
Type
Len
Pos
Format
Informat
Label 6
ADMTOT
Num 8 32 5
BDTOT 24 7
BIRTHS 40 2
EXPTOT
DOLLAR27.2 1 ID
Char 10 48
$10.
MNAME 30 58
$30. 4
NPAYBEN 16 3
PAYTOT 9
bdgrp 18 88
2/18/2019

11. -----Alphabetic List of Variables and Attributes-----#
Variable
Type
Len
Pos
Label 19
assists
Num 8
112
Assists 5
atbat
Times at Bat 12
atbatc 56
Career Times at Bat 22
batavg
136
Batting Average 23
batavgc
144
Career Batting Average 20
errors
120
Errors 6
hits
Hits 13
hitsc 64
Career Hits 7
homer 16
Home Runs 14
homerc 72
Career Home Runs 2
league
Char 1
166
League
name
152
Hitter's name 4
position
170
Position(s) 18
putouts
104
Put Outs 9
rbi 32
Runs Batted In
rbic 88
Career Runs Batted In
runs 24
Runs 15
runsc 80
Career Runs Scored 21
salary
128
Salary (in 1000$) 3
team
167
Team 10
walks 40
Walks 17
walksc 96
Career Walks 11
years 48
Years in the Major Leagues
Baseball -
2/18/2019

12. SAS/INSIGHT Interactive tool for exploring and analyzing data.
Graphs include box plots, histograms, and scatter plots
Dynamic - Click on points to identify
All graphs and analyses are linked.
Brush observations in one window and they are highlighted in all windows.
Color a point in one graph and it receives the same color in all displays.
Exclude an observation from calculations, and all analyses recalculate automatically.
2/18/2019

13. Demonstration Invoke insight Type insight in the command box
P-menu – solutions-analysis –interactive data analysis
PROC insight
2/18/2019