1. Performance-Based Planning:
Increasing Transparency & Understanding in Decision Making
2016 AMPO Annual Conference
Maria Roell
Atlanta Regional Commission

2. Outline Background ARC’s Project Evaluation Objectives
Big Data Challenges and Solutions
Modelling Individual Projects in VISUM
Criteria for The Atlanta Region’s Plan
Project Evaluation Visualization
Future Project Evaluation & SHRP2

3. Background 20 Counties Population: 5 Million 726 Projects
340 Programmed
114 Long Range
272 Aspirations

4. ARC’s Project Evaluation Objectives
Understand need and performance separately
Find individual projects’ significance
Consider timing of projects
Bring comprehensive dataset to public and decision makers

5. Big Data Challenges Solutions Choosing a provider
Cost
Collection Methodologies
Different Networks/Coverage
Solutions
Try to fill current data gaps
Set aside time to analyze

6. Isolated Data Sources Model RTP ASTRO RTN CRASH NHS/ NPMRDS
GASTARS, TMC
NAVTEQ & INRIX

7. Example of Uncombined Data

8. Combined All Data 2015 Key Network
Model
RTP
ASTRoMaP
CRASH
RTN
COUNT
NAVTEQ
NHS
TMC
2015 Key Network
Now able to analyze all data at project level

9. Data Sources and Networks
Project Data
Estimated
Real World Data
Project ID
Project Cost
Model
Crashes
NAVTEQ & INRIX
Equity
Other
Resources
B/C
Volume,
VMT, VHT,
Accessibility
Crash
Rate
TTI
ETA
RTN
ASTRO
NHS
Separate Networks
Model Network
2015 Key Network

10. Modelling Individual Projects
Which projects to run
163 out of 726
Limited to capacity projects using Federal funding
VISUM
Macroscopic & Mesoscopic
Capacity & Operational projects
Can be converted to Microscopic (VISSIM)
User interface
Easy to edit network and manage scenarios
Running time less < 1hr
Each project run for 2015 and 2040
File size
8GB
Flow Bundle Analysis
Percent volumes to and from all activity centers automatically
Compatible with GIS and Excel

11. Criteria for The Atlanta Region’s Plan
Need Metrics- Current
Variable
Measure
Calculation
Source
Congestion
Travel Time Index
Avg. TTI by Project
NAVTEQ and INRIX
Accessibility
Percent Volume
Flow Bundle Analysis
VISUM
Safety
Crash Rate
Crash Rate/ Avg Crash Rate
By Facility Type
CARE
Air Quality
Particulate Matter
Avg. Level of PM by Project
AREES
Reliability
Buffer Index
95th Percentile Avg Travel Time
Equity
Equitable Target Area
Inside or Outside
ETA Index
Freight
Truck Network
On or Off Network
ASTRoMaP
Performance Metrics- Future
Variable
Measure
Calculation
Congestion
Vehicle Hours Delay
VHD Project Build (PB)-VHD No Build (NB)
Accessibility
Percent Volume
PB-NB
Freight
Truck VMT
Air Quality
Particulate Matter
PM kg/year 2040 PB-NB
Deliverability
Environmental Impacts
Avg. Number of Environmental Obstacles
Impact
Volume/Mile
Categorized

12. Benefit Cost, Need & Performance
Cost of Project
Change in emissions
Change in congestion
Need and Performance
Each measure indexed
Each measure weighted to reflect region’s policies and goals

13. Visualization Decision Makers Public
Graphics help understand differences
Between need and performance
Between projects
Can focus on what is most important to them
By customizing chart
Public
Increased transparency of public spending
Can look for projects in their area

14. Visualization

16. Summary Understand need and performance separately
Kept observed data & modeled data separate
Used interactive graphs
Find individual projects’ significance
Each project run separately
Consider timing of projects
Projects run through multiple years
Bring comprehensive dataset to public and decision makers
Created interactive visualization

17. Strategic Highway Research Program 2 (SHRP2)
TIP Prioritization
Taskforce
County Planners, Non-Profits, Consultants, State Planners
April – September
Small working groups
Each Key Decision Point and Metric
Process ongoing

18. New Project Evaluation Process
Universal TIP Project Call
Policy Filter (KDP 1)
Performance Evaluation (KDP 2)
Projects Prioritized by Type
CMAQ
TAP
STP
Qualitative Evaluation (KDP 3)
Consolidate all programs into a universal process
No min or max funding levels
Funding distribution evaluated using RTP distribution
GDOT projects that are federal funded should be evaluated

19. Performance Evaluation Criteria
World Class Infrastructure
Healthy Livable Communities
Competitive Economy
Mobility/Congestion
Safety
Freight Supportive
Reliability
Air Quality & Climate Change
Employment Accessibility
Network Connectivity
Cultural & Environmental Sensitivity
Multimodalism
Social Equity
Asset Mgt. & Resiliency
Land Use Compatibility
Each criteria calculated for every mode, using different data and calculations

20. Projects Ranked by Type
Transit
Transit 1
Transit 2
Transit 3
Trail
Trail 1
Trail 2
Trail 3
Roadway
Roadway 1
Roadway 2
Roadway 3

21. Project Recommendations
MAP-21 National Goals
Safety
Infrastructure Condition
Congestion Reduction
System Reliability
Freight Movement & Economic Vitality
Environmental Sustainability
Reduced Project Delivery Delays

22. Thank you! Maria Roell- MRoell@atlantaregional.com
Project Evaluation Visualization