Presentation is loading. Please wait.

Presentation is loading. Please wait.

Performance Metrics for Weatherization David Carroll State WAP Evaluations ACI Home Performance Conference April 30, 2014.

Similar presentations


Presentation on theme: "Performance Metrics for Weatherization David Carroll State WAP Evaluations ACI Home Performance Conference April 30, 2014."— Presentation transcript:

1 Performance Metrics for Weatherization David Carroll State WAP Evaluations ACI Home Performance Conference April 30, 2014

2 What is Performance Measurement? 2

3 Step 1 - Goals What are your goals? –Are you trying to serve a certain population? –Are you trying to affect … Energy use? Energy costs? Payment problems? Emissions? Health problems? –How will you know when you are successful? 3

4 Step 2 – Measurement Overall Research –Who are you serving? –How are you serving them? –What are they saving? –What other benefits are you delivering? Comparative Research –What approach maximizes energy, cost, payment, emissions, health impacts? 4

5 Step 3 - Assessment Assessment –What are your goals for your program? –Does your performance match your goals? –How can you better align your performance with your goals? 5

6 Step 4 – Improvement Strategies –Changing who you serve Targeting Partnerships –Changing what you deliver Assessments Measures 6

7 Step 4 - Improvement Strategies (continued) –Changing your performance Comparative analysis Mentoring / partnerships –Changing funding available Leveraging Advocacy 7

8 A Comprehensive Approach to Performance Measurement 8

9 Benchmark Use data on …. –Population / Census Data (ACS) –Recipients / LIHEAP or Energy Assistance –WX Clients / Demographics, Housing Units, Baseline Conditions 9

10 Observe Observations of …. –Intake –Audits –Service Delivery –Inspections 10

11 Measure Collect data on …. –Installed Measures –Post-WX Conditions –Pre/Post Energy Usage –Client Outcomes – Payments, Housing, Health 11

12 Analyze Study …. –Gross changes in weather-normalized usage –Net changes using a comparison group –Variations in outcomes by key client, building, and program factors 12

13 Assessment Investigate… –Why are some subgroups seeing high impacts? –Why are some subgroups seeing low impacts? –What strategies might be tested to better align outcomes with goals? 13

14 Who are you Serving? Example of using Census and LIHEAP data as a Benchmark 14

15 Minnesota Households - 2010 About one in four Minnesota households were income- eligible for the LIHEAP Program in 2010. 15 Eligibility Group Number of HouseholdsPercent of Households Not Income Eligible 1,564,18775% Income Eligible 527,35925% All Households 2,091,546100% Source: 2010 American Community Survey

16 Minnesota LIHEAP and WAP Recipients in 2010 About 38% of income-eligible households received LIHEAP and 2% received WAP. National averages are 17% and 0.5%, respectively. 16 Received Benefits LIHEAP Recipients Percent of Households WAP Recipients Percent of Households Yes 199,96938%11,2072% No 327,39062%516,15298% Income-Eligible Households 527,359100%527,359100% Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database

17 Housing Unit Type LIHEAP is less likely to serve households in Large Multi- Family buildings. WAP serves very few households in Multi-Family buildings of any type. 17 Housing Unit Type Low-IncomeLIHEAP RecipientsWAP Recipients Single Family 52%59%80% Mobile Home 5%11%14% Small Multi-Family 8%7%3% Large Multi-Family 35%23%3% Total 100% Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database

18 Housing Unit Type LIHEAP is less likely to serve households in Large Multi- Family buildings. WAP serves very few households in Multi-Family buildings of any type. 18 Housing Unit Type Low-IncomeLIHEAP RecipientsWAP Recipients Single Family 52%59%80% Mobile Home 5%11%14% Small Multi-Family 8%7%3% Large Multi-Family 35%23%3% Total 100% Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database

19 Ownership Status LIHEAP serves both owners and renters. WAP is less likely to serve renters. 19 Ownership Status Low-IncomeLIHEAP RecipientsWAP Recipients Owner 46%44%84% Renter/Other 54%56%16% Total 100% Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database

20 Ownership Status – Single Family Units Even if we control for housing unit type, WAP is more likely to serve owners than renters. 20 Ownership Status Low-IncomeLIHEAP RecipientsWAP Recipients Owner 75%60%87% Renter/Other 25%40%13% Total 100% Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database

21 Ownership Status of WAP Participants – Single Family Units Control for housing unit type reduces that variation in service to renters by substate area. 21 Ownership Status StateNENWCentralMetroSESW Owner 87%93%94%89%80%88% Renter/ Other 13%7%6%11%20%12% Total 100% Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database

22 How are you serving them? Example of furnishing details for the state, region, and agency. 22

23 23

24 24

25 How much energy are you saving and how does that vary by important program factors? 25

26 Table 1 WAP Energy Impacts for Single Family Site-Built Homes Gross and Net Gas Savings by End Use (therms/year) Group/Breakout# Homes Gas Use Pre-WAP Gas Use Post-WAP Gross SavingsNet Savings% of Pre Total Use937983845138 (±10) 130 (±11)13.2% (±1.1%) Comparison1,2959299218 (±4) Heating Use937775658117 (±9) 100 (±11)13.0% (±1.4%) Comparison1,29574172416 (±6) Baseload Use93720818721 (±7) 30 (±8)14.2% (±17) Comparison1,295188196-8 (±5)

27 Table 3 WAP Energy Impacts for Single Family Site-Built Homes Gas Savings for Homes with Natural Gas Main Heat By Measure Combination (therms/year) Group/Breakout# Homes Gas Use Pre- WAPNet Savings% of Pre No Major Measures20287737 (±15)4.2% (±1.7%) One Major Measure298957121 (±17)12.7% (±1.8%) Two Major Measures2111,003162 (±20)16.1% (±2.0%) Three Major Measures1151,111236 (±29)21.2% (±2.6%) All Four Major Measures331,179382 (±71)32.4% (±6.1%)

28 Table 4 WAP Energy Impacts for Single Family Site-Built Homes Net Gas Savings for Natural Gas Main Heat by Pre-Weatherization Gas Usage (therms/year) Pre-WAP Gas Use (therms/yr) Major Measures# Homes Gas Use Pre-WAPNet Savings% of Pre All Clients1.4937983130 (±10)13.2% (±1.1%) <750 th/yr.1.124564064 (±12)10.0% (±1.9%) 750-10001.3296880105 (±14)12.0% (±1.6%) 1000-12501.62261,097142 (±22)12.9% (±2.0%) 1250-15001.61011,355219 (±42)16.2% (±3.1%) >=1500 th/yr.2.0691,731269 (±65)15.6% (±3.7%)

29 Table 12 Gas Impact Results by Agency for Gas Heated Single Family Site-Built Homes Agency ID Gas Use Pre-WAPNet Savings% of Pre # of Measures A 1,077187 (± 21)17.3% (±1.9)2.2 B992122 (± 32)12.3 % (±3.2)0.9 C1,028119 (± 40)11.6% (±3.9)1.2 D948118 (± 19)12.4% (±2.0)1.3 E1,012113 (± 64)11.1% (±6.3)0.7 F937109 (± 44)11.6% (±4.7)1.2 G945107 (± 50)11.3% (±5.3)0.9 H87594 (± 26)10.7% (±3.0)0.7 I92994 (± 41)10.1% (±4.4)1.1 J 88958 (± 27)6.5% (±3.0)0.5 Total 983130 (±11)13.2% (±0.7)1.4

30 Make sure you consider other program impacts. 30

31 Table 26 Emissions Benefits Estimated Value of Avoided Emissions per Home for Single Family Site-Built Homes (2013 Dollars) PollutantFirst YearLifetime CO2 Equivalent $53.65$1,009.63 NOX $23.45$432.11 PM2.5 $2.49$42.85 SO2 $44.48$684.39 VOC $0.41$8.25 Total $124.49$2,177.22 31

32 Dwelling Quality Indicators 32 Indicator Pre-Audit Incidence Post-WX Incidence Percent Change Home sometimes at unhealthy temperature 20%9%-55% Observed standing water in home 33%19%-42% Frequent mildew odor or musty smell 29%16%-45% Home somewhat or very infested with insects 25%17%-32% Home has CO monitor 41%74%+80%

33 Affordability Indicators 33 Indicator Pre-Audit Incidence Post-WX Incidence Change Got disconnect notice 45%33%-26% Had natural gas, electricity, or bulk fuel service terminated 18%9%-50% Went without food to pay energy bills 34%23%-33% Went without food in the last four weeks 9%6%-33% Used high interest loan to pay energy bills 20%12%-40%

34 Contact 34 David Carroll, 609-252-8010 david-carroll@appriseinc.org APPRISE 32 Nassau Street, Suite 200 Princeton, NJ 08540


Download ppt "Performance Metrics for Weatherization David Carroll State WAP Evaluations ACI Home Performance Conference April 30, 2014."

Similar presentations


Ads by Google