BGE Limited Income Pilot Programs - Evaluation ACI Home Performance Conference March 2012.

Slides:



Advertisements
Similar presentations
1 The Potential For Implementing Demand Response Programs In Illinois Rick Voytas Manager, Corporate Analysis Ameren Services May 12, 2006.
Advertisements

1 Rocky Mountain Power Energy Efficiency Study October 1, 2013.
Overview of Property Assessed Clean Energy (PACE) Program San Antonio Office of Environmental Policy December 16, 2009.
Why Implement a Program? Indiana, unlike other states, is without a safety net program Indiana relies solely on Federal LIHEAP funding which has not responded.
IACAA is an umbrella organization that represents non-governmental and local governmental organizations that were established for the purpose of fighting.
NJ Comfort Partners Evaluation Jackie Berger August 21, 2014.
CONSUMER PROTECTIONS AND SERVICE QUALITY March 14, 2011.
Best Practices In Low-Income Energy Efficiency Programs Jackie Berger ACI Home Performance Conference April 30, 2014.
Best Practices In Low-Income Programming Jackie Berger ACI Home Performance Conference May 6, 2015.
Fortis’ Residential Conservation Rate (RCR) How Rural Customers Are Subsidizing Lower Rates For Urban Customers.
HOME ENERGY USAGE REPORTS: DOES INCREASED FEEDBACK LEAD TO SIGNIFICANT ENERGY REDUCTIONS AND REDUCED COSTS? NASUCA MID YEAR MEETING JUNE 25, 2012 Ricky.
National Study of Low Income Energy Programs NARUC Consumer Affairs Committee David Carroll, APPRISE Jacqueline Berger, APPRISE Roger Colton, Fisher, Sheehan,
Achieving High Savings from Low-Income Energy Efficiency Programs David Carroll and Jackie Berger ACI Conference – May 2015.
NJ SHARES 2007 Evaluation October 25, Evaluation Goals Characterize NJ SHARES grant recipients Characterize NJ SHARES grants Examine good faith.
Elements of Ratepayer-Funded Low-Income Programs Affordable Comfort May 2005 Jacqueline Berger, APPRISE Incorporated Suzanne Harmelink, WI Energy Conservation.
1Managed by UT-Battelle for the Department of Energy Michael Blasnik M Blasnik & Associates Greg Dalhoff Dalhoff Associates, LLC David Carroll APPRISE.
Performance Metrics for Weatherization UGI LIURP Evaluation Yvette Belfort Jackie Berger ACI Home Performance Conference April 30, 2014.
National Study of Low Income Energy Programs Lessons for Connecticut January 29, 2008 David Carroll - APPRISE Roger Colton – Fisher, Sheehan, and Colton.
1 Clients As a Resource in Energy Education Jackie Berger David Carroll 2004 Affordable Comfort April 28, 2004.
Client Communication and Energy Education Jackie Berger ACI NJ March 5, 2010.
Why Data Matters! Building and Sustaining a Business Case Kansas City NEUAC June 18, 2014.
1 NJ SHARES ACCOUNTABILITY PLAN Jackie Berger 2004 NFFN June 7, 2004.
Residential Behavior Programs RTF Subcommittee Ryan Firestone September 17, 2015.
NJ SHARES The Evaluation of 2007 Grants October 20, 2008 Revised 11/21/08.
Energy Payment Assistance Programs National Energy and Utility Affordability Conference Denver, Colorado Jacqueline Berger David Carroll June 17, 2008.
2011 Residential HAN Pilots Evaluation Results © 2011San Diego Gas & Electric Company. All copyright and trademark rights reserved. 1.
Utility Low Income Payment Assistance Program Models Vermont Low Income Working Group August 8, 2006.
How Energy Efficiency Can Reduce Bill Subsidization Affordable Comfort, April 2007 John Augustino, Honeywell Jacqueline Berger, APPRISE Susan Moser, Ohio.
Energy Behavior – Lessons from Low-Income Education Programs David Carroll, Jackie Berger ACEEE Summer Study on Energy Efficiency in Buildings August 20,
EvergreenEcon.com ESA 2011 Impact Evaluation Research Plan Public Workshop #1 February 20, 2013 Presented By: Steve Grover, President.
Home Energy Assistance Program Evaluation Jackie Berger July 28, 2010.
PG&E Winter Bill Programs and Plans Low Income Oversight Board Meeting September 17, 2008 Sacramento, CA.
NJ SHARES 2006 Evaluation October 26, Evaluation Goals Characterize NJ SHARES grant recipients Characterize NJ SHARES grants Examine good faith.
Ratepayer Funded Low-Income Energy Programs Performance and Possibilities 2007 NLIEC David Carroll, APPRISE Jacqueline Berger, APPRISE Roger Colton, Fisher,
Measures that Save The Most Energy Jackie Berger David Carroll ACI New Jersey Home Performance Conference January 25, 2007.
New Evidence on Energy Education Effectiveness Jackie Berger 2008 ACI Home Performance Conference April 8, 2008.
Achieving Higher Savings in Low-Income Weatherization Jacqueline Berger 2015 IEPEC Conference ― Long Beach, California.
EMV Results for online Energy Education Study conducted by Lei Wang, PhD October 2011.
Energy Education in the Home Jackie Berger 2014 BECC December 9, 2014.
Non-Energy Benefits Estimating the Economic Benefits of the Ohio Electric Partnership Program 2006 ACI Home Performance Conference May 25, 2006 Jackie.
Comparison of Pooled and Household-Level Usage Impact Analysis Jackie Berger Ferit Ucar IEPEC Conference – August 14, 2013.
The State of Ohio is an Equal Opportunity Employer and Provider of ADA Services HEAP and PIPP Plus: The Basics and Beyond Tracey Ballas Assistant Deputy.
Coordination of LIHEAP with State and Utility Payment Assistance Programs NEUAC Conference June 28, 2011 Jackie Berger.
Why Data Matters Building and Sustaining a Business Case NEAUC Conference June 18, 2014.
Impact of Energy Efficiency Services on Energy Assistance NEUAC Conference June 18, 2014.
Utilities’ Update on Energy Savings Assistance Program Studies Ordered in D LIOB Meeting August 21, 2013 Sacramento, California.
Repeat LIHEAP Recipients 2013 NEUAC Conference Jackie Berger.
Pay-As-You-Go Update November Program Overview Paying advance for electricity Flexibility and Customer benefits Make as many payments as necessary.
Summary of BGE’s Pilot of Innovative Direct Mail Campaign January 27, 2012.
National Study of Low Income Energy Programs Lessons for Connecticut
Research, Evaluation, and Performance Measurement
Best Practices in Residential Energy Efficiency
Smart Thermostats Opportunities for Energy Savings
Roger Colton Presented to: NASUCA Annual Meeting November 2017
Understanding & Improving Energy Affordability in New Jersey
Health and Safety Investments to Increase Energy-Saving Opportunities
South Jersey Gas Home Performance Program & Evaluation
Chad Teman – Assistant Director of Admissions Rhodes State College
What have we learned from Performance Data reported in FY 2015?
NJ SHARES The Evaluation of 2007 Grants
WAP Warm Climate Weatherization: Opportunities for Energy Savings
Health and Safety Investments to Increase Energy-Saving Opportunities
Performance Measurement Report Pilot
Behavior Modification Report with Peak Reduction Component
NEADA 2018 National Energy Assistance Survey
Evaluating Low-Income Programs Why and How
Tom Clark Vice President, Customer Service & Service Area Development
Jackie Berger Home Performance Conference April 3, 2019
LIHEAP Performance Management in the District of Columbia
Presentation transcript:

BGE Limited Income Pilot Programs - Evaluation ACI Home Performance Conference March 2012

Presentation Overview Pilot Summary Evaluation Research CAMP/GRAD Credits Participant Survey Pilot Impacts –Usage Impacts –Arrearage Impacts –Collections Impacts Cost Effectiveness Recommendations 2

BGE LIMITED INCOME PILOTS 3

Pilot Motivation Existing limited-income discount program –Incentive for on-time bill payment –But only 27% receive credit for timely bill payment. New pilots –Attempt to cost-effectively increase on-time payment –Test different programs and benefits –Determine impacts on payments and usage –Determine cost-effectiveness 4

Pilot Programs CAMP 1-Double bill credit 2-Existing credits and payment counseling 3-Double bill credit and payment counseling GRAD 1-Graduated credits 2-Graduated credits and Quick Home Energy Check-up 3-Graduated credits and payment counseling 5

EVALUATION RESEARCH 6

Evaluation Questions Did the programs… –Reduce usage? –Improve on-time bill payment? –Reduce collections and non-payment expenses? Could the program… –Be modified to improve cost-effectiveness? –Be scaled up for all BGE limited-income customers? What would be the costs of such a program? What other changes are recommended for full scale implementation? 7

Evaluation Research 1.Program Database Analysis – program participation and services delivered 2.BGE Interviews – program parameters, customer selection, collection strategies and implementation, and potential improvement. 3.Dollar Energy – implementation barriers, customers’ interest and concerns, customer response to payment counseling 8

Evaluation Research 4.Participant Survey – program understanding, impacts, and satisfaction 5.Billing, Usage, and Collection Data Retrieval and Analysis – impact analysis 6.Cost-Effectiveness Analysis – pilot and full scale cost-effectiveness 9

CAMP/GRAD CREDITS RECEIVED 10

Pre Pilot CAMP Statistics The average monthly credit is $ percent of the customers received at least one credit In the average month, only about 27% of these customers received a credit for timely bill payment. Average annual credit is $7.09*12 months*.27 = $23 11

CAMP Pilot Credits 12 # Mean Credits NumberTotal Average Credit All CAMP8244.5$51 $11 1 – Double Credits2914.5$59 $13 2 – Payment Counseling2334.7$32 $7 3 – Credits & Counseling3004.3$58 $13

GRAD Pilot Credits 13 # Mean Credits NumberTotal Average Credit ALL GRAD8228.5$239 $28 1 – Graduated Discount3048.7$243 $28 2 – Discount & Audit2618.2$228 $28 3 – Discount & Counseling2578.7$244 $28

CUSTOMER SURVEY 14

Survey Goals Customer understanding of pilot benefits and services. Customer perception of pilot impacts on bill payment, energy consumption, and program participation. Potential impacts of payment counseling and energy audits. Customer satisfaction with pilot benefits and services. 15

Pilot Enrollment 16 How difficult or easy was the process to sign up for the CAMP/ GRAD program – would you say it was very difficult, somewhat difficult, somewhat easy, or very easy? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling Very Easy 67%79%56%66%73%79%69% Somewhat Easy 26%18%37%23%21%19%21%29% Somewhat Difficult 5%1%6%8%4%3%7%0% Very Difficult 2%1%2%3%2%0%3%

Previous Program Credits 17 Prior to your participation in the CAMP/GRAD program over the past year, were you receiving any CAMP program credits on your monthly BGE bill? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling Yes41%47%37%38%37% 39%32% No41%37%40%47%50%53%41%60% Don’t Know 18%16%23%16%13%9%20%8%

Pilot Benefits 18 Which did you receive… CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling Discount larger than CAMP 19%25%15%16%33%31%36%32% Discount based on energy used 41%43%45%34%65% Payment counseling 10%13%9%8%9%7%13%5%

Bill Payment 19 Since you have been participating in this program, would you say you have been paying your BGE bill on time more often, you have been paying your BGE bill on-time less often, or there has been no change in when you pay your BGE bill? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling More Often 44%48%40%44%49% 48%49% Less Often 6%7%4%8%6%4%8%5% No Change 50%45%56%48%46%47%44%46%

Energy Usage 20 Since you have been participating in this program, would you say you have been using less energy, you have been using more energy, or there has been no change in your use of energy? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling Less Energy 32%33%35%27%51%45%56%51% More Energy 12%15%13%9%10%9%11%8% No Change 49%44%47%56%33%41%27% Don’t Know 7%8%5%8%7%4%7%14%

Program Participation 21 Has your participation in the program over the past year led to your participation in other energy programs such as: the Weatherization Assistance Program, BGE’s Limited Income Energy Efficiency Program, or any other energy program? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling WAP24% 23%26%28% 21%43% LIEEP20%16%21%23%27%31% 11% Other Energy Program 20%24%16%20%27%37%21%19%

Payment Counseling 22 Did you receive a phone call from Dollar Energy during the course of the program to discuss your BGE payments? ALL CAMPGRAD 233 Payment Counseling Credit & Counseling Discount & Counseling Yes13%11%12%19% No65%61%75%51% Don’t know22%28%13%30%

Energy Audit 23 Did you receive a BGE Quick Home Energy Check-up as part of this program? This is where someone came out to your home and made suggestions for things that could be done to help you use less energy. GRAD 2 Discount & Audit Yes69% No29% Don’t Know1%

Energy Audit Impact 24 Would you say that since the BGE Quick Home Energy Check-up, you have been using less energy, you have been using more energy, or there has been no real change in your energy usage? GRAD 2 Discount & Audit Less Energy71% More Energy0% No Change23% Don’t Know6%

Bill Payment Problems 25 How difficult or easy is it for you to come up with the money to pay your BGE bill – would you say it is very difficult, somewhat difficult, somewhat easy, or very easy? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling Very Easy 20%21% 17%21% 20%22% Somewhat Easy 33%43%27%29%38%46%38%22% Somewhat Difficult 33%26%38%36%28%21%28%41% Very Difficult 14%11%14%17%14%13%14%16%

Sufficiency of Program Assistance 26 Do you feel as though the CAMP/GRAD program provides enough help for you to be able to pay your monthly BGE bill on- time? CAMPGRAD ALL Double Credit Payment Counseling Credit & Counseling Discount Discount & Audit Discount & Counseling Yes67%75%65%60%75%83%75%62% No25%19%23%34%14%9%15%24% Don’t know 8%7%12%7%10%8%11%14%

Survey Findings Many customers don’t understand program –Only 16-25% knew they received bigger credit –65% knew they received discount based on usage –13% recalled payment counseling call –69% recalled audit Reported impacts –Half say they pay bill on time more often –One third to one half say they use less energy –One quarter say they participated in another program High program satisfaction 27

USAGE IMPACTS 28

CAMP Electric Baseload Impacts 29 Treatment GroupGross SavingsNet Savings # Pre- Use Post- Use kWh % Savings kWh % Savings ALL CAMP3818,2647,996269**3%-17>-1% 1 – DOUBLE CREDIT 1408,0627, %-139-2% 2 – PAYMENT COUNSELING 1028,2717, %-2>-1% 3 – DOUBLE CREDIT & COUNSELING 1398,4638,083381**5%951% No significant CAMP pilot impacts on electric baseload usage.

CAMP Electric HEATING Impacts 30 Treatment GroupGross SavingsNet Savings # Pre- Use Post- Use kWh % Savings kWh % Savings ALL CAMP15812,48512, %3243% 1 – DOUBLE CREDIT 5911,38210, %577*5% 2 – PAYMENT COUNSELING 4712,51912,50515<1%1331% 3 – DOUBLE CREDIT & COUNSELING 5213,70613,613921%2112% Significant reduction in electric heating usage for double credit only CAMP pilot group.

CAMP Gas Impacts 31 Treatment GroupGross SavingsNet Savings # Pre- Use Post- Use ccf % Savings ccf % Savings ALL CAMP **-6%-11-1% 1 – DOUBLE CREDIT **-6%-8-1% 2 – PAYMENT COUNSELING ,014-65**-7%-22-2% 3 – DOUBLE CREDIT & COUNSELING **-6%-8-1% No significant CAMP pilot impacts on gas usage.

GRAD Electric Baseload Impacts 32 Treatment GroupGross SavingsNet Savings # Pre- Use Post- Use kWh % Savings kWh % Savings ALL GRAD3708,8738,495378**4%931% 1 – CREDITS1349,0368,599437**5%1522% 2 – CREDITS & AUDIT 1148,8528, %-129-1% 3 – CREDITS & COUNSELING 1228,7138,192521**6%2363% No significant GRAD pilot impacts on electric baseload usage.

GRAD Electric Baseload Impacts By Pre-Treatment Usage 33 Treatment GroupGross SavingsNet Savings #Pre-UsePost-UsekWh% % ALL GRAD3708,8738,495378**4%931% <716 kWh1414,8394,814251%-260-5% ,0138,605408**5%1221% > ,18314,281902**6%617**4% Significant reduction in electric baseload usage for highest pre- usage GRAD pilot group.

GRAD Electric Heating Impacts 34 Treatment GroupGross SavingsNet Savings #Pre-UsePost-UsekWh% % ALL GRAD14913,53113,125405**3%524**4% 1 – CREDITS6012,98312,477505*4%624*5% 2 – CREDITS & AUDIT4514, %5574% 3 – CREDITS & COUNSELING 4412,96512, %3533% Significant reduction in electric heating usage for all GRAD pilot and credit only group.

GRAD Electric Heating Impacts By Pre-Treatment Usage 35 Treatment GroupGross SavingsNet Savings #Pre-UsePost-UsekWh% % ALL GRAD 14913,53113,125405**3%524**4% <716 kWh 234,8665, *-11%-404-8% kWh 438,6928, %2453% >1726 kWh 8318,43917,632807**4%926**5% Significant reduction in electric heating usage for highest pre-usage GRAD pilot group.

GRAD Gas Impacts 36 Treatment GroupGross SavingsNet Savings #Pre-UsePost-Useccf% % ALL GRAD **-4%3<1% 1 – CREDITS **-5%>-1% 2 – CREDITS & AUDIT %35*4% 3 – CREDITS & COUNSELING **-7%-24-3% Significant reduction in gas usage for credit and audit GRAD pilot group.

Usage Impact Summary CAMP –Double credit only electric heaters: 5% electric usage reduction. GRAD –Highest non-electric heating users: 4% electric baseload reduction. –Electric heaters: 4% electric usage reduction. –Electric heaters, credit only: 5% electric usage reduction. –Highest electric heating users: 5% electric usage reduction. –Credits and audit group: 4% gas usage reduction. 37

ARREARAGE IMPACTS 38

CAMP Arrearage Impacts 39 Treatment Group Net Change #PrePost Gross Change All CAMP566$197$230$33**-$60** 1 – Double Credits204$181$202$21-$72** 2 – Payment Counseling160$187$216$29-$64 3 – Credits & Counseling202$220$268$48*-$45

GRAD Arrearage Impacts 40 Treatment Group Net Change #PrePost Gross Change ALL GRAD561$276$251-$26**-$119** 1 – Graduated Discount213$257$254-$3-$96** 2 – Discount &Audit170$332$289-$43*-$136** 3 – Discount & Counseling178$246$210-$36**-$129**

COLLECTIONS IMPACTS 41

CAMP Collections Impacts 42 Treatment Group Net Change #PrePost Gross Change Turn Off Notice As Most Severe Collections Action All CAMP44543%39%-5%**<1% 1 – Double Credits15844%41%-4%1% 2 – Payment Counseling12243%34%-10%**-5% 3 – Credits & Counseling16542%41%-2%3% Field Call As Most Severe Collections Action All CAMP4454% 0%-4%* 1 – Double Credits1584%1%-3%-6%* 2 – Payment Counseling1224%7%2%-1% 3 – Credits & Counseling1654%5%1%-3%

GRAD Collections Impacts 43 Treatment Group Net Change #PrePost Gross Change Turn Off Notice As Most Severe Collections Action ALL GRAD48459%49%-10%**-5%** 1 – Graduated Discount17961%50%-12%**-7%* 2 – Discount &Audit15358%51%-7%*-2% 3 – Discount & Counseling15259%47%-12%**-7% Field Call As Most Severe Collections Action ALL GRAD4844%5%1%-3% 1 – Graduated Discount1794%5%1%-3% 2 – Discount &Audit1535%6%1%-3% 3 – Discount & Counseling1523%4%1%-3%

COST EFFECTIVENESS 44

Costs and Benefits CostsBenefits EnrollmentReduction in turn-off notices Payment CounselingReduction in field calls Billing System ModificationReduced carrying costs on arrearages Printing and MailingReduced reserves for arrearages Discounts Evaluation 45 Highlighted items are included in full scale implementation costs.

Net Costs 46 Net Costs (Per Participant) CAMP 1 – Double Credit$44 CAMP 2 – Payment Counseling$71 CAMP 3 – Credit & Counseling$97 GRAD 1 – Discount$239 GRAD 2 – Discount & Audit$256 GRAD 3 – Discount & Counseling$273

RECOMMENDATIONS 47

Pilot Design Self-selection: those who responded to letters enrolled – difficult to extrapolate to all customers. Stratification: done differently for CAMP, GRAD, and comparison group – difficult to estimate and compare results –CAMP: # on-time payments, poverty level –GRAD: # on-time payments, electric usage, arrearages Enrollee tracking: difficult to examine data attrition issues. 48

Administration Data access for DEF payment counselors –Could respond to customer questions –Would not have to refer to BGE Payment timing –Social Security recipients had trouble with payments –Change bill due date to align with benefit payment at customer’s request 49

Customer Education Customers were unaware of program elements Many communication opportunities –Invitation letter –Phone enrollment –Confirmation letter Shorten and simplify written communication 50

Implementation Stratification – represent all customers to be targeted by full scale implementation Customer targeting – target those likely to have beneficial outcome Program potential – examine potential cost savings against potential costs Cost effectiveness – structure payment to be no less than what was paid prior to program 51

Contact Jackie Berger, Ph.D. President and Co-Founder APPRISE 32 Nassau Street, Suite 200 Princeton, NJ