1. 2004-2005 Statewide Building Operators Certification and Training Program Evaluation Prepared for California’s Investor-Owned Utilities: Pacific Gas and Electric Company San Diego Gas and Electric Company Southern California Edison Company Southern California Gas Company MAESTRO Workshop – July 27, 2006 Presented By: Jane S. Peters, Ph.D.

2. 07/27062004-2005 Statewide Building Operator Certification and Training Program2 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Advisory Committee C Project Advisory Committee Members: Beatrice Mayo (Chris Ann Dickerson) –Statewide Lead, Pacific Gas and Electric Company Carol Yin –Southern California Edison Brenda Gettig –SEMPRA

3. 07/27062004-2005 Statewide Building Operator Certification and Training Program3 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 What is the BOC Program? C Building Operator Certification & Training Program C 8 days of instruction on O&M techniques for Optimal building performance Energy efficiency Occupant comfort

4. 07/27062004-2005 Statewide Building Operator Certification and Training Program4 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 What is the BOC? C Training provided by Northwest Energy Efficiency Council (NEEC) under contract to California utilities C Launched In California in 2002 15 Level I series in 2004- 2005 3 Level II series in 2004- 2005

5. 07/27062004-2005 Statewide Building Operator Certification and Training Program5 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Evaluation Method C Build on Previous Findings Showing High Levels of Satisfaction Two prior California studies Two Northeast studies Seven Northwest studies C Three of the studies estimated energy impacts

6. 07/27062004-2005 Statewide Building Operator Certification and Training Program6 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Evaluation Method C Analysis of Interview Data 58 Participating Students 25 Supervisors of Students 58 Nonparticipating Supervisors 17 Utility and BOC Staff and Instructors

7. 07/27062004-2005 Statewide Building Operator Certification and Training Program7 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students and Supervisors Are Highly Satisfied C 90% report satisfaction Same as prior evaluations C The less-satisfied students Are those with the most experience Desire a more advanced course

8. 07/27062004-2005 Statewide Building Operator Certification and Training Program8 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students and Supervisors Are Highly Satisfied C 93% of students report using concepts they’ve been taught 75% of supervisors report BOC-trained operators have saved energy, money, and increased comfort C 80% of students report greater confidence in their ability to provide “demand response”

9. 07/27062004-2005 Statewide Building Operator Certification and Training Program9 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Course Locations and Student Commutes C MapQuest ® was used to analyze distances between students’ workplaces and training locations C Shortest commute: Oakland—8 minutes (median) C Longest commute: Stockton—52 minutes (median) C Commutes within the LA area varied the most: Oxnard—17 minutes (median) Ontario—39 minutes (median)

10. 07/27062004-2005 Statewide Building Operator Certification and Training Program10 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 But Does the BOC Do Anything? ?

11. 07/27062004-2005 Statewide Building Operator Certification and Training Program11 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Evaluation Focused on O&M Actions C Students and nonparticipants reported whether they took 12 specific O&M actions: At least as often as every few months Every six months Every year Every few years Never C Students reported on their own actions; nonparticipants reported on actions of themselves or their staff

12. 07/27062004-2005 Statewide Building Operator Certification and Training Program12 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Check the Boiler Combustion System More Often StudentsNonparticipants

13. 07/27062004-2005 Statewide Building Operator Certification and Training Program13 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Inspect Steam Traps More Often StudentsNonparticipants

14. 07/27062004-2005 Statewide Building Operator Certification and Training Program14 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Test for Proper Damper Modulation More Often StudentsNonparticipants

15. 07/27062004-2005 Statewide Building Operator Certification and Training Program15 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Check & Recalibrate Chilled Water Loop Controls More Often StudentsNonparticipants

16. 07/27062004-2005 Statewide Building Operator Certification and Training Program16 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Lubricate Motor, Fan, and Pump Bearings More Often StudentsNonparticipants

17. 07/27062004-2005 Statewide Building Operator Certification and Training Program17 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Inspect Fan and Pump Motor Belt Alignments & Bearings More Often StudentsNonparticipants

18. 07/27062004-2005 Statewide Building Operator Certification and Training Program18 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Inspect the Compressed Air System for Leaks More Often StudentsNonparticipants

19. 07/27062004-2005 Statewide Building Operator Certification and Training Program19 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Monitor Compressed Air Systems More Often StudentsNonparticipants

20. 07/27062004-2005 Statewide Building Operator Certification and Training Program20 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Appear to Check Settings on Packaged AC Units More Often StudentsNonparticipants

21. 07/27062004-2005 Statewide Building Operator Certification and Training Program21 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students Appear to Check for Leaks in Air Ducts More Often StudentsNonparticipants

22. 07/27062004-2005 Statewide Building Operator Certification and Training Program22 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students and Nonparticipants Are Similar in Cleaning Chiller Tubes StudentsNonparticipants

23. 07/27062004-2005 Statewide Building Operator Certification and Training Program23 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Students and Nonparticipants Are Similar in Adjusting VFDs to Match Loads StudentsNonparticipants

24. 07/27062004-2005 Statewide Building Operator Certification and Training Program24 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Conclusions C BOC is a mature program Mature curriculum Mature delivery process C BOC participants are highly satisfied C Course locations are good C BOC training increases the energy- efficiency actions of building operators Four studies using different self-report methods have reached this conclusion

25. 07/27062004-2005 Statewide Building Operator Certification and Training Program25 2004-2005 Statewide Building Operator Certification and Training Program: MPER #3 Recommendations C “Stay the course” in program implementation Program implementers already recognize the need for expanded marketing C Design and fund impact evaluation to meet California protocols Consider training the entire staff of a large facility, with pre- and post-metering of key end-uses