1. Measuring changes in energy behaviours in complex non-domestic buildings Paula Morgenstern UCL Energy Institute Supervision: Paul Ruyssevelt Rokia Raslan

2. Staff-centered energy conservation Potential Realised success Intervention Organisation Individual Evaluation

3. Challenges for evaluation Methodology Complexity of building energy use Non-energy effects

4. RQ: To what extent can effects of behaviour changes be detected through the analysis of energy consumption profiles in complex buildings given the daily variability in activities and resulting energy use itself?

5. Case study Investigation of the evaluation of an energy awareness campaign at a large UK acute hospital Intervention approach: 1.‘Carbon Champions’ at ward level 2.Rewards for successful champions and teams 3.Senior management endorsement Close involvement from January to May 2013 in analysing the hospital’s electricity use over the course of the campaign

6. Analysis of departmental electricity use kWh/d as useful metric based on four weeks of pre and post campaign data

7. Analysis: Inclusion criteria  Identifying statistically significant changes in mean daily electricity use I. International Performance Measurement and Verification Protocol (IPMVP): ‘savings need to be larger than twice the standard error (…) of the baseline value’

8. Analysis: Inclusion criteria II II. More conservative estimate: Savings statistically valid if they exceed twice the sum of the standard error of both baseline and post-intervention value III. Repeated measures t-test Pre and post sets differ at significance level 0.05

9. Comparison of analysis approaches >> Results of the different analysis approaches differ as much as the actual effect size of the energy awareness campaign was thought to be across the whole hospital # of areas meeting inclusion criteria Average campaign effect size across the whole hospital Control: All metered areas 49 X % Inclusion criteria I 35 1.3*X% Inclusion criteria II 18 1.5*X% Inclusion criteria III 20 2.5*X%

10. Looking behind headline figures Detailed analysis of consumption profiles Observations

11. Discussion Importance of methodology used to estimate energy savings  so far no standardised methodologies Discussion needed between campaign developers, building operators and independent evaluators Can individual energy behaviours reliably be placed within the context of total building energy use in complex non-domestic buildings?

12. Intermediate performance indicators? Specific Impact orientated Systematically recorded

13. Going forward I Improving the understanding in complex buildings  Increased monitoring in detail Building energy use Energy behaviours

14. Going forward II Promoting learning through honest accounts of what worked and what did not in both design and implementation of initiatives Headline reporting What worked?

15. Questions or comments? Thank you for your attention.