1. Data Center Energy Efficiency Sonoma Mountain Village November 29, 2007 William Tschudi wftschudi@lbl.gov

2. Acknowledgement of LBNL sponsors California Energy Commission – PIER program California Energy Commission – PIER program Pacific Gas and Electric Company Pacific Gas and Electric Company New York State Energy and Development Agency (NYSERDA) New York State Energy and Development Agency (NYSERDA) US - Environmental Protection Agency US - Environmental Protection Agency US – Department of Energy US – Department of Energy

3. Energy Commission 101 The state’s primary energy policy and planning agency charged with:  Licensing thermal power plants 50 megawatts and larger  Adopting appliance and building energy efficiency standards  Forecasting state energy use  Maintaining energy information and performing analysis  Proposing to the Governor integrated state energy policies  Conducting public interest energy research

4. PIER Program Established in California by legislation in 1997 Established in California by legislation in 1997 $62.5 million collected annually from investor-owned electricity utility ratepayers for “public interest” energy research, development and demonstration (RD&D) projects $62.5 million collected annually from investor-owned electricity utility ratepayers for “public interest” energy research, development and demonstration (RD&D) projects

5. PIER Program Objectives Improve energy cost/value Improve energy cost/value Improve environment, public health, and safety Improve environment, public health, and safety Improve electricity reliability/quality/sufficiency Improve electricity reliability/quality/sufficiency Strengthen the economy Strengthen the economy Provide consumer choice Provide consumer choice Address research gaps Address research gaps

6. PIER Segments of Research Buildings End-Use Energy Efficiency Buildings End-Use Energy Efficiency Energy-Related Environmental Research Energy-Related Environmental Research Energy Systems Integration Energy Systems Integration Environmentally-Preferred Advanced Generation Environmentally-Preferred Advanced Generation Industrial/Agricultural/Water End-Use Energy Efficiency Industrial/Agricultural/Water End-Use Energy Efficiency Renewable Energy Technologies Renewable Energy Technologies Climate Change Program Climate Change Program Transportation Research Transportation Research

7. Data Center research activities Research Roadmap Research Roadmap Benchmarking and 23 data center case studies Benchmarking and 23 data center case studies Self-benchmarking protocol Self-benchmarking protocol Power supply efficiency study Power supply efficiency study UPS systems efficiency study UPS systems efficiency study Standby generation losses Standby generation losses Performance metrics – Computation/watt Performance metrics – Computation/watt EPA report to Congress EPA report to Congress DOE Save Energy Now program DOE Save Energy Now program

8. Energy efficiency varies There are many features in data center design and operation that must all be optimized in order to achieve highest efficiency There are many features in data center design and operation that must all be optimized in order to achieve highest efficiency There is no silver bullet There is no silver bullet Changing paradigms may be necessary Changing paradigms may be necessary –DC power (Edison was right!) –Liquid cooling –Use of outside air for cooling

9. Server Load/ Computing Operations Cooling Equipment Power Conversion & Distribution Alternative Power Generation High voltage distribution Use of DC power Highly efficient UPS systems Efficient redundancy strategies Load management Server innovation Energy efficiency opportunities are everywhere Better air management Move to liquid cooling Optimized chilled-water plants Use of free cooling On-site generation Waste heat for cooling Use of renewable energy/fuel cells

10. Benchmark results helped to find best practices The ratio of IT equipment power to the total (or its inverse) is an indicator of relative overall efficiency. Examination of individual systems and components in the centers that performed well helped to identify best practices.

11. Ratio of electricity delivered to IT equipment Average.57 Higher is better Source: LBNL Benchmarking

12. Performance varies The relative percentages of the energy actually doing computing varies considerably.

13. Best HVAC Practices Air Management Air Management Air Economizers Air Economizers Humidification Control Humidification Control Centralized Air Handlers Centralized Air Handlers Low Pressure Drop Systems Low Pressure Drop Systems Fan Efficiency Fan Efficiency Cooling Plant Optimization Cooling Plant Optimization Water Side Economizer Water Side Economizer Variable Speed Chillers Variable Speed Chillers Variable Speed Pumping Variable Speed Pumping Direct Liquid Cooling Direct Liquid Cooling

14. Best Electrical Practices UPS systems UPS systems Self-generation Self-generation AC-DC distribution AC-DC distribution Standby generation Standby generation

15. Sonoma climate and efficiency Grapes aren’t the only thing that benefits from this climate Grapes aren’t the only thing that benefits from this climate Majority of cooling can be achieved without chillers Majority of cooling can be achieved without chillers

16. Most hours of the year can be cooled without chillers

17. LEED TM criteria and data centers The US Green Building Council established LEED criteria for commercial buildings The US Green Building Council established LEED criteria for commercial buildings Points are given for sustainable elements Points are given for sustainable elements –e.g. bikeracks, bamboo floors, waterless urinals While these are wonderful to consider for any building, the real action in data centers is with energy and water consumption While these are wonderful to consider for any building, the real action in data centers is with energy and water consumption A different point rating system is needed A different point rating system is needed

18. LEED TM type criteria points for data centers LBNL and industry are developing proposed criteria to be used in ranking data centers LBNL and industry are developing proposed criteria to be used in ranking data centers Consider different metrics: Consider different metrics: –Ratio of IT power to total power –Efficiency of power delivery –Efficiency of chilled water plant –Air management effectiveness –Environmental conditions –Mission of the data center –etc. Completion planned for August, 2008 Completion planned for August, 2008

19. LEED TM type criteria development Green Grid, Uptime Institute, ASHRAE, Critical Facilities Roundtable Green Grid, Uptime Institute, ASHRAE, Critical Facilities Roundtable EPA and DOE supportive EPA and DOE supportive Other industry input welcome Other industry input welcome

20. LBNL data center demonstrations “Air management” demonstration Outside air economizer demonstration Use of infrared thermography DC powering demonstration Silicon Valley Leadership Group – “chill-off”

21. Measured fan energy savings – 75% If mixing of cold supply air with hot return air can be eliminated- fan speed can be reduced

22. Better temperature control can allow raising the temperature in the entire data center! ASHRAE Recommended Range Ranges during demonstration

23. See the problem areas Infrared thermography and CFD modeling can be used as visualization tools

24. Inverter InOut Bypass Battery/Charger Rectifier Internal Drive External Drive I/O Memory Controller  Processor SDRAM Graphics Controller DC/DC AC/DC DC/DC AC/DC Multi output PS Voltage Regulator Modules 5V 12V 3.3V 12V 1.5/2. 5V 1.1V- 1.85V 3.3V 12V PWM/PFC Switcher Unregulated DC To Multi Output Regulated DC Voltages Data center power conversions AC voltage conversions

25. With over 25 industry partners direct DC powering of servers was demonstrated

26. Typical AC distribution today 480 Volt AC

27. Facility-level DC distribution 380V.DC 480 Volt AC

28. AC system loss compared to DC AC system loss compared to DC 7-7.3% measured improvement 2-5% measured improvement Rotary UPS

29. Challenge Can Sonoma Mountain Village’s data center demonstrate these energy saving technologies? Can Sonoma Mountain Village’s data center demonstrate these energy saving technologies? LBNL is seeking partnering sites to demonstrate DC power LBNL is seeking partnering sites to demonstrate DC power

30. Thank you website:http://hightech.lbl.gov/datacenters/