Presentation for the 7th ITU Symposium on ICTs, the Environment and Climate Change Greening ICT Infrastructures Session 5/30/12 Dr. Gregory Hidley California Institute for Telecommunications and Information Technology, University of California at San Diego (UCSD) Project GreenLight

ICT is a Key Sector in the Fight Against Climate Change Applications of ICT could enable emissions reductions of 7.8 Gt CO 2 e in 2020, or 15% of business as usual emissions. But it must keep its own growing footprint in check and overcome a number of hurdles if it expects to deliver on this potential.

Application of ICT Can Lead to a 5-Fold Greater Decrease in GHGs Than its Own Carbon Footprint Major Opportunities for the United States* – Smart Electrical Grids – Smart Transportation Systems – Smart Buildings – Virtual Meetings * Smart 2020 United States Report Addendum “While the sector plans to significantly step up the energy efficiency of its products and services, ICT’s largest influence will be by enabling energy efficiencies in other sectors, an opportunity that could deliver carbon savings five times larger than the total emissions from the entire ICT sector in 2020.” --Smart 2020 Report

Project GreenLight Motivation: The CyberInfrastructure (CI) Problem Compute energy/rack : 2 kW (2000) to 30kW+ in 2012 Cooling and power issues were becoming a major factor in CI design IT industry is “greening” huge data centers … but today every $1 spent on local IT equipment will cost $2 more in power and overhead Academic CI is often space constrained at departmental scale Energy use of growing departmental facilities is creating campus crises of space, power, and cooling Unfortunately, little was known about how to make shared virtual clusters energy efficient, since there has been no campus financial motivation to do so Challenge: how to make data available on energy efficient deployments of rack scale hardware and components?

The NSF-Funded GreenLight Project Giving Users Greener Compute and Storage Options PI is Dr. Thomas A. DeFanti $2.6M over 3 Years to construct GreenLight Instrument – Start with instrumented Sun Modular Data Centers Sun Has Shown up to 40% Reduction in Energy Measures Temperature at 5 Levels in 8 Racks Measures power Utilization in Each of the 8 Racks Chilled Water Cooling input and output temperatures – Add additional power monitoring at every receptacle – Add web and VR interfaces to access measurement data Populate with a variety of computing clusters and architectures – Traditional compute and storage servers – GP GPU arrays and specialized FPGA based coprocessor systems – DC powered servers – SSD equipped systems Turn over to investigators in various disciplines Measure, Monitor and Collect Energy Usage data – With the goal of maximizing work/watt

The GreenLight Project: Instrumenting the Energy Cost of Computational Science Focus on 5 Communities with At-Scale Computing Needs: – Metagenomics – Ocean Observing – Microscopy – Bioinformatics – Digital Media Measure, Monitor, & Web Publish Real-Time Environmental Sensor Output – Via Service-oriented Architectures – Allow Researchers Anywhere To Study Computing Energy Cost – Enable Scientists To Explore Tactics For Maximizing Work/Watt Develop Middleware that Automates Optimal Choice of Compute/RAM Power Strategies for Desired Greenness Teach future engineers who must scale from an education in Computer Science to a deeper understanding in engineering physics Source: Tom DeFanti, Calit2; GreenLight PI

GreenLight Research activities Leading to Greener CI Deployments Computer Architecture – FPGA, GP GPU systems – Rajesh Gupta/CSE Software Architecture – Virtualization, memory management, networking and modeling – Amin Vahdat, Ingolf Kruger/CSE CineGrid Exchange – mixed media storage, streaming, and management – Tom DeFanti/Calit2 Visualization – Using 2D and 3D modeling on display walls and CAVEs – Falko Kuster/Structural Engineering, Jurgen Schulze/Calit2 Power and Thermal Management – Tajana Rosing/CSE DC Power Distribution – Greg Hidley/Calit2

Calit2/UCSD [ Monitoring, Modeling and Management

Situational Awareness Calit2/UCSD [ “Tap” for details “Tap” for details Dashboard interface Power utilization Multiple perspectives Enterprise reach

Datacenter vitals Calit2/UCSD [ Input/Output sampling Input/Output sampling Live/Average data Live/Average data Live Temperature Live/average Fan speeds Environmentals Heat Exchangers

Domain specific views Calit2/UCSD [ Control elements Real-time heatmap Realistic models

Airflow dynamics Calit2/UCSD [ Live fan speeds Live fan speeds Airflow dynamics

Heat distribution Calit2/UCSD [ Combined heat + fans Realistic correlation

Heat Trends Calit2/UCSD [ Trends over past 24h Heat exchangers Hotspot identification

Past changes in airflow Calit2/UCSD [ Fan slices rpm Fan slices rpm Potential for failures Trends over past 24h Heat distribution changes

Power spikes Calit2/UCSD [ minute resolution 1 minute resolution Unused asset Average load IT assets Peak computation Computation zone

Zoom-in Analysis Calit2/UCSD [ 17 History over several days. Zoom on desired time range. Hint on each sample point. Automatic average area. Multiple sensors per asset with up to 1 min sampling resolution.

DC Power: UCSD is Installing Solar and Fuel Cell DC Electricity Generators San Diego’s Point Loma Wastewater Treatment Plant Produces Waste Methane UCSD 2.8 Megawatt Fuel Cell Power Plant Uses Methane 2 Megawatts of Solar Power Cells at UCSD, 1 MW to be Installed off campus