1. 1 PCE 3.2: EPMS-What is it? Do I Need it, Isn’t it DCIM? Steven Shapiro, PE, ATD Mission Critical Practice Lead

2. 2 Each presenter is required to certify that their presentation will be vendor-neutral. As an attendee you have a right to enforce this policy of having no sales pitch within a session by alerting the speaker if you feel the session is not being presented in a vendor neutral fashion. If the issue continues to be a problem, please alert Data Center World staff after the session is complete. Data Center World – Certified Vendor Neutral

3. 3 EPMS: What is it? Do I Need it, Isn’t it DCIM? This presentation will provide an overview of what an EPMS system is and how it is utilized within the data center for operations and forensic applications. Trending of facility KPIs will be discussed as well as how to use the system to determine energy reduction possibilities within the facility.

4. 4 AGENDA What Is EPMS? What Is DCIM? What Is The Difference? What Can It Do For Me? How Does It Work? What Should I Ask For? How Do I Use It Everyday? What Is The Cost Impact?

5. 5 What is EPMS? Electrical Power Monitoring System Monitoring only of Electrical Systems Active One Lines Load Monitoring Battery Monitoring Alarm Monitoring and Notification – Text, Email, Page Data Trending Performance Evaluation Preventative Maintenance Web Page Functionality Forensic Analysis Tool – Millisecond Time Stamping Sequence of Events Recording Synchronized Clocks

6. 6 What is EPMS? Electrical Power Monitoring System Reports to Include: Alarms Sequence of Events – Forensic Reports Dashboard of Facilities Active One Line Incorporation of Aspects Of BMS Monitoring Room Overview Equipment Elevations and Metering RPP Load Distribution Detail BCM Load and Trending Power Strip (MOA) Monitoring And more…

7. 7 What is EPMS? Electrical Power Monitoring System Vendors Include: Schneider Eaton Siemens General Electric ASCO Russelectric And More……..

8. 8 What is DCIM? Data Center Infrastructure Management Rack Inventory Rack Temperatures, Airflow, and Security Server Utilization Connectivity BCM UPS Monitoring Electrical Systems – General Monitoring Electrical Power Meters – General Monitoring CRAC Status General HVAC Status

9. 9 What is DCIM? Data Infrastructure Management Reports to include: IT Alarms IT Asset Management/Capacity Planning IT Server Utilization Open Space for New IT Assets Dashboard of IT/Dashboard of Facilities Incorporation of Aspects of BMS Monitoring CFD Analysis Room Overview and Room Heat Map Cabinet List and Detail RPP Load Distribution Detail HVAC Equipment List BCM Load and Trending Power Strip (MOA) Monitoring And more… or, less…

10. 10 What is DCIM? Data Center Infrastructure Management Vendors Include: CA Technologies Cormant Eaton Emerson Nlyte - Fieldview Panduit Raritan Schneider Siemens Sunbird And More……..

11. 11 EPMS Implementation Guidelines Reliability Assure Economical Operation Ease of Replacement of Failed Components and Systems Distribution of Monitoring Devices

12. 12 EPMS Implementation Guidelines Perform Bid Leveling and Conduct Vendor Interviews Review EPMS Shop Drawing Submittals Perform Factory Witness Tests Maximize the Performance of Selected Product During System Startup Provide Customer Support During and After Successful Project Completion

13. 13 EPMS Implementation Guidelines Specification Development System Hardware / Software Requirements Device Specifications Sequence of Operations Point Lists EPMS Controls Network Architecture Schematics

14. 14 Operations Review MV Switchgear Diesel Generator Switchgear Substations UPS Modules UPS Systems Critical Output Switchgear PDUs RPPs Multi-Outlet Assemblies at Racks

15. 15 EPMS Devices Power Quality Meters Solid State MV Relays Solid State Trip Units Dry/Wet Relay Contacts Millisecond Time Stamping Devices Branch Circuit Monitoring GPS time Synchronization PLCs Servers UPS

16. 16 EPMS Says What and How? What Modbus - Modicon in 1979, master/slave configurations BACnet – Proposed in 1987 but not really accepted until 1996, (Building Automation Control network), designed specifically to manage building applications like HVAC and lighting OPC – OLE for process control, based on Microsoft OLE/COM Technology, Cross platform Web Services. Contact Closure – On/Off Relays, typically legacy equipment SNMP - (Simple Network Management Protocol), more in the IT domain XML – (Extensible Markup Language), structured data across different information systems SOAP LON How Wiring RS-485 – twisted pair, daisy chain, master/slave, 35 mbit/s up to 10 m and 100 kbit/s at 1200 mkbit/s RS-232 – point to point, slow

17. 17 EPMS Block Diagram

18. 18 EPMS Block Diagram

19. 19 EPMS Block Diagram Main Distribution Switchgear and Diesel Generator Switchgear

20. 20 EPMS Block Diagram Substation Serving UPS Systems

21. 21 EPMS Block Diagram UPS Output Board

22. 22 EPMS Block Diagram Network Concept

23. 23 EPMS Block Diagram Typical EPMS RACK Configurations Distributed Racks for Servers and Connectivity

24. 24 Active One Line Software Capabilities

25. 25 Software Capabilities One Millisecond Time Resolution

26. 26 Software Capabilities Energy usage comparison screen Energy usage patterns can be effortlessly analyzed with the month-to- month, week-to-week comparison chart. Compare energy consumption for any month-to-month or week-to-week combination Set benchmark for energy consumption Compare weeks & months Built-in trend analysis Open energy data log in Excel or Save data to a CSV-file for exporting This was a Friday

27. 27 Software Capabilities Historical trend plot Integral Meter Web Server supports graphical trend charts of key circuit measurements, such as current, voltage, power and energy.

28. 28 Software Capabilities What is ITIC? (2000 -) Information Technology Industry Council Developed in collaboration with EPRI’s Power Electronics Application Center (PEAC) More accurately reflects the performance of IT equipment

29. 29 Software Capabilities Area above black line is the Equipment Disruption & Damage Region! Transients counter – silent killers equivalent to “high blood pressure” L2, L4 and L8 Swells counters L2, L4 and L8 Sags counters ITIC Legend

30. 30 Software Capabilities Power Quality and Analysis

31. 31 Software Capabilities Harmonic spectral plot The harmonic spectral plot displays both harmonics and interharmonics up to the 85 th order. STEP 1 Check the “PQ temperature” STEP 2 – get the details Zoom(1) 5Hz resolution Zoom(2) 1-27th harmonic Zoom(3) 1-85th harmonic

32. 32 Capacity Report Review 5 top loaded circuits at-a-glance: Avoid unscheduled shutdowns due to circuit overloading Review 5 bottom loaded circuits at-a-glance: No-load losses are primary contributors to Data Center electrical costs. Check minimum, average and maximum loading at- a-glance: Is this normal volatility, or not? Identify and mitigate abnormal activity.

33. 33 Capacity Report Circuit Utilization by Device Review circuit utilization at-a-glance: Check on minimum, average and maximum circuit utilization. Understand Hourly Trends at-a-glance: Detect abnormal trend activity.

34. 34 Branch Circuit Monitoring Report Color-coded Graphics alert you to potential issues: Red and yellow colors are used to indicate areas of concern, when closing in on branch circuit overloading. Key parameters are clearly indicated in kVA, kW and Amps

35. 35 Branch Circuit Monitoring Report Continued… Review and understand Side Balances per Phase: How well balanced is your equipment? Power Graphs draw attention to trends immediately: Quickly pinpoint hourly power usage trends. Why do sudden increases, decreases occur at certain times? Color-coded bar charts point out trend variations per Phase: Is this normal volatility, or not? Identify and mitigate abnormal activity.

36. 36 Energy Summary Report – Get a baseline, identify opportunities & verify savings Track and compare hourly consumption: How does this facility compare with our other facility? Why is there a difference and should, can it be mitigated? Compare Totals side by side, identify savings opportunities: “East Campus’ energy saving investments are really kicking in!” Summary of total energy consumption and peak demand per facility/location

37. 37 Cost Allocation Report How $$$ much is your energy bill? Allocate costs where they belong. Allocate costs between departments and facilities? Slice, dice and distribute costs where they belong How much is energy costing you? Get total kWh and costs of energy clearly in dollars and cents! Let Power Xpert Reporting do the math: Create formulas to add up consumption and costs. Which facility is frugal, which one consumes the lions share? Mini Pie Charts, in addition to numbers, help get the big picture at-a-glance.

38. 38 Power Quality Report (Current) Identify reoccurring trends, focus on the important ones Pareto Chart points you in the right direction: The chart clearly displays the relative significance of readings, helping to focus on what is important. Statistical Analysis of current: Get minimum, average, maximum and standard deviation analyzed automatically. Identify power consumption patterns: Cross-reference current with time and discover consumption patterns for potential savings opportunities.

39. 39 Power Quality Report (Voltage) Identify reoccurring trends, focus on the important ones Statistical Analysis of voltage: Get minimum, average, maximum and standard deviation analyzed automatically. Pareto Chart points you in the right direction: The chart clearly displays the relative significance of readings, helping to focus on what is important. Identify power consumption patterns: Cross-reference voltage with time and discover consumption patterns for potential savings opportunities

40. 40 Event Summary Report Identify event type: Easily identify if the worst offender is a transient, sag, swell or other power event. And what is the level of severity Identify what event is the worst offender: Review which events keep reoccurring and cause the most problems. Ranking provides a clear laundry list for mitigation opportunities. Pareto Chart points out locations, devices hit worst: The chart clearly displays the relative significance of locations and devices, helping to focus on what is important i.e. putting in TVSS systems for the Chiller Plant would maximize the total reduction of power quality problems. Identify power problem time patterns: Is there a pattern to when power quality or certain events hit? Are some months and times worse than others? Do precautions or mitigating actions need to be put in place?

41. 41 Solution: Sequence of Event Recording System 1 ms time-stamped events using GPS Pinpoint relay mis-coordination Proof of commissioning FIX IT SO IT DOES NOT HAPPEN AGAIN. Antenna STR-100 DCF-77 IRIG-B unmodulated 32 point ProTime Card

42. 42 Solution: Sequence of Event Recording System Event Log

43. 43 Summary A reliable, fast, flexible EPMS is the foundation of any data center monitoring endeavor. Energy efficiency: DCE/PUE, utility bill verification, cost allocation, and reporting Alarm reporting and notification Forensic Analysis Generator emissions monitoring and reporting *Credit for many photos and information to Schneider and Eaton.

44. 44 5 Key Things You Have Learned During this Session 1.Overview of EPMS Functionality 2.EPMS is NOT DCIM 3.You Will Need Both 4.EPMS Design Guidelines 5.EPMS Design Activities

45. 45 Thank You Steven Shapiro, PE, ATD Mission Critical Practice Lead (914) 420-3213 sshapiro@morrisonhershfield.com http://www.linkedin.com/in/stevenshapirope @stevenshapirope