John Grosh Lawrence Livermore National Laboratory July 20, 2017 Panel Session: On the Importance of Benchmarks to Drive Innovation in Grid Modeling John Grosh Lawrence Livermore National Laboratory July 20, 2017

How can we sustain continuing advances in grid modeling, simulation, and analysis? Examples: Power flow modeling Transient stability analysis Production cost modeling Co-simulation Grid Data Grid Tools Computing and Storage

Top500 benchmark has shaped high performance computing < Measuring computer system performance https://www.top500.org/

Top500 benchmark has shaped high performance computing

http://plato.asu.edu/bench.html

Advanced benchmarking research under DARPA HPCS Program HPCS Application Analysis and Assessment, Kepner, J. Kepner and D. Koester, ://www.dtic.mil/dtic/tr/fulltext/u2/a428412.pdf

Benchmarking is not a simple endeavor – careful analysis required! https://www.spec.org/osg/news/articles/news9412/lies.html

How can the grid community establish performance measures for critical calculations? Transient stability analysis targets State-of-the-art Long Term Vision Bus-branch model; transmission buses only Node-breaker model; transmission buses + distribution feeders Model size will increase by 10-10,000 times 10-20 seconds time domain simulation Long-term time domain simulation > 5 minutes and up to several hours ~1000 contingencies Massive contingency analysis cascading events, millions of contingencies 15~30 minutes Wall-clock time Within a dispatch interval < 5 minutes To capture the dynamics from DER and improve visibility of substation To capture the multi-scale dynamics (Wind ramping, AGC, boiler dynamics) To avoid cascading outages and increase grid resilience to HILP events B-B to N-B will be 10X (nodes to ground) B-B – substation would be one node N-B – substation would be 10 connections 10,000 X Who transient stability analysis today: All ISO and utilities for planning studies Advacnced users CAISO and PJM (real time stability in control center from Power Tech) TSA Dynamic behavior of generators and loads Used for post-event analysis (root cause analysis) No common way to understand cascading fauilure Cascading failure Algorithm to analysis what is the starting of events, what is the tree of events Different from TSA … tools to analyze Could use energy function to predict dynamic behavior (other approaches) To enable faster than real-time simulation and meet operational needs Community-recognized benchmarks could be used to shape development of grid modeling and analysis capbilities

Speakers ARPA-E GRID DATA – Challenges and Importance of Benchmarks, Timothy Heidel, NRECA Benchmarking Grid Modernization: Dataset, Model, and Workflow Development, Clayton Barrows, National Renewable Energy Lab Toward Distribution Systems Benchmarks: Large Scale Synthetic Data and Rich Scenario Generation, Bryan Palmintier, National Renewable Energy Laboratory How Benchmarks Drive Innovation and Influence the High-Performance Computing (HPC) Community, Rob Neely, Lawrence Livermore National Laboratory

Goal of panel – explore how to drive innovation in grid tools via benchmarking Discuss the importance of benchmarking for shaping research agenda in computing for the grid  Examine benchmarks used in other fields, how these are developed, and common pitfalls Explore how the grid community might develop and deploy benchmarks