PCWG Intelligence Sharing Initiative 10 August 2016 NREL, Colorado, US.

Slides:



Advertisements
Similar presentations
© NHS Institute for Innovation and Improvement, 2012 Baseline Data Collection Guide for Project Managers and Facilitators updated Feb 2012.
Advertisements

A short Introduction to the Ideas of the Algorithm used in MVQCA
Evaluation of a Scalable P2P Lookup Protocol for Internet Applications
CASPA Comparison and Analysis of Special Pupil Attainment SGA Systems SGA Systems Limited A brief overview of CASPA's graphs and reports.
1 H2 Cost Driver Map and Analysi s Table of Contents Cost Driver Map and Analysis 1. Context 2. Cost Driver Map 3. Cost Driver Analysis Appendix A - Replica.
PCWG 9 th Meeting: 12 December Glasgow Introduction, Agenda and Review of Actions.
Celso Ferreira¹, Francisco Olivera², Dean Djokic³ ¹ PH.D. Student, Civil Engineering, Texas A&M University ( ² Associate.
Experimental Uncertainties: A Practical Guide What you should already know well What you need to know, and use, in this lab More details available in handout.
PCWG 9 th Meeting December Glasgow PCWG 2015 Roadmap: Detailed Survey Results.
PCWG 9 th Meeting: 12 December Glasgow Proposed PCWG Data Sharing Initiative.
Generation of atlas graphs & charts. Objective The major objective this training session is to equip participants with the knowledge and skills of creating.
Pet Fish and High Cholesterol in the WHI OS: An Analysis Example Joe Larson 5 / 6 / 09.
Slide 1 Testing Multivariate Assumptions The multivariate statistical techniques which we will cover in this class require one or more the following assumptions.
Handling Data and Figures of Merit Data comes in different formats time Histograms Lists But…. Can contain the same information about quality What is meant.
1 Aircraft Data: Geographic Distribution, Acquisition, Quality Control, and Availability Work at NOAA/ESRL/GSD and elsewhere.
Power Curve Working Group Update New Orleans 15 th September 2015.
StAR web server tutorial for ROC Analysis. ROC Analysis ROC Analysis: This module allows the user to input data for several classifiers to be tested.
Experimental Design. Experimental Investigation The organized procedure used to study an aspect of the natural world under controlled conditions.
SHINE SEP Campaign Events: Long-term development of solar corona in build-up to the SEP events of 21 April 2002 and 24 August 2002 A. J. Coyner, D. Alexander,
EXPERIMENTAL DESIGN Science answers questions with experiments.
Power Curve Working Group Update Roskilde 26 th June 2015.
A New Theoretical Basis for Describing Low Turbulence Wind Turbine Performance Peter Stuart PCWG Meeting – 26 June 2015.
MEASURE : Measurement System Analysis
The National Student Survey (NSS) 2015 University of Edinburgh – Initial Findings Student Surveys Unit 7 th August
Sensitivity Analysis A systematic way of asking “what-if” scenario questions in order to understand what outcomes could possibly occur that would effect.
Physics 2.1 AS Credits Carry out a practical physics investigation that leads to a non- linear mathematical relationship.
PCWG 15 th Meeting December 2015 – Kings Langley PCWG 2016 Roadmap: Detailed Survey Results.
PCWG-Share-01 Initial Results PCWG Meeting Kings Langley 9 th December 2015 Peter Stuart (RES), Lee Cameron (RES), Alex Clerc (RES) & Andy Clifton (NREL),
8th October Aarhus PCWG-Share-01 Introduction.
Del Mar College Utilizing the Results of the 2007 Community College Survey of Student Engagement CCSSE Office of Institutional Research and Effectiveness.
Understanding the Power Curve Interpolation Issue Power Curve Working Group, , Hamburg Axel Albers.
Multi-Interval Real-Time Market (MIRTM) Updates SAWG Sean Chang Market Analysis February 22, 2016 ERCOT Public Version
PCWG-Share-01 Current Status PCWG Meeting Hamburg 10 th March 2016 Peter Stuart (RES) and Andy Clifton (NREL), on behalf of the Power Curve Working Group.
IEC Ed 2 Collaboration IEA Task 32 Round Robin & PCWG Worked Examples NREL, Colorado, US 10 th August 2016 IEC Task 32: Luke J Simmons (DNV GL)
PCWG 2016 Update 20th May 2016 Peter Stuart.
IEC FDIS 2016 Worked Example Industrial Project
PCWG 2016 Update Wednesday, 13 December 2016 Glasgow, Scotland
Chapter 4 PowerPoint Spreadsheet Analysis.
IEC FDIS 2016 Worked Examples Ellie Weyer, AWS True Power
PCWG Intelligence Sharing Initiative Update
PCWG Intelligence Sharing Initiative Update 13 December 2016
The Drought Impact Reporter
Comparing Systems Using Sample Data
Alternative Turbulence Correction Methods
PCWG 2016 Roadmap & Meeting Overview
Adastra v3 Reporting & National Quality Requirements
PCWG Intelligence Sharing Initiative
WSP quality assurance tool
Chapter 7 Process Control.
Evaluation of the Cuban Wind Atlas
Power Curve Interpolation, What We’ve Learnt?
Height and Pressure Test for Improving Spray Application
MEASURE : Measurement System Analysis
Statistical significance & the Normal Curve
Url Login here.
TI measurement techniques for pulsed Lidars – the Current Status
Edexcel: Large Data Set Activities
Chapter 3 Graphical and Tabular Displays of Data.
SSI Toolbox Status Workbook Overview
IB BIOLOGY INTERNAL ASSESSMENT
Normal Probability Distributions
Software Systems for Survey and Census
Graphing Techniques.
The Science of Biology! Chapter 1.
The Height and Span Juxtaposition
Local Alcohol Profiles for England
Daniel E. Winkowski, Eric I. Knudsen  Neuron 
Lesson 2.2 Linear Regression.
Research Questions & Research Hypotheses
Welcome to ASCA’s Salary & Benefits Survey Benchmarking Portal Results Guide This guide outlines important information regarding the dynamic comparison,
Presentation transcript:

PCWG Intelligence Sharing Initiative 10 August 2016 NREL, Colorado, US

PCWG-Share-01: PCWG Analysis Tool Excel Benchmark and PCWG Analysis Tool Comparison PCWG-Share-01: Enabled by PCWG Analysis Tool. Consistent data analysis and anonymous report generation. ‘Just do it’ PCWG-Share-01 button (minimise set-up time)

PCWG-Share-01 Definition Document Download PCWG-Share-01 Definition Doc from

Inner Range Power Curves Extracted from the Dataset Itself: the data analysis process has been designed such that the warranted power curve is never considered. Instead a power curve is extracted from a subset of the data (Inner-Range) which is then used to model the power output in the outer-range. Intelligence Sharing, not Data Sharing: the data analysis process has been designed such that the datasets do not need to be shared outside of the participant organisations. Instead of sharing the actual data, participants will share performance metrics which describe the accuracy of the trial methodologies. PCWG-Share-01: Neutralising Commercial Sensitivities

Proprietary Dataset D Analysis Definition Y Organization D Proprietary Dataset A Organization A Proprietary Dataset B Organization B Proprietary Dataset C Organization C Aggregator (Academic Institution ) Combination Analysis Aggregated Hypothesis Performance Metrics Hypothesis Performance Metrics Analysis Definition Y Hypothesis/Trial Methodology How well did the trial method perform? PCWG-Share-01: Data Flow

PCWG-Share-01: Error Metric Definitions See PCWG-Share-01 Definition Document for Further Details

PCWG-Share-01: Submissions by Participant Type

Still unexpectedly large errors for baseline inner range (further investigation required) PCWG-Share-01: Baseline Error, Inner vs Outer Range ‘Uncertainty’ associated with ‘Outer Range’ effects. Std Dev ≈ 2% Smaller inner baseline errors still warrant further investigation Version 0.5.9/10

PCWG-Share-01: Baseline Errors by Wind Speed (0.5.8) Large errors above rated for certain datasets.

PCWG-Share-01: Errors by Method (‘Four Cell Matrix’)

PCWG-Share-01: Improvements by Method (‘Four Cell Matrix’)

Erroneous Outlier Issue

PCWG-Share-01: Baseline Histogram for ‘Follow Up’ Datasets PCWG participants were asked for permissions to allow the data aggregator to investigate their submissions for sources of error. Owners of 34 datasets responded positivity. A baseline NME histogram for these participants is shown below.

PCWG-Share-01: Baseline Errors by Wind Speed (Outliers Only) The 4 large negative NME outliers all have a distinct ‘by wind speed error signature’. Further investigation is required to ascertain what is going on with these datasets. Large errors at high wind speeds

PCWG-Share-01: Baseline Errors by Wind Speed (Non-outliers) The ‘by wind speed’ errors of the non-outliers look more reasonable, although some notable behaviour is observed (as highlighted). Re-plot once interpolation issue is resolved. Notable behaviour for ‘red’ dataset. Notable behaviour for ‘blue’ dataset. Interpolation Issue

Many thanks to all PCWG-Share-01 Participants and special thanks to Andy Clifton of NREL Join the Power Curve Working Group at: