PCWG-Share-01 Current Status PCWG Meeting Hamburg 10 th March 2016 Peter Stuart (RES) and Andy Clifton (NREL), on behalf of the Power Curve Working Group.

Slides:



Advertisements
Similar presentations
Running a model's adjoint to obtain derivatives, while more efficient and accurate than other methods, such as the finite difference method, is a computationally.
Advertisements

1 Continuity Equations: Analytical Monitoring of Business Processes and Anomaly Detection in Continuous Auditing Michael G. Alles Alexander Kogan Miklos.
Experiments and Variables
Kjell Simonsson 1 Low Cycle Fatigue (LCF) analysis (last updated )
PCWG 9 th Meeting: 12 December Glasgow Introduction, Agenda and Review of Actions.
The General Linear Model Or, What the Hell’s Going on During Estimation?
Today’s class Romberg integration Gauss quadrature Numerical Methods
22-Nov-2004 © Renishaw plc Not to be reproduced without written permission from Renishaw Laser & Calibration Products Division Slide 1 Laser.
Experimental Uncertainties: A Practical Guide What you should already know well What you need to know, and use, in this lab More details available in handout.
ABSTRACT Discrete-time multi-level survival analysis is very useful in prevention research due to the longitudinal and clustered nature of the data. Implementing.
System Design and Analysis
Parameterised turbine performance Power Curve Working Group – Glasgow, 16 December 2014 Stuart Baylis, Matthew Colls, Przemek Marek, Alex Head.
Power Curve Working Group Overview
1 PCWG Peter Stuart 02 September Agenda (1) 2 Morning Session: 10am-1pm – “Welcome” Peter Stuart (RES) – “Review of Actions.
PCWG 9 th Meeting December Glasgow PCWG 2015 Roadmap: Detailed Survey Results.
PCWG 9 th Meeting: 12 December Glasgow Proposed PCWG Data Sharing Initiative.
CHAPTER 3 Describing Relationships
Introduction to Systems Analysis and Design Trisha Cummings.
CENTRE FOR INNOVATION, RESEARCH AND COMPETENCE IN THE LEARNING ECONOMY Session 2: Basic techniques for innovation data analysis. Part I: Statistical inferences.
Handling Data and Figures of Merit Data comes in different formats time Histograms Lists But…. Can contain the same information about quality What is meant.
Health and Disease in Populations 2001 Sources of variation (2) Jane Hutton (Paul Burton)
Quantitative Skills 1: Graphing
Power Curve Working Group Update New Orleans 15 th September 2015.
W  eν The W->eν analysis is a phi uniformity calibration, and only yields relative calibration constants. This means that all of the α’s in a given eta.
StAR web server tutorial for ROC Analysis. ROC Analysis ROC Analysis: This module allows the user to input data for several classifiers to be tested.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
Non-Linear Regression. The data frame trees is made available in R with >data(trees) These record the girth in inches, height in feet and volume of timber.
Whiteboardmaths.com © 2008 All rights reserved
Chapter 14 Inference for Regression © 2011 Pearson Education, Inc. 1 Business Statistics: A First Course.
Power Curve Working Group Update Roskilde 26 th June 2015.
1 Accuracy and Precision Notes Chemistry 1. 2 Uncertainty in Measurements There is no such thing as a perfect measurement! All measurements have a degree.
Stat 112: Notes 2 Today’s class: Section 3.3. –Full description of simple linear regression model. –Checking the assumptions of the simple linear regression.
11/23/2015Slide 1 Using a combination of tables and plots from SPSS plus spreadsheets from Excel, we will show the linkage between correlation and linear.
Numerical Methods.
A New Theoretical Basis for Describing Low Turbulence Wind Turbine Performance Peter Stuart PCWG Meeting – 26 June 2015.
Jeff J. Orchard, M. Stella Atkins School of Computing Science, Simon Fraser University Freire et al. (1) pointed out that least squares based registration.
State Estimator & Telemetry. Imagine a student measuring current on an electrical circuit.59 With on meter, he measures.59 A. Being a cautious type, he.
Module 1: Measurements & Error Analysis Measurement usually takes one of the following forms especially in industries: Physical dimension of an object.
Non-Linear Regression. The data frame trees is made available in R with >data(trees) These record the girth in inches, height in feet and volume of timber.
Physics 2.1 AS Credits Carry out a practical physics investigation that leads to a non- linear mathematical relationship.
J. Pfingstner Imperfections tolerances for on-line DFS Improved imperfection tolerances for an on-line dispersion free steering algorithm Jürgen Pfingstner.
PCWG 15 th Meeting December 2015 – Kings Langley PCWG 2016 Roadmap: Detailed Survey Results.
PCWG-Share-01 Initial Results PCWG Meeting Kings Langley 9 th December 2015 Peter Stuart (RES), Lee Cameron (RES), Alex Clerc (RES) & Andy Clifton (NREL),
Lecture 8: Measurement Errors 1. Objectives List some sources of measurement errors. Classify measurement errors into systematic and random errors. Study.
8th October Aarhus PCWG-Share-01 Introduction.
Understanding the Power Curve Interpolation Issue Power Curve Working Group, , Hamburg Axel Albers.
Multi-Interval Real-Time Market (MIRTM) Updates SAWG Sean Chang Market Analysis February 22, 2016 ERCOT Public Version
Micro-terrain feature identification and processing: An overview with practical implementations along with discussion of a potential application area of.
5-2-3 Analogue to Digital Converters (ADC). Analogue to Digital Conversion The process is now the opposite of that studied in Topic Now we wish.
A Comparison of Marking Levels in the Reviewed Majors.
Remember the equation of a line: Basic Linear Regression As scientists, we find it an irresistible temptation to put a straight line though something that.
23 Jan 2012 Background shape estimates using sidebands Paul Dauncey G. Davies, D. Futyan, J. Hays, M. Jarvis, M. Kenzie, C. Seez, J. Virdee, N. Wardle.
PCWG Intelligence Sharing Initiative 10 August 2016 NREL, Colorado, US.
IEC Ed 2 Collaboration IEA Task 32 Round Robin & PCWG Worked Examples NREL, Colorado, US 10 th August 2016 IEC Task 32: Luke J Simmons (DNV GL)
PCWG 2016 Update 20th May 2016 Peter Stuart.
IEC FDIS 2016 Consensus Analysis Project
PCWG 2016 Update Wednesday, 13 December 2016 Glasgow, Scotland
PCWG Intelligence Sharing Initiative Update
PCWG Intelligence Sharing Initiative Update 13 December 2016
Alternative Turbulence Correction Methods
PCWG 2016 Roadmap & Meeting Overview
Results from the Offshore Wind Accelerator (OWA) Power Curve Validation using LiDAR Project Lee Cameron, Alex Clerc, Peter Stuart, Simon Feeney, Ian Couchman.
PCWG Intelligence Sharing Initiative
Chapter 7 Process Control.
Evaluation of the Cuban Wind Atlas
Power Curve Interpolation, What We’ve Learnt?
Least-Squares Regression
Least-Squares Regression
Lesson 2.2 Linear Regression.
Presentation transcript:

PCWG-Share-01 Current Status PCWG Meeting Hamburg 10 th March 2016 Peter Stuart (RES) and Andy Clifton (NREL), on behalf of the Power Curve Working Group

PCWG-Share-01: PCWG Analysis Tool Excel Benchmark and PCWG Analysis Tool Comparison PCWG-Share-01: Enabled by PCWG Analysis Tool. Consistent data analysis and anonymous report generation. ‘Just do it’ PCWG-Share-01 button (minimise set-up time)

PCWG-Share-01 Definition Document Download PCWG-Share-01 Definition Doc from

Inner Range Power Curves Extracted from the Dataset Itself: the data analysis process has been designed such that the warranted power curve is never considered. Instead a power curve is extracted from a subset of the data (Inner-Range) which is then used to model the power output in the outer-range. Intelligence Sharing, not Data Sharing: the data analysis process has been designed such that the datasets do not need to be shared outside of the participant organisations. Instead of sharing the actual data, participants will share performance metrics which describe the accuracy of the trial methodologies. PCWG-Share-01: Neutralising Commercial Sensitivities

Proprietary Dataset D Analysis Definition Y Organization D Proprietary Dataset A Organization A Proprietary Dataset B Organization B Proprietary Dataset C Organization C Aggregator (Academic Institution ) Combination Analysis Aggregated Hypothesis Performance Metrics Hypothesis Performance Metrics Analysis Definition Y Hypothesis/Trial Methodology How well did the trial method perform? PCWG-Share-01: Data Flow

PCWG-Share-01: Error Metric Definitions See PCWG-Share-01 Definition Document for Further Details

PCWG-Share-01: Submissions by Participant Type

Erroneous Outliers: unexpectedly large errors for baseline inner range PCWG-Share-01: Baseline Error, Inner vs Outer Range ‘Uncertainty’ associated with ‘Outer Range’ effects. Std Dev ≈ 2% Interpolation Issue: Smaller inner baseline errors still warrant further investigation Version 0.5.9/10

POWER CURVE INTERPOLATION ISSUE

What is inner range baseline error? The Inner Range power curve is derived from the Inner Range data Each Inner Range data point is compared to the Inner Range power curve. The error for each data point is calculated. The error is summarised as NME (Normalised Mean Error). This is expected to be 0 for the inner range! HOWEVER The inner range baseline error may not be 0 depending on interpolation of the power curve! Inner Range Baseline Error Error for each point is the difference from the interpolated power curve

Zero-Order interpolation: easy to get 0 NME (just use the bin average power) but large errors for individual data points.

Linear Interpolation: v0.5.8 and earlier, improvement for individual data points but noticeable over prediction at low wind speed

Cubic interpolation: introduced in v0.5.9 for PCWG-Share-01. Noticeably reduces error at low wind speed compared to linear.

Normalised Mean Error (NME) by wind speed: Cubic interpolation has similar but smaller errors than linear. Zero-order has 0 error by definition Cubic and linear interpolators over estimate data at the ankle Cubic and linear interpolators under estimate data at the knee

Residual Error Main reason for residual error: Bin averages are used as interpolation points. Unfortunately the bin averages do not lie exactly on the curve when the underlying function is non-linear. Cubic (Convex) Clipped (Concave) Linear The bin average, (avg(x), avg(y)), is above the curve The bin average, (avg(x), avg(y)), is on the curve The bin average, (avg(x), avg(y)), is below the curve

Possible solutions The problem is that bin average power does not well represent bin centre power The bin averaging process is very similar to the effect of turbulence. An iterative correction method similar to the Albers method could be applied to find the true bin centres. In the rising part of the curve, evaluate bin average Cp, consider this to be bin centre Cp, and convert to bin centre power. Cp data is a bit less non-linear than power.

Erroneous Outlier Issue

PCWG-Share-01: Baseline Histogram for ‘Follow Up’ Datasets PCWG participants were asked for permissions to allow the data aggregator to investigate their submissions for sources of error. Owners of 34 datasets responded positivity. A baseline NME histogram for these participants is shown below.

PCWG-Share-01: Baseline Errors by Wind Speed (Outliers Only) The 4 large negative NME outliers all have a distinct ‘by wind speed error signature’. Further investigation is required to ascertain what is going on with these datasets. Large errors at high wind speeds

PCWG-Share-01: Baseline Errors by Wind Speed (Non-outliers) The ‘by wind speed’ errors of the non-outliers look more reasonable, although some notable behaviour is observed (as highlighted). Re-plot once interpolation issue is resolved. Notable behaviour for ‘red’ dataset. Notable behaviour for ‘blue’ dataset. Interpolation Issue

PCWG-Share-01 RESULTS Selected Results Only: For Full results see December 2015Meeting ProceedingsDecember 2015Meeting Proceedings

PCWG-Share-01: Errors by Method (‘Four Cell Matrix’) Need to eliminate baseline issues to get a clear signal of which methods work best in which conditions.

PCWG-Share-01: Improvements by Method (‘Four Cell Matrix’) Need to eliminate baseline issues to get a clear signal of which methods work best in which conditions.

Many thanks to all PCWG-Share-01 Participants and special thanks to Andy Clifton of NREL Join the Power Curve Working Group at: