Presentation is loading. Please wait.

Presentation is loading. Please wait.

Repeatability and Reproducibility Analysis of the Round Robin Results.

Published byDorthy Gilmore Modified over 9 years ago

Similar presentations

Presentation on theme: "Repeatability and Reproducibility Analysis of the Round Robin Results."— Presentation transcript:

1 Repeatability and Reproducibility Analysis of the Round Robin Results

2 Round Robin Objectives  The familiarization of the participating laboratories within the project with the specific sampling system use (“particulates” system)  The examination of the consistency of the results obtained when applying this methodology in different physical environments

3 Participating Laboratories  VTT Energy (VTT) – Finland  MTC – Sweden  IFP – France  EMPA – Switzerland  Technical University Graz (TUG) – Austria  AEA Technology (AEAT) – UK  SHELL – UK  Lab of Applied Thermodynamics (LAT) - Greece

4 Round robin execution table LaboratoryArrival DayDeparture Day VTT 11/09/200124/09/2001 MTC 28/09/200105/10/2001 IFP 12/10/200122/10/2001 EMPA 02/11/200109/11/2001 TUG 09/11/200120/11/2001 AEAT 29/11/200107/12/2001 Shell 08/12/200115/12/2002 LAT 16/12/200229/01/2002

5 Test Vehicle  VW Golf TDI 1.9 l, M Y 1996 with the oxidation catalyst removed  Fuel: Fulfilling the specification EN590 (Year 2000 specs)  Lubricant: BP Vanellus C4 multi SAE 20W – 50 grade (pre aged for 874 km)

6 Instrumentation  Primary Porous Diluter  TYLAN MFC 2920 dilution air mass flow controller  Ageing Chamber  Thermodenuder  Dekati’s Electrical Low Pressure Impactor (ELPI) & ELPI Filter Stage  Vacuum Pump  2 Ejector dilutors  Dekati’s Diffusion Charger (DDC)  TSI’s 3022 Condensation Particle Counter (CPC)  Dekati’s Gravimetric Cascade Impactor (DGI)

7 Testing  Transient Cycles:  NEDC  Artemis Road  Steady State Modes:  50 km/h  120 km/h (road loads)

8 Properties measured in round robin  Particulates System  Mass emission rate (mg/km) [DGI]  Active surface (cm 2 /cm 3 ) [DDC]  Number Concentration (cm -3 ) [ELPI stages 1 to 8]  Number Concentration (cm -3 ) [ELPI end filter stage]  Mean aerodynamic diameter (nm)  Number concentration (cm -3 ) [CPC]  Total number concentration (cm -3 ) – mean & median mobility diameters [SMPS]  Regulated emissions:  NO x  CO 2  CO  HC  PM

9 Repeatability – Reproducibility Analysis proposed in ASTM E691-99 Standard  Inspection of the repeatability and reproducibility of the results obtained from each laboratory.  Derivation of a precision statement in terms of the total within laboratory and between laboratories variances.

10 Factors affecting the outcome of a test method  The equipment used  The calibration of the equipment  The operators using the equipment  The environmental conditions

11 Precision and Accuracy Accurate but imprecise results True Value Precise but inaccurate results

12 Within Lab and between laboratories variability  Within Laboratory Variability: (σ 2 ).  Between Laboratories Variability (σ τ 2 ).  Within Laboratory – Between Laboratories Variances reflect:  The precision of the test method  Any vagueness in the protocol  Departures from the protocol  Coefficient of Variance: σ/μ

13 Repeatable Results Average value

14 Reproducible Results Overall mean value

15 Repeatability – Reproducibility Statistics and their critical values  Repeatability Index: k  x… laboratory  Reproducibility Index: h  Critical h * and k * values.

16 h plots by laboratories (reproducibility)

17 h plot by driving cycles

18 k plots by laboratories (repeatability)

19 k plots by driving cycles

20 Repeatability problems in regulated emission results VTTIFPEMPA CO2 NEDC cold CO HC NEDC cold50 km/h Artemis & NEDC hot NOx NEDC coldArtemis PM Artemis & NEDC hot

21 Reproducibility problems in regulated emission results EMPASHELLVTTIFPAEAT CO2 50 km/h All cycles CO 50 km/h HC NEDC hot NEDC cold NOx Artemis NEDC cold PM All cycles

22 Within Laboratories Coefficients Of Variance for Regulated Emissions Results

23 Between Laboratories Coefficients Of Variance for Regulated Emissions Results

24 Repeatability Problems in Particulates instruments results MTCIFPEMPAAEATSHELLTUGLAT CPC 120 km/h 50 km/h NEDC hot DDC NEDC cold 50 & 120 km/h ELPI 1- 8 Artemi s & NEDC cold 50 & 120 km/h NEDC cold ELPI filter Artemi s & NEDC ELPI mean dp 120 km/h SMPS total conc. 120 km/h 50 & 120 km/h

25 Reproducibility Problems in Particulates instruments results MTCIFPEMPAAEATTUGSHELL CPC 120 km/h 50 km/h NEDC hot NEDC cold DDC Artem is NEDC 120 km/h ELPI Filter Artem is NEDC ELPI 1-8 Artem is NEDC hot & 120 km/h NEDC cold ELPI mean dp 50 km/h NEDC cold DGI total mass NEDC Hot Artemis

26 Within laboratories Coefficients Of Variance for Particle properties

27 Between Laboratories Coefficients of Variance for particle properties

28 Comparison of the Within Laboratory Coefficients of Variance of the particulates instruments results with the regulated PM ones

29 Comparison of the Between Laboratory Coefficients of Variance of the particulates instruments results with the regulated PM ones

30 Conclusions - Recomendations  Great variability observed in ELPI results (possibly thermodenuder?).  DDC results were the most repeatable and reproducible.  Possible dilution ratio determination problems.  Indications that the method is robust.  Importance of conducting another round robin now that all laboratories are familiar with the protocol.

Download ppt "Repeatability and Reproducibility Analysis of the Round Robin Results."

Similar presentations

Effect of Fuel Quality and Engine Technology on Particle Emissions

Effect of Fuel Quality and Engine Technology on Particle Emissions
MASS EMISSION RATES AND CHEMICAL CHARACTERIZATION OF PM 2.5 EMISSIONS FROM TWO MOTORCYCLES Deniz Karman and Colin Welburn Department of Civil and Environmental.

MASS EMISSION RATES AND CHEMICAL CHARACTERIZATION OF PM 2.5 EMISSIONS FROM TWO MOTORCYCLES Deniz Karman and Colin Welburn Department of Civil and Environmental.
27/06/02 Reproduction permitted with due acknowledgement DG TREN Particulates Consortium Lemnos, 11-12 September 2003 Neville Thompson, Technical Coordinator,

27/06/02 Reproduction permitted with due acknowledgement DG TREN Particulates Consortium Lemnos, September 2003 Neville Thompson, Technical Coordinator,
Experimental Evaluation of Various Biofuel-Diesel Blends as Diesel Engine Fuels Georgios Fontaras and Zissis Samaras Laboratory of Applied Thermodynamics.

Experimental Evaluation of Various Biofuel-Diesel Blends as Diesel Engine Fuels Georgios Fontaras and Zissis Samaras Laboratory of Applied Thermodynamics.
The DG Tren ” Particulates „ project Zissis Samaras Lab of Applied Thermodynamics Aristotle University Greece.

The DG Tren ” Particulates „ project Zissis Samaras Lab of Applied Thermodynamics Aristotle University Greece.
VII. How might current analysis methods be enhanced or combined to obtain more information about the nature of OC, EC, and other carbon fractions in filter.

VII. How might current analysis methods be enhanced or combined to obtain more information about the nature of OC, EC, and other carbon fractions in filter.
S.T. O’Sullivan D.J. Timoney University College Dublin Ireland On-road measurement of particulate emissions from diesel engined vehicles.

S.T. O’Sullivan D.J. Timoney University College Dublin Ireland On-road measurement of particulate emissions from diesel engined vehicles.
Parallel aerosol sampling with SMPS and LPI in biomass combustion B. Stojkova, M. Hagström, J. B. C. Pettersson, Department of Chemistry, Physical Chemistry,

Parallel aerosol sampling with SMPS and LPI in biomass combustion B. Stojkova, M. Hagström, J. B. C. Pettersson, Department of Chemistry, Physical Chemistry,
1 Motor Vehicle Emission Control in Japan Better Air Quality Workshop 2002 （ 16th Dec 2002 ） Environmental Management Bureau, Ministry of the Environment.

1 Motor Vehicle Emission Control in Japan Better Air Quality Workshop 2002 （ 16th Dec 2002 ） Environmental Management Bureau, Ministry of the Environment.
1 Motivation Particles are generally regarded as one of the most serious indoor air quality concerns Increasing concern about ultrafine particles Very.

1 Motivation Particles are generally regarded as one of the most serious indoor air quality concerns Increasing concern about ultrafine particles Very.
Quality Assurance in the clinical laboratory

Quality Assurance in the clinical laboratory
Revisions To Heavy Duty Validation Report General Numerous clarifications to text as requested at December meeting Partial flow systems referred to consistently.

Revisions To Heavy Duty Validation Report General Numerous clarifications to text as requested at December meeting Partial flow systems referred to consistently.
Instrumented Vehicle BAQ2004-1 Instrumented In-Use-Vehicles, a Versatile Tool to Measure Emissions BAQ 2004 Agra, India Dec 2004 Instrumented In-Use-Vehicles,

Instrumented Vehicle BAQ Instrumented In-Use-Vehicles, a Versatile Tool to Measure Emissions BAQ 2004 Agra, India Dec 2004 Instrumented In-Use-Vehicles,
WORKSHOP ON VEHICLE EXHAUST PARTICULATE EMISSION MEASUREMENT METHODOLOGY San Diego, 21 Oct 2002 Zissis Samaras Lab of Applied Thermodynamics Aristotle.

WORKSHOP ON VEHICLE EXHAUST PARTICULATE EMISSION MEASUREMENT METHODOLOGY San Diego, 21 Oct 2002 Zissis Samaras Lab of Applied Thermodynamics Aristotle.
1 The Result of Japan’s Round Robin Engine Test: Measurement of PM and PN 3/30/2009 PMP Informal Meeting National Traffic Safety and Environmental Laboratory.

1 The Result of Japan’s Round Robin Engine Test: Measurement of PM and PN 3/30/2009 PMP Informal Meeting National Traffic Safety and Environmental Laboratory.
Sampling and Measurement for Respirable Particulates.

Sampling and Measurement for Respirable Particulates.
Estimating Impact of Traffic Operation on Carbon Emission Faculty Mentor: Dr. Heng Wei Students: Racquel Redwood Sweta Patel.

Estimating Impact of Traffic Operation on Carbon Emission Faculty Mentor: Dr. Heng Wei Students: Racquel Redwood Sweta Patel.
HD 2007 Rule Diesel Fuel Sulfur Testing and Sampling Methods and Requirements US EPA Office of Transportation and Air Quality November 20, 2002.

HD 2007 Rule Diesel Fuel Sulfur Testing and Sampling Methods and Requirements US EPA Office of Transportation and Air Quality November 20, 2002.
” Particulates „ Characterisation of Exhaust Particulate Emissions from Road Vehicles Key Action KA2:Sustainable Mobility and Intermodality Task 2.2:Infrastructures.

” Particulates „ Characterisation of Exhaust Particulate Emissions from Road Vehicles Key Action KA2:Sustainable Mobility and Intermodality Task 2.2:Infrastructures.
PMP Progress Report Activities since GRPE 58 Heavy Duty Validation testing Exercise completed in October Draft report and draft proposal to insert PN measurement.

PMP Progress Report Activities since GRPE 58 Heavy Duty Validation testing Exercise completed in October Draft report and draft proposal to insert PN measurement.

Similar presentations

Ads by Google