1. CIS : Data Quality Indices Iannis Dandouras, Alain Barthe, Sylvain Brunato CLUSTER ACTIVE ARCHIVE April 2012

2. Data Quality Index: Context CAA User Guide:

3.  Five new datasets : four for CODIF (separate for each ion species) and one for HIA.  Separate index values, for each instrument, for each of the four dataset families :  moments  3D distributions  PADs  omni-directional fluxes  When the value of the index is below a given threshold, the corresponding data will be flagged.  When the data are completely useless (e.g. instrument resets), they will be removed (data filtering), or substituted by filler data.  In addition to the CAA-defined quality index, a CIS-specific flag referring to the type of caveat. CIS Data Quality Principle

4. -1: Remove data (CIS specific, for internal use) 0 : Not applicable (not used by CIS) 1: Known problems, use at your own risk 2: Survey data, not for publication (not used by CIS) 3: Good for publication, subject to PI approval 4: Excellent data which has received special treatment  Default CIS Data Quality Index: 3 unless overwritten by another value, by software or manually  A CIS-specific flag (ASCII string) when Data Quality Index < 3  More than one flags might apply to a given data interval; the data quality index is then the minimum of the values relevant to each flag  CIS Data Quality Index: Does not concern raw particle counts data sets and ancillary data datasets (by nature uncalibrated) CAA Data Quality Index

5. CIS Data Caveats Database CIS Data Quality Index < 3  Magnetospheric region - CIS mode mismatch  Poor counting statistics  etc.  Data gap, or CIS off  Operational incidents with no effect on data quality (for the given dataset family)  etc. CIS Data Quality Index set to < 3 from Caveats Database

6. CIS Caveats Database Example

7. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to operation incidents Wrong HIA discriminator levels Caveats DatabaseDISC RI 33331111 Wrong HIA MCP HV level Caveats Database MCP 33331111 Wrong CODIF MCP HV level Caveats Database MCP 11113333 HIA MCP HV discharge Caveats Database MCP _DC 33331111 CODIF MCP HV discharge Caveats Database MCP _DC 11113333

8. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to operation incidents (or scheduled special operations) CODIF post- acceleration HV discharge Caveats DatabasePACC _DC 11113333 Instrument- spacecraft telemetry mode mismatch Caveats DatabaseTM11111111 CODIF onboard calibrations Caveats DatabaseCALI B 11113333 HIA onboard calibrations Caveats DatabaseCALI B 33331111

9. CODIF s/c 4 post-acceleration high-voltage discharge

10. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to operation incidents (or scheduled special operations) Instrument resetInstrument Command History + Δt RESE T EclipseCaveats Database (DSH param. + Δt) ECLI PSE 131 Incomplete CODIF TM packets Instrument telemetry packets PACK ET 1 For the concerned dataset 3333 Incomplete HIA TM packets Instrument telemetry packets PACK ET 3333 1 For the concerned dataset cf. presentation by A. Barthe on these Data Caveats

11. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to sampling of ion distributions Poor CODIF counting statistics CODIF density value threshold : ~0.01 cm -3 LOW _CO UNTS 11313333 Poor HIA counting statistics HIA density value threshold : ~0.05 cm -3 LOW _CO UNTS 33331131 He ++ contamination from H + All He ++ dataHE211113333 O + contamination when high H + CODIF H + density > 5 cm -3 and HS O111113333 CODIF on sc3 deficient anodes All CODIF sc3 data after 23 Feb 2003 DEF_ ANO DES 11313333

12. Low HIA and CODIF counting statistics example

13. Example of CODIF O + data contamination from very high H + fluxes in the magnetosheath

14. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to sampling of ion distributions Finite gyroradius / gyroperiod effects B-field intensity: 8s) GYR ORA D 31333133

15. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to magnetospheric region – CIS mode mismatch Magnetosheath or magnetosphere when CIS is in a solar wind mode Cluster magnetospheric regions dataset SW_ MOD E 11 1 1 Solar wind mode & CODIF on HS CIS Modes datasetSW_ HS 11 3333 Mode 12 or 14 & CODIF on HS (for data after 1 Nov, 2003) CIS Modes datasetMSH _HS 11 3333 Solar wind when CIS is in a magnetospheric mode Cluster magnetospheric regions dataset MAG _MO DE 11111111

16. CODIF High / Low Sensitivity SW / MAG Modes Example Magnetospheric Mode Solar Wind Mode SW_HS MAG_MODE

17. Data CaveatIdentificationCIS Flag CODIF Quality Index HIA Quality Index 3DPAD1DMo men ts 3DPAD1DMo men ts Limitations related to a magnetospheric region Radiation Belts background (does not concern cleaned CODIF datasets) Cluster magnetospheric regions dataset RAD_ BELT 1111111

18. Outer RB B1B2B3B4B5B6 Outer RBInner RB HIA and CODIF background counts in the Radiation Belts