1. 10th CAA Operations Review Annual Report of the FGM Experiment
Chris Carr, Leah-Nani Alconcel, Peter Fox, Patrick Brown, Tim Oddy
Imperial College London, London, UK

2. Introduction In the last year:
Despite reduced (wo)manpower, data delivery rate was maintained
- March 2014 through April 2015 delivered (thanks to PF’s sterling efforts)
- Routine calibration will resume in 2016
- Additional files delivered to fill data gaps and improve calibration
(details to follow)
HPA Low mode data reinstated (Dec 2009)
Commissioning phase data calibrated and delivered for C1, C2 and C3
Individual orbits reprocessed and delivered to fix data gaps in the CAA

3. Status of Management Chris Carr is PI (12%)
Funding
support from STFC finished at the end of December 2010.
ESA funds (routed via UKSA and STFC) through end of December 2016.
- in place for operations/DP support
- reduced to 1.0 FTE (Full-Time Equivalent) of staff + 12% PI time
ESA funds (direct) for CSA support
- 0.5 FTE
Proposal for UKSA funding for 2017/2018 submitted and under review.
The team is configured as follows:
Chris Carr is PI (12%)
Leah-Nani Alconcel is Archive Engineer (50%)
Patrick Brown is Operations and Data-Processing Manager (20%)
Tim Oddy is software, calibration and instrument analyst (40%)
Peter Fox does calibration and archiving (40%)
For 17/18 we have submitted a detailed proposal to UKSA which is being reviewed by panel at the moment, but we don't expect to hear anything until after the government's autumn spending review.

4. Overview of Instrument Calibration Status
FGM CAA product delivery status
Product name 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15
Cx_CP_FGM_SPIN P D1
Cx_CP_FGM_5VPS
Cx_CP_FGM_FULL
Cx_CQ_FGM_VALF
Cx_CQ_FGM_GAPF
Cx_CC_FGM_CALF
Cx_CQ_FGM_CAVF D2
D = delivered
P = partial delivery
FGM have fulfilled contractual obligations for 2014 data delivery
On track to fulfill 2015 data delivery obligations on time or ahead of schedule
Contractual dates are: 2014 data delivered by mid-2015 and all 2015 data delivered by mid 2016 with all earlier datasets to be finalised by end 2016

5. Calibration Status – Consistency between 4 instruments
QMUL flagged up a consistent problem in the July 2003 FGM data where the spin-axis calibration was suspect for C3. It was consistently offset from C124 by 0.4 nT. Due to small s/c separations (~200 km), an offset of this magnitude would not be expected.
The inter-calibration step that had been added to the standard calibration procedure was found to have introduced this offset in both July and August 2003 data. The standard calibration was therefore run on July and August 2003 and the FGM data redelivered to the CAA.
(Details in CrossCal 22 presentation)

6. Calibration Status – Comparison with other instruments
No recent cross-instrument calibration efforts to report.
It could be interesting to revisit the C1 and C3 FGM-EDI comparison for July and August 2003 but the FGM team is focusing its limited resource on Extended Mode processing this year.
Point out FGMEXT processing could actually lead to increased CAA coverage, while FGM-EDI comparison won’t

7. Overview of Data Production Pipelines
Data processing flow, per calendar month of data (12-14 orbits)
Calibration
Pipeline
Submission to CAA
Preprocessing
of Raw Data
Processing of
Calibrated Data
The combination of software improvements last year and hardware upgrades the year before have sped up the processing & calibration pipelines considerably.

8. Data Production Pipelines: Calibration Flow
Calibration flow, conducted per calendar month of data (12-14 orbits)
Dayside Season:
Solar Wind Analysis
Visual Inspection &
Validation
Fourier
Analysis
Range
Jumps
Tail Season:
Spin-axis Offset
Interpolation
Huge improvements in the software efficiency have led to this, i.e. to demonstrate that we are still refining and improving our tools and procedures
Calibrator #1
Calibrator #2
Full process used to take ~4 weeks, now takes ~1-1.5 weeks

9. Overview of Instrument Product Deliveries
Datasets
Delivered interval
Comments
FGM magnetic field data: FULL, 5VPS, SPIN – V01
Jan 2001– Apr 2015.
Preparation of these core datasets was our highest priority.
FGM supporting data: GAPF and VALF files
These files are prepared routinely along with the core data sets.
FGM calibration files: CALF
Detached headers (required in order for these non-CEF data files to be ingested) have been submitted to the CSA.
FGM caveat files: CAVF
Files are prepared to highlight periods where problems with data occur that cannot be calibrated out.
FGM calibration accuracy files: CALA
Feb 2001 – Dec 2006, files prepared for all orbits
CALA files have been superseded by CAVF files.

10. Status of Instrument Products – Recent Deliveries
First calibration of Commissioning Phase data
Spacecraft
Orbit Numbers
Dates
Reason
C123
68-80
Dec 2000
First calibration of commissioning phase orbits from December 2000 for C123
C4 not delivered because inboard sensor was used & has not been calibrated.
Reinstatement of data taken during HPA Low Mode
Spacecraft
Orbit Numbers
Dates
Reason C1
Dec 2009
Reprocessing and redelivery of C1 data so that HPA Low Mode data is reinstated.
NB: This is a one-off. HPA Low Mode data has been routinely delivered since Jan 2010.

11. Status of Instrument Products – Recent Deliveries
Recalibrated FGM data
Spacecraft
Orbit Numbers
Dates
Reason
C1234
Jul 2003
Aug 2003
Standard calibration found to be more realistic than calibration carried out with the inter-calibration step.
QMUL flagged up a problem in the July 2003 FGM data where the spin-axis calibration was suspect for C3. It was consistently offset from C124 by 0.4 nT. Due to small s/c separations (~200 km), an offset of this magnitude would not be expected.
The inter-calibration step that had been added to the standard calibration procedure was found to have introduced this offset in both July and August 2003 data. The standard calibration was therefore run on July and August 2003 and the FGM data redelivered to the CAA.
Details will be presented during CrossCal 22.

12. Status of Instrument Products – Recent Deliveries
Redelivery of files that failed CAA ingestion
Spacecraft
Orbit Numbers
Dates
Reason C1
158,1435
04-06 Jul 2001
28-31 Oct 2009
Removed misordered time records that had caused FULL resolution data files to fail ingestion into the CAA/CSA. C2
592,1435
02-04 May 2004
Ditto C3
223,811,899,
925, 929,1314
06-08 Dec 2001
05-07 Oct 2005
02-05 May 2006
03-05 Jul 2006
13-15 Jul 2006
14-16 Jan 2009 C4
106,151,592
02-05 Mar 2001
17-20 Jun 2001

13. Status of Instrument Products – Recent Deliveries
Redelivery of files with missing data
Spacecraft
Orbit Numbers
Dates
Reason C1
30 Aug-04 Sep 2004
Reinstate a day’s worth of data (02 Sep) that hadn’t appeared in the original files C2
18-23 Nov 2002
Missing day was 20 Nov
709
03-06 Feb 2005
Missing day was 05 Feb C3
1346
31 Mar-02 Apr 2009
Missing day was 01 Apr
1489
01-03 Mar 2010
Reinstate all data. Orbit data files on CAA were empty.
811
05-07 Oct 2005
Correct a CAA data gap in SPIN caused by processing problem C4
655
28-30 Sep 2004
Missing day was 29 Sep

14. Status of Instrument Products – Recent Deliveries
Redelivery of files with inconsistent data sets
Spacecraft
Orbit Numbers
Dates
Reason C1
98,99,246,456, 463
11-16 Feb 2001
29 Jan-01 Feb 2002
13-15 Jun 2003
30 Jun-02 Jul 2003
Correct an inconsistency between FULL, 5VPS and SPIN generation dates on CSA C2
263,996
11-13 Mar 2002
19-21 Dec 2006
Ditto C3
1538
20-22 Jun 2010 C4
114,297,362
21-24 Mar 2001
31 May-02 Jun 2002
01-04 Nov 2002

15. Status of Instrument Products – Required Redeliveries
GI data that was embargoed for February and March 2015 has passed out of the embargo period and been delivered to the CAA.
Upcoming GI periods include: Jun, Nov/Dec 2015 and Jan, Feb, Apr-Jun 2016
The GI embargo periods for these FGM data will be respected when routine data calibration begins again in 2016, except where the FGM team has been explicitly informed that the GI does not require the data to be embargoed (e.g. Jan 2016).

16. CAA/CSA Inventory Plot Inconsistencies
Deliveries to the CAA have not propagated to the CSA
Commissioning phase data
C1: December 2000
All datasets available

17. CAA/CSA Inventory Plot Inconsistencies
Deliveries to the CAA have not propagated to the CSA
C1, December 2000
All data appears to be missing!

18. CAA/CSA: Slow Ingestion
Deliveries not appearing in both CAA and CSA
Commissioning phase data
C2: December 2000
Data delivered to CAA
(after CC21)
No datasets available

19. CAA/CSA: Slow Ingestion
Deliveries not appearing in both CAA and CSA
C2, December 2000
All data appears to be missing

20. Open Action Items from 8th Operations Review
AI Number
Action Item
Status
CAA-OR8-R17
The board recommends that the FGM team investigates the possibility of providing extended-mode FGM data to the CAA.
Open. FGM is investigating. These data are transmitted during BM3 and contain the measurements when the spacecraft was not transmitting data. Time stamping of the data is a nontrivial problem as the data are given in instrument internal timing with no reference to the SCET time. We have progressed somewhat recently but the data are still not in a deliverable state.
No open actions for FGM from 9th Operations Review

21. Summary of Problems and Open Issues
Bursty Spin Noise on C4
Seen since September 2010 (possibly earlier) and has continued
No progress has been made in finding the source of the problem
There appears to be no correlation with FGM commanding or platform commanding.
We are continuing to caveat the C4 Range 2 and 3 data.

22. Summary of Problems and Open Issues
Bursty Spin Noise on C4: Sep 2010, ~10 min interval, 5 vps

23. Summary of Problems and Open Issues
Bursty Spin Noise on C4: Sep 2010, ~2 min sub-interval, 22 vps

24. Instrument Calibration Plan for 2016
The following calibration tasks will be addressed (in order of priority)
Routine calibration, resuming February 2016
Reprocessing and redelivery to fill identified gaps in the CAA
Continued efforts to process Extended Mode intervals for integration into the calibration pipeline (summer student 2016), following on from progress made by summer student in 2015

25. Data Production Plan for 2016
The long term plan is to deliver:
all 2015 data by the 11th Operations Review (mid 2016?)
2016 data (through April 2016) by the 11th Operations Review