1. SCOPE-CM: IOGEO GSICS GRWG & GDWG, 20-24 March 2017, Madison, USA
Rob Roebeling, Viju John, Frank Ruethrich, Alessio Lattanzio, Tim Hewison,
Marie Doutriaux Boucher, and Joerg Schulz

2. SCM-06 IOGEO* Towards a GEO ring
Fundamental Climate Data Record (FCDR)
of inter-calibrated
Infrared, Water vapour and Visible radiances
European Organisation for the Exploitation of Meteorological Satellites (Rob Roebeling, Tim Hewison)
Japanese Meteorological Agency (Masaya Takahashi)
National Oceanic and Atmospheric Administration (Kenneth Knapp, Anand Inamdar)
Deutscher Wetterdienst (Marc Schroeder)
China Meteorological Administration (Peng Zhang, Xiuqing Hu)
Indian Meteorological Department (A.K. Sharma, Ashim Mitra)
Korea Meteorological Administration (Dohyeong Kim, Hyesook Lee)
*Inter-calibration of imager observations from time-series of geostationary satellites (IOGEO)
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 2

3. SCM-06 IOGEO - Introduction
Objective:
Re-calibrate and Inter-calibrate Meteosat First Generation (MFG) and Meteosat Second Generation (MSG) IR, WV, and VIS radiances from 1982 till date.
Project Activities:
to share common re-calibration methods between the participating agencies;
to re-calibrate geostationary data from all heritage instruments;
to compare re-calibrated geostationary data in overlap regions;
to prepare an FCDR of re-gridded radiances normalized to a reference instrument;
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 3

4. SCM-06 IOGEO - Introduction
(Courtesy Reto Stöckli, CM SAF Meteo-Swiss)
Progress (Status 2016)
Developed GSICS based re-calibration method for the IR, WV, and VIS channels;
Modified Space Time Angle Matching Procedure (STAMP) to collocate GEO-LEO, LEO- LEO, and GEO-in-situ observations;
Generated time-series of reference radiances from HIRS/2, IASI and AIRS observations;
Generated HIRS data record in NetCDF format (version 2) [available to IOGEO];
Re-calibration of MFG, FY-2, and GOES time-series of IR and WV radiances;
Initiated a joint GSICS and IOGEO comparison of recalibrated IR/WV/WV radiances.
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 4

5. Definitions
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 5

6. Fundamental Climate Data Records (FCDR) discussion - recalibration -
Sensor equivalent calibration [GSICS definition] refers to the calibration where each sensor is calibrated in such a way that the spectral characteristics of that individual sensor are maintained. As a result of this process, the calibrated radiances represent the unique nature (e.g., spectral response function) of the monitored sensor.
Harmonisation [FIDUCEO definition]
A harmonised radiance dataset from a series of satellites is one where all the calibrations of the sensors have been done consistently relative to reference datasets which can be traced back to known reference sources, in an ideal case back to SI. Each sensor is calibrated to the reference in a way that maintains the characteristics of that individual sensor such that the calibrated radiances represent the unique nature of each sensor. This means that two sensors which have been harmonised may see different signals when looking at the same location at the same time the difference being related to known differences in the responses of each sensor such as differences in the sensors spectral response functions etc.
NRTC/RAC/ARC
For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 6

7. Fundamental Climate Data Records (FCDR) discussion - recalibration -
Blue arrows show the aim of Sensor Equivalent Calibration
(also referred to as harmonization or re-calibration)
Sensor 1
Sensor X
Time
Radiances
Calibration as it should be
Actual Calibration
Note, sensor equivalent calibrations are supposed to differ
in their radiances (or counts) due to differences in
the spectral characteristics of the sensors
NRTC/RAC/ARC
For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 7

8. Fundamental Climate Data Records (FCDR) discussion - inter-calibration -
Reference sensor normalised calibration [GSICS definition] refers to the calibration that provides the best match to spectral characteristics of a predefined “reference*” sensor. As a result of this process, the calibrated radiances represent the unique nature (e.g., spectral response function) of the “reference” sensor. The normalised calibration includes information on uncertainty associated with adjusting the characteristics of the monitored sensor to those of the predefined “reference” sensor.
Homogenisation [FIDUCEO definition]
Unlike harmonisation, homogenisation is where radiances from all satellites are forced to look the same such that when looking at the same location at the same time they would (in theory) give the same signal. In reality the signals from different sensors would be different and homogenisation is adding in corrective terms to each satellite to make them look the same. It is likely that these corrective terms will not be 100% effective and that the process of homogenisation will add in scene dependent errors to the uncertainty budget which may be difficult to assess. 
NRTC/RAC/ARC
For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 8

9. Fundamental Climate Data Records (FCDR) discussion - inter-calibration -
Blue arrows show the aim of Reference Sensor Normalized Calibration
(also referred to as homogenization or inter-calibration)
Sensor 1
Reference Sensor used for normalization
One sensor from a series or
a hypothetical sensor
Sensor X
Radiances
Sensor Equivalent Calibration
Reference Sensor Normalized Calibration
Time
Uncertainty due to differences between
the spectral characteristics of the reference sensor and
the spectral characteristics of other sensors in the series
NRTC/RAC/ARC
For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 9

10. on heritage geostationary satellites.
Joint GSICS and IOGEO inter-comparison of reference sensor equivalent WV, IR (and VIS) radiances
KALPANA
74 E
India
Objective
Objective:
IOGEO and GSICS partners to compare reference sensor equivalent (or re-calibrated) radiances from the water vapor (WV), infrared (IR), (and visible (VIS)) channels
on heritage geostationary satellites. 10

11. IOGEO and GSICS inter-comparison - Introduction
Method
To collect re-calibrated data for a common test period:
Channels: WV, IR (and VIS)
Satellites: COMS, GOES, Feng-Yun, Himawari, Kalpana, METEOSAT
Test days: 19 August 2015 and 21 July 2016
Test slots: 3 hourly images (00, 03, 06, 09, 12, 15, 18, 21 GMT)
To encourage IOGEO partners to all use HIRS as reference instrument (Note -> EUMETSAT can provide HIRS record ( ) in standard NetCDF format)
To inter-compare re-calibrated data in overlapping regions;
To compare re-calibrated data against IASI observations;
To compare re-calibrated data against simulated radiances from ECMWF.
Data Exchange
An FTP site has been set up at EUMETSAT where all IOGEO and GSICS partners can upload their test data (details on the next slide)
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 11

12. IOGEO and GSICS inter-comparison – FTP site details
Site : ftp.eumetsat.int User accounts : CMA, EUMETSAT, GSICS, IMD, JMA, KMA, NOAA Password : Each user account has a personal password for details mail to Viju John Directories : Each user account has a personal directory with r/w/e permissions Sub Directories : Each personal directory contains the following sub-directories Reference data : IASI and HIRS reference data will be made available on the FTP site Calibrated data : Each user should but their calibrated data in their personal directory
/rse_native
reference sensor equivalent calibrated data original resolution
/rse_resamp
reference sensor equivalent calibrated data re-sampled (5x5 km2)
/aux_native
auxiliary data (e.g. geometry data) original resolution
/aux_resamp
auxiliary data (e.g. geometry data) re-sampled (5x5 km2)
ftp.eumetsat.int
EUMETSAT FTP Administration Account:
Username: iogeo
Password: 8L5ujAs78E
Access rights: Read/Write/Delete
Suppliers: Login name and directory name
1. NOAA
Username: noaa
Password: 3qp3NR5Hwn
Access rights: Read/Write/Delete to content of NOAA directory, read to other suppliers
2. JMA
Username: jma
Password: ccx8EbATA6
Access rights: Read/Write/Delete to content of JMA directory, read to other suppliers
3. CMA
Username: cma
Password: N9f246T5ju
Access rights: Read/Write/Delete to content of CMA directory, read to other
suppliers
4. IMD
Username: imd
Password: qNHFAxwg9v
Access rights: Read/Write/Delete to content of IMD directory, read to other
5. GSICS
Username: gsics
Password: UqHrCc4jkV
Access rights: Read/Write/Delete to content of GSICS directory, read to other
6. TBD
Username: tbd
Password: M4sR8q4Xh3
Access rights: Read/Write/Delete to content of TBD directory, read to other 12

13. IOGEO and GSICS inter-comparison – Status Data Uploads
00z
03z
06z
09z
12z
15z
18z
21z
24z 21
GOES-15
135°W 
GOES-13
75°W
Met-10
0°E 
Met-7
57°E  
Kalpana
74°E
FY-2D
86°E
FY-2E
105°E
FY-2F
112°E
COMS-1
128°E
Himawari
145°E
 : Ready and uploaded to the common FTP site
 : Ready but not yet uploaded to the common FTP site
 : Not ready but not yet uploaded to the common FTP site
 : Current status needs to be checked

14. Planning
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 14

15. SCM-06 IOGEO - Planning
: IR/WV/VIS recalibration geostationary satellites:
to provide re-calibrated IR/WV/VIS radiances (IOGEO, GSICS) for test days;
to compare re-calibrated IR/WV/VIS radiances (IOGEO, GSICS) in overlapping regions;
to gather feedback from beta users;
2018: VIS recalibration geostationary satellites:
to generate of IR/WV/VIS radiance FCDRs for the GEO satellites;
to gather feedback from beta users.
: Gridded FCDR (GEO ring) of inter-calibrated radiances
to generation a combined product of gridded inter-calibrated radiances that is based on re-calibrated radiances from as many geostationary satellite data as possible.
We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan.
However, we are only at the beginning.
Systematic activities: NOAA CDR Program –SAF Network and CAF
Infrastructure Elements:
Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing;
Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools;
Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution.
Sensor Intercalibration
Level 2 and Level 3 data Records
CDR Quality Assessment
Interoperability of CDRs.
Benefits of common actions for international activities would be:
GSICS would fulfil the implementation plan items on climate;
SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs;
The latter also strengthens the link between GSICS and SCOPE-CM;
International reanalysis activities will get a one stop shop for FCDRs from operational sensors;
NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate;
NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 15

16. Discussion