1. Introduction on the FY historical Big Data Reprocessing project
Di XIAN, Zhe XU,Ling SUN, Xiangang ZHAO…
National Satellite Meteorological Center,
China Meteorological Administration
(NSMC/CMA)

2. Outline Overview of the project
Big Data Reprocessing System introduction

3. Projects on Space-based Radiometric Benchmark
Founded by
National High Technology Research & Development Program of China (863 program) before 2018
National Key R&D Program of China after 2018
Goal
Chinese SI-traceable reference satellite
Retrospective recalibration of historical Chinese EO satellite data
2019/4/25

4. EOS Phase A Phase B Phase C
Projects on Space-based Radiometric Benchmark in China
Phase A
Phase B
Phase C
Climate Change Detection,
Calibration Reference Satellite
Short-term goal ( )
Medium-term goal
( )
Long-term goal
( )
Since 2012
IR calibrator
Blackbody and emissivity measurement on-board
Engineering Model for reference instrument
Solar total irradiance 0.01%
Solar spectral irradiance 0.1%
Earth reflected solar radiance 0.3%
Earth outgoing longwave radiance 0.1K
Long-term Chinese EOS data
Flight Model for reference satellite
EOS
Space-based Radiometric Benchmark
SRB calibrator
Coherent photon Tech for optical path reuse
Solar Spectrum traceable
Cryogenic radiometer
Lunar-based calibration for SRB
Satellite Data Reprocessing
Space-based CDR
Natural Benchmark & Traceability Chains
Benchmark
(Lunar, DCC, PICS) & Traceability chains
2019/4/25

5. Phase B National Key R&D Program of China Chinese FY Satellite Program
Chinese HY Satellite Program
Chinese ZY Satellite Program
Engineering Model for reference instrument
Shanghai Institute of Technical Physics (SITP), CAS
Anhui Institute of Optics and Fine Mechanics (AIOFM), CAS
Natural Benchmark
(Lunar, DCC, PICS) & Traceability chains
Academy of OPTO-Electronics (AOE), CAS
Satellite Data Reprocessing
National Satellite Meteorological Center (NSMC), CMA
2019/4/25

6. 30 years’ Chinese historical Satellite data
Retrospective recalibration of historical Chinese EO satellite data
30 years’ Chinese historical Satellite data FY
17 Satellites HY
3 Satellites ZY
9 Satellites
2019/4/25

7. Outline Overview of the project
Big Data Reprocessing System introduction

8. The project overview: 5 main research objects
Meteorological satellites
Historical reprocessing
Optical instruments
Common technology
Oceanic satellites
Historical reprocessing
Microwave instruments
Common technology
Land satellites
Historical reprocessing

9. Fast intensive satellite data processing technology
The first PB level satellite data reprocessing system in China
Big data Reprocessing
Dispatching
Re-cal
Re-nav
integration
Algorithm R&D
Satellite Partitioning
Distributed data storage
Memory work flow design
Big data dispathching
Data dispatching based on GPU/CPU
Big data reprocessing IT frameworks
Multi-task dispatching design
Parallel algorithm libs
Re-navigation algorithm integration
Re-calibration algorithm integration
Data reprocessing and quality anylisis
Parallel big data reprocessing system
Big data dispatching system
Big data reprocessing libs
>3PB
High I/O
High concurrence
GPU/CPU
parallel algorithm
intelligent dispatching
integration
Analysis
Reprocessing
Reproducing

10. Big data reprocessing system IT frameworks
HY data center
ZY data center
FY data center
Computating pool
Data pool

11. Reprocessing Dataset Satellite Instrument Data sets GEO
FY-2A/B/C/D/E/F/G
VISSR
L1, OLR, SST
LEO
FY-1A/B/C/D
AVHRR
L1,OLR,SST,LST,NDVI
FY-3A/B/C
VIRR, MERSI, MWRI,MWHS,MWTS,IRAS
19V Channel

12. Data Sharing: standard + Web Portal Service
Website Users Number
Website Order Number

13. Thank You