Calibration/Validation of the NPOESS NPP Instruments: Plan Overview National Polar-Orbiting Operational Environmental Satellite System Karen St.Germain, NPOESS Integrated Program Office Direct Readout Meeting, October 3-6, 2005

Philosophy of Calibration/Validation Cal/Val Calibration Validation Centrals NWP Real-time tactical Non-tactical JTWC NHC JIC Science Others Users Mission Success Absolute Accuracy Polarization Purity Geolocation Accuracy Instrument Stability Signal-to-Noise Antenna Pattern Correction Environmental Data Products (EDRs) Atmosphere Ocean Land Ice Space Ensures Meet Specification Operational production of synoptic maps and profiles of critical atmospheric, oceanographic, land and space parameters Known Accuracy Quality Control Calibration ensures that the Sensor Data (SDRs) are usable Validation ensures that the Environmental Data (EDRs) are usable

The Stakeholders Success NGST IPO NASA Centrals Driver: Meet Spec Resources: Cal/Val infrastructure, Payload subcontractors Manpower IPO NASA Driver: Meet IORD Driver:Science Quality Success Resources: Cal/Val Heritage, BAA Correlative Data Assets, MOUs Resources: Cal/Val Heritage, Manpower Science Data Segment Centrals Driver: Mission Resources: Real time Quality Assessment

NPOESS Calibration Verification Validation Program- System Perspective Prelaunch Post-Launch Long-Term Monitoring Sensor Characterization and Calibration Operations, Maintenance, and Upgrades Heritage sensor data, design analysis Calibration and characterization ground tests Calibration and characterization on-orbit Sustaining calibration and validation Algorithm tuning and upgrades Verification of science algorithm quality and latency RDR/SDR validation Verification of operational algorithm quality and latency Validation of operational EDR quality and latency Operational EDRs RDR/SDR/EDR Verification RDR/SDR/EDR Validation Hotbed of Activity Intensive Planning and Tool Development Effort Underway Planning Underway

Cal/Val Complexity 26 EDRs 4 New Instruments 3 Resource Management Centers Pre-launch tests occurring at 4 different sensor vendors How are we managing this? How do we know our plans are comprehensive?

Coordinated NPP Cal/Val Plan Baseline and Changes Coordinated NPP Cal/Val Plan Baseline The SSPR Prime contractor, the Integrated Program Office, and the NAS NPP Science team have a (mostly) common interest in executing a successful Cal/Val SDR/EDR Compliance-to-Cal/Val Requirement system engineering (with Science and Technical Advisors involvement) will identify tasks that are must, specific, realistic, and measurable. A Tasks Network will be used to explore schedule constraints and clearly define task responsibilities The CVMT and Science/Technical Advisors are responsible for constraint management Looking for synergistic tasks. Exploring parallel task execution options Identifying discrepancies in bottom-up schedule, budget and Goals Using priorities to explore trade-offs Using NPOESS SCB and NETS to resolve schedule and budget gaps From the Task Network the CVMT will establish roles and responsibilities among performing organizations The CVMT will manage execution of the Joint NPP Cal/Val Plan baseline Joint NPP Cal/Val Plan Baseline changes The CVCCB will manage baseline changes employing traditional CCB processes and documentation

NPOESS NPP Cal/Val “Big Picture” Pre-Launch Post-Launch Sensor Dgn Parts Subsys Sys I&T SDR/EDR Ingest - Performance Parameters & LUT - Geolocation - Cal Xfer - Radiometry/Photometry Long-Term Monitoring Perf. Budget Compliance Review Board Point Budget Cal Budget Anomaly Resolution Op Algorithm Change Performance & Calibration Verification RDR Quality & Selection SDR Validation EDR Validation Cal/Val Infrastructure Design Manufacturing, I&T Readiness Demo Infrastructure – RDR Storage, Match-up Data, Ground Truth, ICVS, LTA,, Quality Flags, Tools, Op/Sci Algorithms Infrastructure Req. Data Storage, Sci/Op Algorithms, Tools, Ground Truth, Match-up Data Task Lead RDR Quality Geo-location Task Lead Task Lead Cal Scenes Solar/Lunar Ground Task Lead EDR Match-up Data X-Cal (Space Assets) Task Lead Task Lead Airborne Campaign Ground Campaign Task Lead Task Lead Etc. BaselineChange Task Planning & Execution Task Planning Intensive Cal/Val Sustaining Cal/Val Cal/Val Plan Baseline (Task Network, Data Req., Algorithm Need, Infrastructure Req.) L + 7 mos Baseline Coordinated IPO-NASA-NGST SSPR Activity Heritage Validation & New Approaches (Doc, Data Req, Implementation Support, Lessons Learned)

“Bottom Up” approach to defining Cal/Val Driven by diagnostic work that has to be done in the intensive post-launch phase

Tasks are captured in a web-based relational database Attributes include Data, metadata, tools, entry and exit criteria, etc.

Once described, tasks are linked logically and scheduled Technical threads are rigorously developed and reviewed by joint teams with individuals from NGST, sensor vendors, Academia, Gov’t Labs, and FFRDCs. ATMS Thread

A technical library supports the distributed Cal/Val Team Sensor data, analyses, algorithms, formats, tools, reports

The technical library includes the algorithms and their supporting documentation: ATBDs, code, test data, formats, results, etc.

All code, including algorithms and tools is under configuration control for Cal/Val

Cal/Val Anomaly Resolution & Ops Change The IPO/NASA/NGST SSPR Cal/Val Team will perform analysis and validation of calibration and SDR/EDR performances Cal/Val anomalies will be investigated by expert SSPR CV Anomaly Resolution Teams Anomaly findings and resolutions will be submitted to the CVCCB for consideration and subsequent recommendation to the ACCB and the O&S CCB for operational implementation

Cal/Val Activities Today Algorithms and Validation Infrastructure Validation Data Sources Data Quality Subsystem Validation Data Tools Cal/Val Database Cal/Val Activities Today Internal Gov’t Studies Quality Flags/ Intermediate Products NPP Science Team OATs Interface Analysis Tools MOUs/MOAs Long Term Monitoring: Requirements and Tools Pre-launch Testing S/C Attitude Maneuvers Sensor Algorithms (SDRs) Transition to O&S Cal Coefficients/Look-up Tables OPSCON Scenarios NPP Cal/Val Plan Sensor Calibration Operational Issues

Two Questions and an Opportunity: Are there Cal/Val concerns specific to the Direct Readout community? Global look-up tables Radiometric calibration consistency Cross-instrument geolocation What can the direct readout community bring to the Cal/Val program? Validation concepts http://ipo.noaa.gov Internal Government Studies Program Announcement

NPOESS Calibration Verification Validation Program Participants Exploration & Exploitation Activities Performance Advisory Activities Development Activities IPO & NASA Integrated Product Teams (IPTs) Systems Engineering (SE, SI, ST&E) Payloads IDPS Operations and Support IPO Cal/Val Team NPOESS Internal Government Studies NPOESS Operational Algorithm Team (NOAT) Science Algorithms Sensors NASA NPP Science Team Integrated Product Teams (IPTs) Systems Engineering (SE, SI, ST&E, Cal/Val) Payloads IDPS Operations & Support NGST Cal/Val Team NGST NGST Science Advisory Team (SAT) Science NGST SE IPT Science Team Joint NOESS P3I NPOESS Customer Forum Calibration/Validation Working Group (CVWG) Calibration/Validation Teams (Participation from Gov’t Labs, Universities, FFRDCs, Centrals)