1 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Evolution of NOAA's Satellite Archive: Transition of CLASS Development to Operations at NOAA's Data Centers and Future Plans John J. Bates, NOAA’s National Climatic Data Center Ken Casey, NOAA’s National Oceanographic Data Center Eric Kihn, NOAA’s National Geophysical Data Center

2 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Outline  What is an Archive  Current State of NOAA’s Archive  Archive Plans for NPOESS  Challenges and New Opportunities

3 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II What is an Archive? Archive Responsibilities  Negotiates and accepts information from Producers  Obtains sufficient control to ensure long-term preservation  Ensures the information to be preserved is independently understandable to identified Designated Communities  Follows documented policies and procedures that ensure the information is preserved against all reasonable contingencies  Makes the preserved information available to the Designated Communities in forms understandable to those communities NOAA’s Data Centers = NOAA’s Archive; CLASS is IT

4 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II The Archive Environment  Producer provides information to be preserved  Management sets overall policy  Consumer seeks and acquires preserved information OAIS (Archive) Management Producer Consumer The Archive Environment from 30,000 ft CLASS Operations and Planning Board (COPB)

5 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II SIP = Submission Information Package AIP = Archival Information Package DIP = Dissemination Information Package SIP DIP Administration PRODUCERPRODUCER CONSUMERCONSUMER queries result sets MANAGEMENT Ingest Access Data Management Archival Storage Descriptive Info. Preservation Planning orders AIP Archive Functional Entities The Archive Environment from 10,000 ft CONSUMERCONSUMER PRODUCERPRODUCER MANAGEMENT

6 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Current State – NOAA Archives CLASS Web Interface Users CLASS Data Providers NOAA’s Data Centers Web Interfaces Users Data Providers Mirror Tape Warehouses FGDC Metadata Centers of Data Users Web Interfaces Metadata? ? Courtesy NGDC

7 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Transitional State – NOAA Archives CLASS Web Interface Users CLASS Data Providers NOAA’s Data Centers Direct Access Users Data Providers Application Interface (NOAA Server) APIs Mirror Services Mirror NOAA Metadata Manager and Repository Users Interfaces Warehouse Centers of Data Metadata? ? Courtesy NGDC

8 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Final State – NOAA Archives CLASS Web Interface Users CLASS Data Providers NOAA’s Data Centers Direct Access Users Data Providers NOAA Web Services APIs Mirror Services Mirror Centers of Data Centers of Data Providers APIs Mirror NOAA Metadata Manager and Repository Data Discovery Users

9 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Archive Plans for NPOESS

10 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Archive Plans for NPOESS  Interface Data Processing Segment (IDPS) –Data Delivery Subsystem (DDS) - request for & receipt of: –NPP Data Products (RDRs, SDRs/TDRs, IPs, EDR/ARPs, geolocation) –Two-line Elements (TLEs) and Mission Schedules –Official Dynamic Ancillary Data –Data Delivery Reports (DDR) –Consolidated Data Delivery Reports (CDDR) –Data Quality Monitoring (DQM) - receipt of: –DQM Reports  NOAA’s Climate Data Record Project –Long-term Climate data and metadata  Ground Integrated Support Facility (GISF) - receipt of: –Software Release Packages that include source code and Look Up Tables –Documentation Release Packages that include External Interface Control Documents, the CDFCB-X Volumes, Product Profiles, OADs, and ATBDs. –Supporting Data Release Packages that include Processing Coefficient Tables, Sensor Calibration Table Updates, DQTTs, QST IPs, and Official Static Ancillary Data. –Test Data Release Packages  Command, Control and Communications Segment (C3S) - request for: –request via the WRS for DQM Reports

11 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview and Status II Challenges and New Opportunities  Archive must validate the data are independently understandable –Work with customers to use archived data  Archive will receive different and more data than centrals –Build ISO metadata catalog for easy customer access  Volume of data is daunting –Explore compression and use of raw data records