Near Real-Time Data Access - PDA Presenter: Donna McNamara, Data Access Manager NOAA / NESDIS / OSPO / Mission Operations Division (MOD) Contributors: Don Slater, ESPDS Transition to Operations Lead (contractor) NOAA / NESDIS / OSGS / PETD / CDACCB Chris Sisko, Data Operations Manager NOAA Satellite Conference – April 29, 2015

Presentation Outline The Focus of this presentation is on data access to the near real-time distribution systems, DDS (today) and PDA (tomorrow). Overview of the Office of Satellite and Product Operations Overview (OSPO) Processing and Distribution (today) Processing and Distribution (near future) – PDA Data Access Overview Contingency data access (near future) Summary Q&A PDA – Product Distribution and Access (Enterprise Distribution)

NOAA Satellite Operations Facility NESDIS Office of Satellite and Product Operations (OSPO) Supported Missions Command and Control, Ingest, Product Generation and Distribution for the nation’s 15 environmental satellites 3 Geostationary (GOES) by NOAA 3 Polar-Orbiting (POES) by NOAA 6 Defense Meteorological Satellite Program (DMSP) operated by NOAA 1 OSTM Jason-2 (Ocean Surface Topography Mission) Joint NOAA, NASA, CNES, EUMETSAT effort 1 Suomi National Polar-orbiting Partnership (NPP) by NOAA & NASA 1 DSCOVR (Solar Observatory) by NOAA & NASA NOAA Satellite Operations Facility Pre-Launch and Post-Launch Testing Operational Testing, Validation, and Verification User Readiness Long-Term Continuity of Products and Services

NESDIS Office of Satellite and Product Operations (OSPO) OSPO has locations at four major facilities. NOAA Satellite Operations Facility (NSOF) in Suitland, Maryland Mission Operations Division NOAA Center for Weather & Climate Prediction (NCWCP) in College Park, Maryland. Satellite Product and Services Division Command and Data Acquisition Stations in Alaska and Virginia. NSOF Fairbanks CDAS NCWCP Wallops CDAS

OSPO (Satellite Operations, Processing and Distribution) SNPP/JPSS-1 (PM) POES NOAA-19 Center for Satellite Applications and Research (STAR) GOES-West GOES-East Non-NOAA (Jason2, DMSP, Meteosat, MTSAT, Metop, EOS, COSMIC, others) Product Development Algorithm Development Science Maintenance Office of Satellite and Product Operations (OSPO) METOP-B/C (AM) TDRSS Fairbanks Wallops Svalbard McMurdo / Troll Command and Control Processing and Distribution Satellite Operations Control Center Environmental Satellite Processing Center Suitland Data and Products Customers Office of Satellite Ground Services (OSGS) Ground Systems Development and Sustainment, IT Enterprise Architecture Archive and Access NESDIS Data Centers

Data Processing and Distribution (Today) NDE (NPP Data Exploitation) provides NPP data and derived products. GEODIST provides McIDAS products via ADDE. McIDAS products are satellite imagery and primarily GOES derived products DDS (Data Distribution Server) provides all other non-McIDAS operational products. GINI (GOES Ingest NOAAPORT Interface) provides data to the NWS AWIPS Satellite Broadcast Network (SBN) and to NOAAPORT.   Existing data access process: Users complete a standard data access request form found at: URL: http://www.ospo.noaa.gov/Organization/About/access.html Technical assessment conducted to ensure system and infrastructure resources are available to service the request. Access is reviewed and adjudicated by the Data Access Review Board to validate the near real-time access requirement. Data activation and subscriptions are actively managed by OSPO/ESPC personnel.

Data Access Policy: http://www. ospo. noaa Requestors must: Have an operational need for near real-time data Agree to adhere to the rules of behavior on the Data Access Request form Understand that requests may be prioritized due to data volume issues. Send request to: NESDIS.data.access@noaa.gov

Processing and Distribution (near Future) - PDA Purpose of the Production Distribution and Access (PDA) system is to serve as the NESDIS enterprise distribution system for our near real-time users. All near real-time distribution except for McIDAS will be migrated to PDA – phased approach (new missions and then current missions). McIDAS ADDE access will remain on GEODIST systems for the foreseeable future. GOES-R products will be provided to AWIPS2/Satellite Broadcast Network (SBN), GOES Re-Broadcast (GRB) and the primary PDA system at NSOF. S-NPP/JPSS products will be provided via PDA. PDA is being developed for OSPO by the Office of Satellite Ground Services (OSGS). PDA Distribution Service Improvements: User managed subscriptions User managed search and tailoring Enhanced security controls / transfer protocols Enhanced reporting and control for system optimization Ability to handle large data volumes

High Data Volumes - Example Example of bandwidth capacity needed to transfer one full orbit of uncompressed S-NPP data as a function of time. Key points: Data transfers can only go as fast as the slowest link speed. Accessing new mission data via terrestrial communication circuits require significant bandwidth capacity increase. Vast amounts of new data require capacity changes by provider and end user. Need 1 Gbps of available bandwidth capacity to transfer one full orbit of data in 38 mins

PDA Systems There are three PDA instantiations: Full Operational System at NSOF S-NPP/JPSS, GOES-R and current mission data Test system at NSOF Internal test system only Smaller capacity operational contingency system at Consolidated Back-Up (Fairmont, West Virginia) S-NPP/JPSS data (prime mission sensor only) GOES-R data only available via GRB (GOES Re-Broadcast) and AWIPS

Future Contingency Operations Note In the event of an outage at the primary Facility (NSOF in Suitland, MD), PDA access is transferred to the Consolidated Back-up in Fairmont, West Virginia, to support only the JPSS/S-NPP mission. Data fail-over requirement is under 12 hours. Just the JPSS primary mission sensor data will be available, since the backup system is smaller scale than the operational system at NSOF. Supports both full and partial failover scenarios i.e. GOES-R can be nominal a NSOF while JPSS is failed over to CBU This flexibility requires different network addresses at NSOF and CBU, therefore Pull users will need to change to CBU if needed.

PDA Schedule Internal readiness reviews: Operational Readiness Review (ORR) scheduled for 30 October 2015 System Acceptance Review (SAR) scheduled for 6 January 2016 Actual near real-time data flow is dependent upon the new JPSS ground system upgrade (Jan 2016) Existing users of S-NPP NDE system are already being integrated or are in the process of being scheduled for integration. Existing users with further questions should contact: Donna McNamara (Data Access Manager) donna.mcnamara@noaa.gov Chris Sisko (JPSS Data Operations Manager) chris.a.sisko@noaa.gov Matt Seybold (GOES-R Data Operations Manager) matthew.seybold@noaa.gov New users with questions should contact NESDIS Satellite User Services: NESDIS.Data.Access@noaa.gov

PDA User Training PDA user training will be made available in the Fall of 2015. A PDA external User’s Guide will be available as well. Training will be done locally in the Washington area, as well as remotely via Webinar. Primary PDA Training POC: Don Slater, don.slater@noaa.gov, 301-817-4168 Linda – add Don Slater as POC.

Summary The PDA will be the authorized enterprise distribution system for our near real-time users. PDA will enable OSPO to: deliver the large mission data (such as GOES-R, JPSS, etc.) to authorized users, have greater management control and insight into distribution, and enable NESDIS to more easily scale to meet future distribution demands while ensuring a secure distribution framework.

Questions?

Contact Information & Social Media Author Contact Info: Donna McNamara, donna.mcnamara@noaa.gov, 301-817-3803 Don Slater, don.slater@noaa.gov, 301-817-4168 Chris Sisko, chris.a.sisko@noaa.gov, 301-817-4455 24/7 Help Desk ESPCOperations@noaa.gov User Services SPSD.UserServices@noaa.gov Data Access NESDIS.Data.Access@noaa.gov Webmaster SSDWebmaster@noaa.gov Web www.ospo.noaa.gov www.facebook.com/NOAANESDIS www.twitter.com/noaasatellites