1. 4/27/2004 Fred Branski April 27, 2004 NOAA/NWS Telecommunication Gateway GTS System

2. 4/27/2004 National Weather Service Telecommunication Gateway The Primary Data Communications Switching Facility of the NWS Operated 24 X 7 by the Telecommunication Operations Center Which is Part of the Office of the Chief Information Officer Housed in a Highly Resilient Facility with Dedicated Power and Environmental Systems

3. 4/27/2004 National Weather Service Telecommunication Gateway Serves the U.S. Public, Government and Commercial Hydrometeorological, Oceanographic, Climatological and Emergency Management Communities Critical Acquirer and Provider of Data and Products to and from Many Systems and Agencies

4. 4/27/2004 National Weather Service Telecommunication Gateway The Advanced Weather Interactive Processing System (AWIPS) and NOAAPort Network Control Facility (NCF) The ASOS Operations and Monitoring Center (AOMC) Aggressively Pursuing an Alternate Operational Facility

5. 4/27/2004 National Weather Service Telecommunication Gateway ICAO - The Communications Portion of the Washington World Area Forecast System (WAFS) Center Aeronautical Fixed Telecommunication Network (AFTN) Switch OPMET Data Bank Server Critical to the Aviation Community for Acquiring and Providing Timely Data and Products

6. 4/27/2004 National Weather Service Telecommunication Gateway WMO - The Communications Portion of the Washington World Meteorological Center Regional Telecommunication Hub (RTH) for WMO Region IV Provides the Path for U.S. Meteorological and Related Products to the Rest of the World and for their Products Back into the U.S.

7. 4/27/20047 NWSTG Structure & Function Components 3 Mainframes – Active, standby, test & development >70 Unix servers (HTTP, FTP, File server, communications, data processing) >2 terabytes of online storage >160 point-to-point communication circuits 7 internal networks

8. 4/27/20048 NWSTG Structure & Function

9. 4/27/20049 NWSTG Structure & Function Message Processing Data input from various sources Data is identified by WMO or AWIPS heading Data stored in a receive queue along with information retrieved from a switching directory (>130,000 entries) Some data selected for processing which may generate new products Data written to transmit queue(s) based on switching directory information Data sent to destination(s)

10. 4/27/200410 NWSTG Structure & Function Message Processing >850,000 messages received daily >8.5 billion bytes received daily

11. 4/27/200411 WMO Global Telecommunication System Main Trunk Network

12. The Improved MTN (IMTN) The planned IMTN configuration should be achieved in 2004 Exeter Sofia Cloud II Melbourne Buenos Aires Tokyo Beijing New Delhi Nairobi Cairo Toulouse Dakar Algiers Moscow Washington Brasilia Offenbach Jeddah Prague Frame Relay Frame Relay by BT Ignite by BT Ignite Frame Relay Frame Relay by Equant by Equant Cloud I Cloud I

13. 4/27/200413 MTN Connectivity in RAII &V (slide from Hiroyuki ICHIJO (JMA)

14. Specific characteristics of IMTN data- communication clouds Cloud I Frame Relay Melbourne Tokyo 1.5Mbps Washington 256kbps Bracknell 256kbps Access circuit 1.5Mbps 32kbps 16kbps CIR= 768kbps 32kbps 64kbps 32kbps PVC Flexibility of establishing logical connections (PVC) Asymmetric bandwidths (CIR: Committed Information Rate)

15. 4/27/2004 Observations $Over 450,000 Observations Distributed Daily $ 152,000 Surface Observations $ 3,100 Upper Air Observations $ 4,700 Ship Reports $ 46,000 Aircraft Reports $ 48,000 DCP Reports $ 200,000 Satellite Reports $ Observations from 33,000 Places

16. 4/27/2004 Model Output $Over 96,000 Model Products Distributed Daily $ 9 NCEP Models Run Daily $ Hurricane, Volcanic Ash and Hydrological Dispersion Model as Needed $ EPA Air Quality Forecast $ Also from Canada, United Kingdom, Japan, Australia, NWS River Forecast Centers, DoD and ECMWF

17. 4/27/2004 Text Products $Over 36,000 Text Products Distributed Daily $ 23,800 NWS Produced Text Products $ 7,000 other U.S. Agency Text Products $ 5,300 International Text Products

18. 4/27/2004 Pictorial Products $Over 2,000 Pictorial Products Distributed Daily $ Most in Red Book Graphic Format $ OFCM Standard FCM-S2 $ CCITT T4 Fax and GIF products also

19. 4/27/200419 Data Input to the NWSTG NWS (ASOS, WFOs, NCEP National Centers) – observations, guidance, forecasts, watches & warnings, national products FAA (ASOS) – aviation observations & intnl data DoD (FNMOC, AFWA) DoT (Coast Guard) – marine reports Other Government and Scientific Sources (NOS, OAR, USDA, Scripps Institute, SeaKeepers, etc.) – observations FEMA, DoA, EPA ICAO (ISCS, AFTN) – aviation data WMO (GTS MTN, Other GTS) – meteorological and hydrological data Commercial community

20. 4/27/200420 Data Input to the NWSTG Data Input Methods IP Sockets X.25 Asynchronous FTP – http://weather.gov/tg/ftpingest.htmlhttp://weather.gov/tg/ftpingest.html Email – http://weather.gov/tg/emailingest.htmlhttp://weather.gov/tg/emailingest.html Web - http://weather.gov/tg/bullguid.htmlhttp://weather.gov/tg/bullguid.html

21. 4/27/200421 Data Input to the NWSTG

22. 4/27/200422 Data Input to the NWSTG

23. 4/27/200423 NWSTG Data Dissemination - Push Broadcast, multicast, and point-to-point data dissemination: NOAAPORT NWWS - NOAA Weather Wire Service EMWIN – Emergency Manager’s Weather Information Network ISCS – International Satellite Communications System FOS – Family of Services

24. 4/27/200424 NWSTG Data Dissemination - Push ISCS – International Satellite Communications System Supports two data dissemination requirements for – –ICAO World Area Forecast System (WAFS) – –WMO Regional Meteorological Telecommunication Network for Region IV (North America) supporting two-way communication (RMTN/GTS) C-band satellite coverage for – –US area of responsibility - 30°W to 120°E – –European area of responsibility - 100°E to 30°W (SADIS)

25. 4/27/200425 NWSTG Data Dissemination - Push ISCS – International Satellite Communications Data includes aviation weather and other meteorological, hydrological, and climatological products Six data streams – –WAFS Text, GRIB, and Facsimile – –RMTN Text, GRIB, and Facsimile Volume: >630MB/day >180,000 Products/day More Information at – –http://weather.gov/tg/iscscvr.htmlhttp://weather.gov/tg/iscscvr.html – –http://www.nws.noaa.gov/iscs/http://www.nws.noaa.gov/iscs/

26. 4/27/200426 NWSTG Data Dissemination - Push International Satellite Communications System

27. ATLANTIC OCEAN REGION (AOR)  The AOR portion of the successor ISCS will be centered around the WorldCom shared Master Satellite Hub, in Andover, Maine.  The Master Satellite Hub will be linked via a 64 Kbps (128Kbps bursting) terrestrial (redundant) circuit to the National Weather Service Telecommunications Gateway (NWSTG) in Silver Spring, Maryland.  The NWSTG will continue to serve as the central point of data entry into the ISCS.  All ISCS data originating at the NWSTG will be transmitted, using TCP/IP network protocol, over to the WorldCom Andover facility for broadcast to all ISCS AOR sites.

28. 4/27/200428 NWSTG Data Dissemination - Push International Satellite Communications System RMTN two-way sites shown in orange

29. ISCS WAFS – Pacific Ocean Region

35. 4/27/200435 NWSTG Data Dissemination - Push EMWIN – Emergency Managers Weather Information Network Hemispheric direct broadcast using GOES East/West Data includes a watches & warnings, forecasts, graphics, satellite imagery Volume: >85MB/day Used to distribute data to Emergency Managers More Information at – –http://iwin.nws.noaa.gov/emwin/index.htmhttp://iwin.nws.noaa.gov/emwin/index.htm

36. 4/27/200436 NWSTG Data Dissemination - Push EMWIN – Satellite Footprint

37. 4/27/200437 EMWIN Architecture

38. 4/27/200438 NWSTG Data Dissemination - Push NOAAPORT AWIPS satellite broadcast network (SBN) C-band satellite covering the entire US Data includes NCEP model products, satellite imagery, observations, forecasts, watches & warnings Volume: >23 GB/day >2,000,000 Products/day Used to distribute data to – –NWS field offices (WFOs and RFCs) – –Commercial Users with NOAAPORT Receiver Systems More Information at http://www.nws.noaa.gov/noaaport/html/noaaport.shtml http://www.nws.noaa.gov/noaaport/html/noaaport.shtml

39. 4/27/200439 NWSTG Data Dissemination - Push AWIPS Network Control Facility (ANCF) NOAAPORT (SBN) 3.5 T1 Circuits: NCEP/NWSTG Data GOES East GOES West Non-GOES Imagery/DCP 140+ AWIPS Field Sites NOAAPORT Receive System (NRS) Weather and Forecast Products Satellite Imagery Americom 4 C-Band Master Ground Station (MGS) 4 T1 Circuits Source: NGIT AWIPS Briefing, L. Klet

40. 4/27/200440 NWSTG Data Dissemination - Push NWWS – NOAA Weather Wire Service Nationwide satellite distribution system for text products C-band and Ku-band satellite covering the entire US Data uplinked from 14 WFOs/RFCs, 6 National Centers Data includes forecasts, watches & warnings Volume: >8 GB/day Used to distribute data to – –Media – –Emergency Managers More Information at – –http://www.nws.noaa.gov/nwws/http://www.nws.noaa.gov/nwws/ – –http://dynis.dyncsc.com/contracts/nwws/index.htmlhttp://dynis.dyncsc.com/contracts/nwws/index.html

41. 4/27/200441 NWSTG Data Dissemination - Push NWWS – System Data Flow Source: Detailed NWWS Data Collection Flowchart

42. 4/27/200442 NWSTG Data Dissemination - Push FOS – Family of Services (Push) Point-to-point and multicast communication services Serves commercial customers on a cost recovery basis More information at – –http://www.nws.noaa.gov/datamgmt/fos/fosindex.htmlhttp://www.nws.noaa.gov/datamgmt/fos/fosindex.html FOS Offerings Public Product Service Domestic Data Service International Data Service High Resolution Data Service Radar Product Service Server Access Service (not push)

43. 4/27/200443 NWSTG Data Dissemination - Push FOS – Family of Services (Push) Public Product Service (PPS) – –9.6 kbps, asynchronous transmission – –All Watches & Warnings, selected forecast, hydrologic, and agricultural products – –Volume: >14,000 product/day, >60MB/day Domestic Data Service (DDS) – –9.6 kbps, asynchronous transmission – –Observations and forecasts for the CONUS – –Volume: >35,000 product/day, >55MB/day

44. 4/27/200444 NWSTG Data Dissemination - Push FOS – Family of Services (Push) International Data Service (IDS) – –9.6 kbps, asynchronous transmission – –Worldwide observations and forecasts – –Volume: >42,000 product/day, >35MB/day High Resolution Data Service (HRS) – –56 kbps, X.25 transmission – –Model-derived forecasts and analyses (mostly GRIB) – –Volume: >62,000 product/day, >315MB/day Detailed information about PPS, DDS, IDS, and HRS products are available at http://weather.gov/datamgmt/fos/fospage.html http://weather.gov/datamgmt/fos/fospage.html

45. 4/27/200445 NWSTG Data Dissemination - Push FOS – Family of Services (Push) Radar Product Service (RDS) – –1.5 Mbps, IP Multicast transmission – –WSR-88D Level III products – –Volume: >800,000 product/day, 8 to 11GB/day Detailed information about RPS is available at http://weather.gov/tg/rpccds.html http://weather.gov/tg/rpccds.html Detailed information about PPS, DDS, IDS, and HRS products are available at http://weather.gov/datamgmt/fos/fospage.html http://weather.gov/datamgmt/fos/fospage.html

46. 4/27/200446 NWSTG Data Dissemination - Push Products Provided via Push Content managed by the Data Management group in the Operations Support and Performance Branch Changes made on a daily basis in response to operational requirements and customer requests Products identified in the NWSTG (the Switching Directory) listed at http://weather.noaa.gov/tg/wmohdg.shtml http://weather.noaa.gov/tg/wmohdg.shtml Products pushed via FOS, ISCS, NOAAPORT, and EMWIN listed at http://weather.noaa.gov/tg/dir_subset.shtml http://weather.noaa.gov/tg/dir_subset.shtml

47. 4/27/200447 NWSTG Data Dissemination - Pull Servers provide access to stored data through various server protocols FTP – Access to data files via anonymous FTP at ftp://tgftp.nws.noaa.gov (since 1993!)ftp://tgftp.nws.noaa.gov FTPMail – Email based FTP for clients without the ability to establish interactive sessions HTTP – Access to data files via http://weather.noaa.gov/pub (since 1994!) http://weather.noaa.gov/pub FOS Server Access Services – FTP access through a dedicated connection

48. 4/27/200448 NWSTG Data Dissemination - Pull FTP – Access to data files via anonymous FTP at ftp://tgftp.nws.noaa.gov including ftp://tgftp.nws.noaa.gov NCEP model output http://weather.gov/tg/modfiles.html http://weather.gov/tg/modfiles.html Product files (multiple messages or bulletins per file) http://weather.gov/tg/txtfiles.html http://weather.gov/tg/obsfiles.html http://weather.gov/tg/txtfiles.html http://weather.gov/tg/obsfiles.html WSR-88D Level III products http://weather.gov/tg/radfiles.html http://weather.gov/tg/radfiles.html Satellite products http://weather.gov/tg/satfiles.html http://weather.gov/tg/satfiles.html Facsimile products http://weather.noaa.gov/fax/index.html http://weather.noaa.gov/fax/index.html See http://weather.gov/tg/dataprod.html for more informationhttp://weather.gov/tg/dataprod.html

49. 4/27/200449 NWSTG Data Dissemination - Pull FTPMail – Email based FTP Access to all FTPable products on ftp://tgftp.nws.noaa.gov ftp://tgftp.nws.noaa.gov Email an FTP command sequence to ftpmail@weather.noaa.gov ftpmail@weather.noaa.gov Used primarily in the maritime community to retrieve products via satellite email services See http://weather.gov/tg/ftpmail.html for usage detailshttp://weather.gov/tg/ftpmail.html

50. 4/27/200450 NWSTG Data Dissemination - Pull HTTP – Access to data files Access all the products at ftp://tgftp.nws.noaa.gov without FTP overhead at http://weather.noaa.gov/pub ftp://tgftp.nws.noaa.govhttp://weather.noaa.gov/pub Provides more browsable alternative to FTP Application-based HTTP file transfers are often faster than FTP Traditional interactive Web services include – –http://weather.govhttp://weather.gov – –http://weather.noaa.govhttp://weather.noaa.gov – –http://iwin.nws.noaa.govhttp://iwin.nws.noaa.gov

51. 4/27/200451 NWSTG Data Dissemination - Pull FOS Server Access Services (SAS) – FTP access through a dedicated connection SAS customers establish a point-to-point connection with and NWS router Customer router hosting at the NWSTG for balanced multiple-circuit connections 64Kb, T1, multiple-T1, and T3 connections Access to a non-public anonymous FTP server holding the same data as ftp://tgftp.nws.noaa.gov ftp://tgftp.nws.noaa.gov

52. 4/27/200452 NWSTG Data Dissemination - Pull File Formats Single product files: http://weather.noaa.gov/pub/data/raw/wg/wghw70.phfo.ffs.hi.txt http://weather.noaa.gov/pub/data/raw/wg/wghw70.phfo.ffs.hi.txt Multiple product files: http://weather.noaa.gov/pub/SL.us008001/DF.an/DC.sflnd/DS.metar/sn.0021.txt http://weather.noaa.gov/pub/SL.us008001/DF.an/DC.sflnd/DS.metar/sn.0021.txt See http://weather.gov/tg/fstandrd.html for a description of how products are delimited within a filehttp://weather.gov/tg/fstandrd.html Non-headed product files: http://weather.noaa.gov/pub/SL.us008001/ST.opnl/MT.eta_CY.00/RD.20040108/PT. grid_DF.bb/fh.0000_tl.press http://weather.noaa.gov/pub/SL.us008001/ST.opnl/MT.eta_CY.00/RD.20040108/PT. grid_DF.bb/fh.0000_tl.press CWA-specific, Zone-specific or named files: http://weather.noaa.gov/pub/data/forecasts/zone/wa/waz007.txt http://weather.noaa.gov/pub/data/records/wa/seattle.txt http://weather.noaa.gov/pub/data/forecasts/zone/wa/waz007.txt http://weather.noaa.gov/pub/data/records/wa/seattle.txt

53. 4/27/200453 NWSTG Data Dissemination - Pull Directory Structures Descriptive directory naming: http://weather.noaa.gov/pub/data/forecasts/zone/wa/waz007.txt http://weather.noaa.gov/pub/data/records/wa/seattle.txt http://weather.noaa.gov/pub/data/forecasts/zone/wa/waz007.txt http://weather.noaa.gov/pub/data/records/wa/seattle.txt See http://weather.gov/tg/engfiles.htmlhttp://weather.gov/tg/engfiles.html Encoded Directory naming: http://weather.noaa.gov/pub/SL.us008001/DF.an/DC.sflnd/DS.metar/sn.00 21.txt http://weather.noaa.gov/pub/SL.us008001/ST.opnl/MT.eta_CY.00/RD.200 40108/PT.grid_DF.bb/fh.0000_tl.press http://weather.noaa.gov/pub/SL.us008001/DF.an/DC.sflnd/DS.metar/sn.00 21.txt http://weather.noaa.gov/pub/SL.us008001/ST.opnl/MT.eta_CY.00/RD.200 40108/PT.grid_DF.bb/fh.0000_tl.press See the Directory and File Naming Standards document at http://www.nws.noaa.gov/datamgmt/filstnd.html to understand how to decode http://www.nws.noaa.gov/datamgmt/filstnd.html

54. 4/27/200454 NWSTG Data Dissemination - Pull Directory Structures – decoding example http://weather.noaa.gov/pub/SL.us008001/DF.an/DC.sflnd/DS.metar/sn.0021.txt SL.us008001 – server location: United States (us), NWSTG (008), Server 1 (01) DF.af – data format: WMO bulletins of alphanumeric data as GTS exchanged (ASCII) DC.sflnd – data category: Surface data (land) DS.metar – data subcategory: Aviation – METAR sn.0021.txt – sequence number file (21 st in the sequence) containing text data

55. 4/27/200455 NWSTG Data Dissemination - Pull Directory Structures – decoding example http://weather.noaa.gov/pub/SL.us008001/ST.opnl/MT.eta_CY.00/RD.20040108 /PT.grid_DF.bb/fh.0000_tl.press SL.us008001 – server location: United States (us), NWSTG (008), Server 1 (01) ST.opnl – status of data files: operational MT.eta – model type: Eta Forecast Model CY.00 – cycle of run: 00 UTC RD.20040108 – reference date: January 08, 2004 PT.grid – product type: gridded DF.bb – data format: WMO bulletins of binary fields in GRIB as GTS exchanged fh.0000 – forecast hour 0000 UTC tl.press – type of level or layer: pressure

56. 4/27/2004 KWBC Weather Bureau Communications Began as a manual data collection and distribution center in World War II 1954 - 9 Teletype Circuits 1966 - 2 IBM 360 Computers 104 Ckts, one at 3.6k bps 1992 - 3 HDS 9060 Computers T1 to NMC (NCEP) 1998 - 2 IBM 9672, 1 IBM 9673 2 IBM 6000/F50 servers 2 IBM 6000/H50 servers 10 Mbs Ethernet to NCEP ATM and multiple T1s Today?

57. 4/27/2004 A View of the Past

58. 4/27/200458 Your Data and Product Advocates Data Management Staff P Fred Branski - Team Leader, Data Management fred.branski@noaa.gov (301) 713-0864 ext 146 P Julie Hayes - Family of Services Manager julie.hayes@noaa.gov (301) 713-0864 ext 120 P Walter Smith - Senior Data Manager walter.smith@noaa.gov (301) 713-0864 ext 139 P Richard Robinson - Data Manager richard.robinson@noaa.gov (301) 713-0864 ext 179 P Sharon Abbas – Data Manager sharon.abbas@noaa.gov (301) 713-0864 ext 120 P Tom King – Statistics Analysis and Support tom.king@noaa.gov (301) 713-0864 ext 110 P KWBC Communication Control Center (CCC) - Tech Control <Point of contact 24 hours every day  Phone: (301) 713-0902 < Fax : (301) 587-1773

59. 4/27/2004 National Weather Service Telecommunication Gateway GTS System Questions / Discussion