Presentation is loading. Please wait.

Presentation is loading. Please wait.

Jeff Ator.  Convert incoming observational data of varying types and formats into BUFR for NCEP observational database in /dcom/us007003  49 different.

Similar presentations


Presentation on theme: "Jeff Ator.  Convert incoming observational data of varying types and formats into BUFR for NCEP observational database in /dcom/us007003  49 different."— Presentation transcript:

1 Jeff Ator

2  Convert incoming observational data of varying types and formats into BUFR for NCEP observational database in /dcom/us007003  49 different decoders at last count  Processing is controlled through DBNet (developed by NCO) and LDM (developed by Unidata)  On dedicated WCOSS nodes managed by NCO PMB dataflow team  Data-driven (pushed to us from GTS, MADIS and other sources), rather than clock-driven via cron or ecFlow  Separate from satellite ingest processing maintained by EMC obsproc team  And where data arrival is generally clock-driven (pulled/mirrored via ecFlow from remote servers)

3 DBNet Receives incoming files or WMO GTS bulletins LDM Calls appropriate decoder for each file or bulletin Decoders Processes file or bulletin and converts to BUFR DBNet Ingests BUFR into observational database

4  The LDM controls and manages the simultaneous running of multiple decoders  Most run continuously “in core” until a specified timeout is reached

5  Consists of a C driver (for interfacing with UNIX operating system), with most lower-level subprograms in FORTRAN  Each one is versioned separately within /nwprod/decoders on WCOSS  vs. updating the entire suite when only changing one decoder  Built using common Makefiles, “include” files and libraries within /nwprod/decoders/decod_shared  GEMPAK  BUFRLIB  MADIS  DECOD_UT (general decoder utility library)  and others…

6  A master spreadsheet, linking every decoder (both LDM-based and obsproc-based) to its corresponding input type, WCOSS location and observational database type(s), is available from Google Drive Google Drive  There is also a parallel (development/testing) decoder suite running in real-time on WCOSS  Source code, etc. stored in /home/decdev  Observational database output stored in /dcomdev/us007003  Big Brother is used to monitor the real-time performance of both the production and development suites


Download ppt "Jeff Ator.  Convert incoming observational data of varying types and formats into BUFR for NCEP observational database in /dcom/us007003  49 different."

Similar presentations


Ads by Google