McIDAS-XCD Status Kevin Baggett UW-SSEC. McIDAS-XCD Update  McIDAS GRIB server has continued its stable performance following the -XCD 2006 release (-

Slides:



Advertisements
Similar presentations
1 jNIK IT tool for electronic audit papers 17th meeting of the INTOSAI Working Group on IT Audit (WGITA) SAI POLAND (the Supreme Chamber of Control)
Advertisements

Interfacing BUFR to NMC Systems Jeff Ator NOAA National Weather Service United States of America WORLD METEOROLOGICAL ORGANIZATION RA.
Kevin Baggett September 9, Kevin Baggett, Dan Forrest, Kevin Hallock, Jay Heinzelman, Dave Parker, Roseann Spangler, Becky Schaffer, Jerrold Robaidek.
New Resources in the Research Data Archive Doug Schuster.
Basic Response Letter Last Updated Basic Response Letter The response redesign in SERFF 5.6 introduces the concept of inline schedule item.
LAPS Analysis & Software by Steve Albers. 2 Basic Solution LAPS coupled with MM5 NWP model Use diabatic initialization (“hot start”) Utilize parallel.
Execute Stored Procedure having Output Parameter and returning Result Set in Adeptia Server.
“Where America’s Climate, Weather and Ocean Services Begin” NCEP CONDUIT UPDATE Brent A Gordon NCEP Central Operations January 31, 2006.
IT Project Management, Third Edition Appendix A1 Appendix A: Guide to Using Microsoft Project 2002.
McIDAS-V McIDAS-V The 5 th Generation of McIDAS by Tom Whittaker Space Science and Engineering Center University of Wisconsin-Madison USA with contributions.
Integrating NDFD with GIS Billy Brooks I.M. Systems Group, Inc. NOAA/NOS/Coastal Services Center NDFD Technical Workshop November 2, 2006.
Testing an individual module
Jeff Ator.  Convert incoming observational data of varying types and formats into BUFR for NCEP observational database in /dcom/us  49 different.
GEMPAK-AWIPS II Discussion Unidata Policy Committee Meeting 12 May 2008.
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.
UPDATING TABLE DRIVEN CODE FORMS 18 April 2006 (Joël Martellet, WMO, World Weather Watch, Data Processing and Forecasting Systems)
Norwegian Meteorological Institute met.no Recent development at met.no EGOWS 2008, Ljubljana Michael O. Akinde Martin L. Sætra Bjørn K. Larsen.
Configuration Management Managing Change. Points to Ponder Which is more important?  stability  progress Why is change potentially dangerous?
CEOS/WGISS 20, Kyev, September 12-16, WTF-CEOP Implementation Plan #1 Status (WTF-CEOP first prototype, by JAXA) September 12, 2005 Osamu Ochiai.
FireRMS SQL Audit, Archiving & Purging Presented by Laura Small FireRMS Quality Assurance.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 16 October 2007.
What is Sure BDCs? BDC stands for Batch Data Communication and is also known as Batch Input. It is a technique for mass input of data into SAP by simulating.
Lecture 1 Saima Gul. What is a Project? A Project is a job that has a beginning and an end (time), a specified outcome ( scope) at a stated level of quality.
Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.
SSEC Data Center Data 2010 MUG Meeting Jerrold Robaidek.
Audio Dial In: or CRM to RM Visual CRM to MS-CRM 2007 Visual User Group Nov 21 st 2007.
Design and Programming Chapter 7 Applied Software Project Management, Stellman & Greene See also:
Accessing and Utilizing AMDAR Data for NWP Applications David R. Helms Office of Science and Technology NOAA National Weather Service AMDAR Regional Workshop.
What’s New in SEER-H 7.3 The Galorath Team. New Features Currency and Exchange Rate (with Multi-Currency option) Addin Enhancement Local Quantity, Schedule.
M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.
2010 MUG Meeting Jerrold Robaidek M cIDAS- XCD McIDAS X C onventional data D ecoder McIDAS-XCD files, decodes and indexes the NOAAPORT data stream (or.
Jerrold Robaidek May 7,  Kevin Baggett, Kevin Hallock, Dave Parker, Roseann Spangler, Becky Schaffer, Jerrold Robaidek.
By John Metz Warning Coordination Meteorologist WFO Corpus Christi.
Training Guide for Inzalo SOP Users. This guide has been prepared to demonstrate the use of the Inzalo Intranet based SOP applications. The scope of this.
CISL/DSS & MMM Data Discussion 19 March Who CISL/DSS - maintain NCEP operational analyses and observation datasets – Gregg Walters, Doug Schuster,
© Mahindra Satyam 2009 Configuration Management QMS Training.
Global Systems Division (GSD) ‏ Information and Technology Services (ITS) ‏ Java Methods for Radar & Satellite Data Ingest Bob Lipschutz NOAA/ESRL/GSD/ITS/Data.
Christopher Juckins Meteorologist/Programmer Technical Support Branch, NHC Christopher Juckins Meteorologist/Programmer Technical Support Branch, NHC GFE.
Rebecca Cosgrove NCEP/NCO/Production Management Branch March 26, 2015
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 8 June 2015.
McIDAS-XCD Status Kevin Baggett UW-SSEC.  DVB-S = Digital Video Broadcast by Satellite  NWS changed to this system in March 2005  Software supplied.
National Weather Service Goes Digital With Internet Mapping Ken Waters National Weather Service, Honolulu HI Jack Settelmaier National Weather Service,
NOAA’s National Weather Service NDFD Dissemination Services Allan Darling Office of the CIO, Telecommunication Operations Center National Digital Forecast.
Preprocessing : status and plans Arjo Segers, Hans Cuijpers.
SunGuide TM 4.0 Functionality Data Fusion: How Data is Managed June 24, 2008.
Chapter 27 - Faxes & File Transfer (FTP) Introduction Sending a Fax –The Internet can be used to send a fax. Two fax machines can be modified to communicate.
McIDAS-V Status and Demonstration by Gail Dengel Tom Whittaker University of Wisconsin-Madison SSEC 2005 MUG Meeting October 27-28, 2005 Madison, WI.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
Scott Lindstrom [Mr. Server] Dave Parker [Mr. MySQL] Kevin Baggett [Mr. XCD] The ADDE GRIB server.
McIDAS-X Software Development and Demonstration Rick Kohrs and Jay Heinzelman 7 May 2012.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 2 June 2009 PDA Animated Weather (PAW) Status by Russ Dengel.
ADO .NET from. ADO .NET from “ADO .Net” Evolution/History of ADO.NET MICROSOFT .NET “ADO .Net” Evolution/History of ADO.NET History: Most applications.
Reporter Training for High School RIO TM
Current Status of the Tracking Trigger Software Andrew W. Rose.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 25 October 2010.
Managing multiple projects or services? Have a mix of Microsoft Project and more simple tasks? Need better visibility and control?
Source Control Dr. Scott Schaefer. Version Control Systems Allow for maintenance and archiving of multiple versions of code / other files Designed for.
Online Database Work Overview Work needed for OKS database
McIDAS-X Software Development and Demonstration
Step 1 Create Database Info activity in Adeptia Server specifying the driver, URL and user credentials information for the database in which stored.
Source Control Dr. Scott Schaefer.
TIGGE Archives and Access
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.
Chapter 13 Quality Management
Development and Futures of Research Data Archives
Status for Endeavor 6: Improved Scientific Data Access Infrastructure
McIDAS-XCD, GRIB2 and NOAAPORT Status
Steven Worley, Douglas Schuster,
David Cleverly – Development Lead
Rebecca Cosgrove NCEP/NCO/Production Management Branch April 11, 2011
Presentation transcript:

McIDAS-XCD Status Kevin Baggett UW-SSEC

McIDAS-XCD Update  McIDAS GRIB server has continued its stable performance following the -XCD 2006 release (- XCD GRID filing still available but very limited support)  GRIB2 file support continues for those files that come across the NOAAPORT feed or as requested by McIDAS users  BUFR file naming conventions have improved but some file sources remain unidentified and are labeled as “UNKN”

GRIB2 Files Update  GRIB2 files available mainly over the NGRID and CONDUIT feeds using the LDM  NOAAPORT has continued to send GRIB1 data over the WMO/HDS feed and will do so for the foreseeable future  GRIB1 was discontinued on the NCEP and TOC FTP servers on January 28, 2008, and replaced entirely by GRIB2 No schedule to change to GRIB2 has been established

GRIB2 Issues  Lack of geographic ID in GRIB2 conflicted with the -XCD naming of GRIB1 files Navigation parameters can still be determined from the data, however Using the file grib2NavLookup.txt, -XCD matches the navigation parameters with the MUG Team defined GRIB2 model name e.g. NAM-USLCAW12 is the NAM Lambert Conformal 12-km AWIPS grid

GRIB-2 Issues (continued)  Uniform naming of GRIB files is desired, especially in relation to a future archive GRIB server  MUG Team and the Datacenter have determined that naming all files with the GRIB2 naming convention is the way to proceed Eventually the files on NOAAPORT will all be converted to GRIB2 Archived GRIB1 data will still need to be accessed Currently, a one-to-one correspondence between existing GRIB1/GRIB2 files has been difficult to track down It appears that any future model data will be created in GRIB2 format, but yet NOAAPORT continues to send GRIB1 data

GRIB2 Tables  Identification of GRIB2 data has continued as new data comes in grib2NavLookup.txt and grib2NCEPModels.txt allow for the identification of GRIB2 model data based on the data's navigation parameters If -XCD users come across unknown GRIB2 data, they can use the “grib2nav” executable to get the navigation parameters to add to their own copies of grib2NavLookup.txt grib2Parameters.txt allows for the identification of GRIB2 data parameters such as temperature, pressure, and wind speed based on Discipline, Category, and Number If -XCD users come across unknown GRIB2 parameters, they can add the new ones to their own copies of grib2Parameters.txt Not sure what to do with 255, 255, 255 that has cropped up recently

GRIB2 Available Datasets via LDM (RTGRIB2 via McADDE) NOAAPORT NCE-* (NCEP) GFS-USLCAWI4 GFS-AKPS2 PSS-* NGRID DGEX-* GLW-* FGF-* MGWM-* LMP-* NAM-* GFS-* NDF-* RTM-* NMM-* RUC(13 km) SREF-* CONDUIT GFS (0.5/1.0 degree) RUC (20/40/80 km) In MUG documents, we say that we support NOAAPORT. Although the number of files has increased on NOAAPORT via the WMO/HDS feed, most of the volume of GRIB2 data comes across the NGRID and CONDUIT feeds. This data has not been thoroughly tested and we would like to know what GRIB2 data you use to better direct those testing efforts.

BUFR Data  -XCD currently files BUFR data coming across the NOAAPORT stream  For -XCD 2008, we introduced an improved naming convention for these files using categories from BUFR Table A  5 BUFR versions showing up – 1, 2, 3, 4, and even 0!  Files are named according to this version and an SSEC-defined name derived from Table A for that version e.g., QUIKSCAT bufr3 is named using the bufrVersion3TableA.txt file derived from information found at g.doc/table_1.htm

BUFR Data (continued) WMO BufrCommon pdf from s.html (Common Code Tables link)‏ Common Code Table C-13 at c8-c14.htm  BUFR Edition 4 files are defined further by international subcategories  The source of the namings for bufrVersion4TableA.txt comes from 2 locations:  Some data remains unclassified due to incomplete tables and this data has a file prefix of “UNKN”

BUFR Server?  In the XCD talk, we mentioned a BUFR server would be available for a 2008 release  This used Java code produced by Robb Kambic at Unidata that decoded the BUFR data  We did get a limited BUFR server working using PTLIST/PTDISP commands in McIDAS-X and attempted to get this working with McIDAS-V  However, this remains a work in progress; we can provide the BUFR server code for users to test and investigate

Miscellaneous -XCD Changes  Nested Grid Model (NGM) was removed for -XCD  Terminal Aerodrome Forecast (TAF) data decoding was updated to account for the new 30-hour format in - XCD 2008a  The existing weather text server was modified to accommodate an archived weather text server and has been in use in the SSEC Data Center since early 2009  MD files now properly handle FEW cloud coverage

Future -XCD Rewrite  Some discussion about a future -XCD rewrite  Efficiency improvements  Easier-to-read code  Better interface with the LDM/McIDAS-V  Utilize a database (such as SQLite) for replacing constructs such as Rapid Access Pointer/Text files  Streamlined and uniform upgrade procedure to reduce the possibility for error