LAPS Data Ingest 1 Steve Albers 1, Yuanfu Xie Global Systems Division NOAA/OAR/ESRL 1 CIRA at GSD Acknowledgements: FAB 2 nd LAPS User Workshop, 25 October.

Slides:



Advertisements
Similar presentations
Sponsored by the National Science Foundation GENI I&M Workshop NetCDF and Local Data Manager (LDM) Mike Zink November 4, 2010
Advertisements

Presented by Limin Zhao, Stan Kidder, and ??????.
Inputs: Digital and 4 configurable for Digital or 10 bit Analog Outputs:4 - 8 amp Relays or 700ma Transistors (1 PWM) 4 Line by 18 Character fully.
LAPS Analysis & Software by Steve Albers. 2 Basic Solution LAPS coupled with MM5 NWP model Use diabatic initialization (“hot start”) Utilize parallel.
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Notes by Ligia Bernardet Recommendations from breakout group 2 Session 2 (Thu, 10/25/2012) Our group.
ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.
CARPE DIEM 2 nd meeting - WP 2 Developed at FSL/NOAA - Forecasting System Laboratory Mesoscale analysis system Exploitation of standard data (Synop, Metar,
BusinessObjects XI R2 Upgrade University of Michigan Administrative Information Services Update: BusinessObjects XI R2 Upgrade Laura Bollettino February.
ERAU Weather Archive Status Update 6 October 2009.
Senior Design Project (COE 485) Group 2 Week 8. OUTLINE User Interface (GUI) User Interface (GUI) Java program Java program Demo Demo NMEA NMEA GPS receiver.
Installing Ricoh Driver. Items you need to know IP address of Printer Options that are installed And Paper Sizes To get all this information you can print.
Hongli Jiang, Yuanfu Xie, Steve Albers, Zoltan Toth
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch October 8, 2008.
CEOS/WGISS 20, Kyev, September 12-16, WTF-CEOP Implementation Plan #1 Status (WTF-CEOP first prototype, by JAXA) September 12, 2005 Osamu Ochiai.
ElVis Developments for Simulation and Analysis Programs Tarun Pondicherry Summer 2006 Science Ed High School Intern Eliot Feibush, Mentor 8/16/2006.
Quick Unidata Overview NetCDF Workshop 25 October 2012 Russ Rew.
© Crown copyright Met Office Introduction to IDV PRECIS Reading Workshop, August 2009.
All-sky imagery: Observations and Simulations with the Local Analysis and Prediction System (LAPS) Steve Albers 1,2, Kirk Holub 1, Hongli Jiang 1,2, Yuanfu.
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
WRF Domain Wizard The WRF Preprocessing System GUI Jeff S Smith Paula McCaslin and Mark Govett AMS 2008 Presentation.
Global Systems Division (GSD) ‏ Information and Technology Services (ITS) ‏ Java Methods for Radar & Satellite Data Ingest Bob Lipschutz NOAA/ESRL/GSD/ITS/Data.
Operational Issues from NCDC Perspective Steve Del Greco, Brian Nelson, Dongsoo Kim NOAA/NESDIS/NCDC Dongjun Seo – NOAA/NWS/OHD 1 st Q2 Workshop Archive,
STMAS runs FAA: surface analysis, CONUS runs: MIT and backup; 5-minute ASOS runs: w-asos/n-asos (OSE); CWB: CWB surface reanalysis; CWB real time full.
Topics Covered Phase 1: Preliminary investigation Phase 1: Preliminary investigation Phase 2: Feasibility Study Phase 2: Feasibility Study Phase 3: System.
Chapter 10 Software Engineering. Understand the software life cycle. Describe the development process models. Understand the concept of modularity in.
A Sequential Hybrid 4DVAR System Implemented Using a Multi-Grid Technique Yuanfu Xie 1, Steven E. Koch 1, and Steve Albers 1,2 1 NOAA Earth System Research.
LAPS / STMAS Verification Activities Steve Albers, Isidora Jankov ESRL / GSD Verification Summit September 2011 Updated Sep 7, 2011.
Introduction Zoltan’s information Matrix (consider a list of people in the branch, maybe take the time to go around the room for brief introductions) Strategic.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
Cooperative Institute for Meteorological Satellite Studies University of Wisconsin - Madison ABI and AIRS Retrievals in McIDAS-V Kaba Bah.
Navigation and Ancillary Information Facility NIF Introduction to WebGeocalc October 2014 SPICE components and services are not restricted under ITAR and.
MADIS Airlines for America Briefing Meteorological Assimilated Data Ingest System (MADIS) FPAW Briefing Steve Pritchett NWS Aircraft Based Observations.
Amir Iqbal L Mahwish Khan L Rabia Akhtar L Nida Sarwar L Cloud Computing Based – Online IDE.
An Update on COLA’s Software Development Jennifer M. Adams and Brian Doty.
Marcelo R.N. Mendes. What is FINCoS? A set of tools for data generation, load submission, and performance measurement of CEP systems; Main Characteristics:
TIGGE Archive Status at NCAR THORPEX Workshop and 6th GIFS-TIGGE Working Group Meetings WMO Headquarters Geneva September 2008 Steven Worley Doug.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
The LAPS Cloud Analysis: Validation with All-Sky Imagery and Development of a Variational Cloud Assimilation Steve Albers 1,2, Kirk Holub 1, Hongli Jiang.
Planning Categories Traditional LAPS Analysis LAPS Analysis (Traditional / STMAS) LAPS Forecast / WRF OAR/ESRL/GSD/Forecast.
Cal/Val for physics MED-MFC internal meeting CMCC-INGV-SOCIB Lecce E. Clementi, INGV.
Advanced Charts Lesson 9. Objectives 1. Create charts by using data from other applications. 2. Modify chart types. 3. Add and modify chart options. 4.
The Fusion of Radar Data and Satellite Imagery With Other Information in the LAPS Analyses Steve Albers August 10, 2010.
CWB Midterm Review 2011 Forecast Applications Branch NOAA ESRL/GSD.
All-Sky Visualization Using the the Local Analysis and Prediction System (LAPS) Steve Albers 1,2, Yuanfu Xie 1, Vern Raben 3, Zoltan Toth 1, Kirk Holub.
Satellite Data as used in the Local Analysis and Prediction System (LAPS) Steve Albers May 13, 2008.
CURRENT DEVELOPMENTS OF LAPS INGEST PROCESSES AT METEOCAT Area of Applied Research and Modelling – SMC Jordi More & Abdel Sairouni.
5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.
Solvency II Tripartite template V2 and V3 Presentation of the conversion tools proposed by FundsXML France.
Software Development LAPS Workshop Oct 25-27, 2010 More info (including Forum) at: OAR/ESRL/GSD/Forecast.
STMAS/LAPS for Convective Weather Analysis and Short-range Forecast
Steve Albers, Kirk Holub, Yuanfu Xie (CIRA & NOAA/ESRL/GSD)
COP 4343 Unix System Administration
OCTOPUS – SeaDataNet Format conversion tool
PRECIS Reading Workshop, August 2009
Yuanfu Xie, Steve Albers, Hongli Jiang Paul Schultz and ZoltanToth
NOAA - LAPS Albers, S., 1995: The LAPS wind analysis. Wea. and Forecasting, 10, Albers, S., J. McGinley, D. Birkenheuer, and J. Smart, 1996:
The Fusion of Radar Data and Satellite Imagery With Other Information in the LAPS Analyses Steve Albers April 15, 2002.
PRECIS Reading Workshop, August 2009
Tools for generation of SDN NetCDF (CFPOINT) files
One Approach For Handling NYT Wires
Requirements on GSICS Plotting Tool to support VISNIR products
Status for Endeavor 6: Improved Scientific Data Access Infrastructure
Lightning NextGen Workshop
Icing NextGen Workshop
Masaya Takahashi Japan Meteorological Agency
Presentation transcript:

LAPS Data Ingest 1 Steve Albers 1, Yuanfu Xie Global Systems Division NOAA/OAR/ESRL 1 CIRA at GSD Acknowledgements: FAB 2 nd LAPS User Workshop, 25 October 2012 Updated Oct 26

2 Data Acquisition Flow Chart

3  Publically available data sources Some are supported in LAPS If unsupported, should they be added to repository?  Locally available data Each user sets up modified data ingest Types of Data Sources

4 1)Convert your data to NetCDF / GRIB input formats supported by LAPS Ingest Easy to port when installing new LAPS updates Conversion is done prior to running LAPS 2)Run a process independent of LAPS ingest that creates intermediate file (sched.pl may need modification) 3) Modify LAPS ingest software to handle your data Not recommended unless data format is general enough for widespread use and software changes can be added to LAPS repository Data Acquisition Strategies

5 Data Acquisition Information  For each data type Where to find publically available data How to set up interface with unsupported or local data

6 Wide Radar Volume Processing

7  Level-II Radar now processed from Volume Files  Java Satellite Interface now available Obtain data from NESDIS ADDE server  MADIS Hydro and HADS data now supported  Improved surface obs QC (e.g. stuck temperature/wind) Recent Data Acquisition Improvements

8  Wideband Radar now processed from Volume Files Augments existing options Portable Java Interface Processes Level-II data (e.g. from UNIDATA) Writes out one NetCDF file for each volume scan Can be remapped from polar to Cartesian format with ‘remap_polar_netcdf.exe’  Description and Download available:  Currently supports reflectivity and radial velocity  Future support for Dual-Polarization parameters Radar Volume Files

9  GPS Total Delay  Radar Dual-Polarization (e.g. for precip type) Airborne Radar Phased Array Radar (every minute)  GOES-R  Radiometers  Pyranometers (Solar Radiation) New Data Sources

Thanks Questions? More info at 10