Introduction to CDO Gulilat Tefera Diro Centre ESCER,

Slides:



Advertisements
Similar presentations
ATMO5332 WRF-ARW Tutorial 0.01”.
Advertisements

Exercise 7.5 (p. 343) Consider the hotel occupancy data in Table 6.4 of Chapter 6 (p. 297)
BUSINESS DRIVEN TECHNOLOGY Decision Analysis Tools in Excel
Decision Analysis Tools in Excel
Climate Specific Tools: The cdutil Package. cdutil - overview The cdutil Package contains a collection of sub- packages useful to deal with Climate Data.
The NCAR Command Language (NCL) and the NetCDF Data Format Research Tools Presentation Matthew Janiga 10/30/2012.
RAMADDA for Big Climate Data Don Murray NOAA/ESRL/PSD and CU-CIRES Boulder/Denver Big Data Meetup - June 18, 2014.
Word Lesson 11 Customizing Tables and Creating Charts Microsoft Office 2010 Advanced Cable / Morrison 1.
Statistical tools in Climatology René Garreaud
Welcome to E-Prime E-Prime refers to the Experimenter’s Prime (best) development studio for the creation of computerized behavioral research. E-Prime is.
Introduction to NetCDF Ernesto Munoz. Outline Overview of NetCDF Overview of NetCDF NetCDF file information NetCDF file information CDL utilities: ncdump,
© Crown copyright Met Office SRNWP Interoperability Workshop, ECMWF, January 2008 SRNWP Interoperability Terry Davies Met Office.
Chapter 11 Solved Problems 1. Exhibit 11.2 Example Linear and Nonlinear Trend Patterns 2.
Hydrologic Statistics
Preparing Data for Analysis and Analyzing Spatial Data/ Geoprocessing Class 11 GISG 110.
Spatial Interpolation of monthly precipitation by Kriging method
Introduction to Hands On Training in CORDEX South Asia Data Analysis
Introduction to Hands On Training in CORDEX South Asia Data Analysis
CS 497C – Introduction to UNIX Lecture 7: General-Purpose Utilities Chin-Chih Chang
Driving UM-SCM with reanalysis / model data Vaughan Barras ACCESS Model Development Group.
P366: Lecture #1 Use of Excel for analysis Lei Chen, MD Jan 6, 2002.
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
XP 1 Excel Tables Purpose of tables – Process data in a group – Used to facilitate calculations – Used to enhance readability of output Types of tables.
The WinMine Toolkit Max Chickering. Build Statistical Models From Data Dependency Networks Bayesian Networks Local Distributions –Trees Multinomial /
Barcelona, 06 May 2015 s2dverification Seasonal to decadal forecast verification in R Overview Nicolau Manubens.
NetCDF Operators 1 netCDF Operators [NCO]
© Crown copyright Met Office An Introduction to Linux, PP utilities, CDO and NCL Bangkok Workshop, 26 th February– 1 st March 2013.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
CCAM Regional climate modelling Dr Marcus Thatcher Research Scientist December 2007.
Copyright 2008 McGraw-Hill Ryerson 1 TECHNOLOGY PLUG-IN T7 PROBLEM SOLVING USING ACCESS.
Excel Workshop CHEM 2001, FALL Make some calculations Always begin a function with ‘=‘ Multiply X and Y Multiply X by 50 (2 methods) – Absolute.
Chris Lynnes, NASA Goddard Space Flight Center NASA/Goddard EARTH SCIENCES DATA and INFORMATION SERVICES CENTER (GES DISC) Analyzing.
Climate Data Formats Deniz Bozkurt
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
Climate Forecasting Unit CFU R common diagnostics CFU_load CFU_season CFU_clim CFU_anoCFU_anocrossvalid CFU_plotclimCFU_plotano CFU_smoothing CFU_trend.
Status and Plans of the Global Precipitation Climatology Centre (GPCC) Bruno Rudolf, Tobias Fuchs and Udo Schneider (GPCC) Overview: Introduction to the.
This document gives one example of how one might be able to “fix” a meteorological file, if one finds that there may be problems with the file. There are.
Regional Climate Model Evaluation System based on satellite and other observations for application to CMIP/AR downscaling Peter Lean 1, Jinwon Kim 1,3,
Statistical Analyses of Historical Monthly Precipitation Anomalies Beginning 1900 Phil Arkin, Cooperative Institute for Climate and Satellites Earth System.
EGR 115 Introduction to Computing for Engineers User-Defined Functions1 – Part 1 Wednesday 22 Oct 2014 EGR 115 Introduction to Computing for Engineers.
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
Introduction to Information and Computer Science
T7-1 LEARNING OUTCOMES – ACCESS PROBLEM SOLVING 1.Describe the process of using the Simple Query Wizard using Access 2.Describe the process of using the.
Data Storage System, Model Output and Analysis Tools PRECIS Workshop Tanzania Meteorological Agency 29 th June – 3 rd July 2015.
INTRODUCTION TO ACCESS. OBJECTIVES  Define the terms field, record, table, relational database, primary key, and foreign key  Create a blank database.
00/XXXX 1 Data Processing in PRISM Introduction. COCO (CDMS Overloaded for CF Objects) What is it. Why is COCO written in Python. Implementation Data Operations.
1 Adventures in Web Services for Large Geophysical Datasets Joe Sirott PMEL/NOAA.
An introduction to CDO, NCL and PRECIS utilities
Presentation on Database management Submitted To: Prof: Rutvi Sarang Submitted By: Dharmishtha A. Baria Roll:No:1(sem-3)
Climate-SDM (1) Climate analysis use case –Described by: Marcia Branstetter Use case description –Data obtained from ESG –Using a sequence steps in analysis,
NetCDF Operators 1 netCDF Operators [NCO]
Some of the utilities associated with the development of programs. These program development tools allow users to write and construct programs that the.
Lesson 5-Exploring Utilities
(Network Common Data Form)
Plug-In T7: Problem Solving Using Access 2007
TIGGE Archives and Access
Chapter 6 Filters.
INTRODUCTION TO UNIX: The Shell Command Interface
The cf-python software library
Lesson 1: Introduction to Trifacta Wrangler
Lesson 1: Introduction to Trifacta Wrangler
Lesson 1: Introduction to Trifacta Wrangler
Lesson 1: Introduction to Trifacta Wrangler
Welcome to E-Prime E-Prime refers to the Experimenter’s Prime (best) development studio for the creation of computerized behavioral research. E-Prime is.
NetCDF and Scientific Data Standard
Programming Funamental slides
Inside Module 8 Extracting Data Page Using the Extract command 2
Seasonal Forecasting Using the Climate Predictability Tool
NCL variable based on a netCDF variable model
Analyzing Reliability and Validity in Outcomes Assessment
Presentation transcript:

Introduction to CDO Gulilat Tefera Diro diro@sca.uqam.ca Centre ESCER, Département des sciences de la Terre et de l’atmosphère Université du Québec à Montréal (UQAM)

2 Simple visualization tool (ncview) 3 Climatological mean calculation Contents Introduction to CDO 2 Simple visualization tool (ncview) 3 Climatological mean calculation 4 Area averaged mean annual cycle calculation Selected topic: Arithmetics with CDO Interpolation Correlation

1. Introduction to CDO CDO – stands for Climate Data Operators - is a free open source tool - CDO is a collection of operators to manipulate and analyze climate and forecast model data. - Developed at Max-Planck-Institute for Meteorology https://code.zmaw.de/projects/cdo/wiki - Supported file formates:GRIB1/2,netCDF3/4

Netcdf, ncdump and Nciew NetCDF -> “Network Common Data Form” NetCDF: is self describing, portable, machine independent data format Netcdf is supported by a number of tools e.g. Ncview, NCO, CDO and also by Matlab, python, etc Ncdump is a netcdf utility that allows one to dump the contents of the netcdf file to a screen or to a file. - Files are often too big to dump to screen, but one can look at subsets of the file using the different ncdump options.e.g. $ncdump -h erain_surf_1982_2002_6hrly_monmean.nc Dump header from netCDF file to screen (see next slide)

Ncview is a simple visualizing tool which allows one to quickly viewthe variables inside a netcdf file. e.g. $ ncview erain_surf_1982_2002_6hrly_monmean.nc

Exercises Use ncdump to examine ERA-Interim surface file. Find a variable of your choice , then open up the same file using ncview, and plot that variable.

Back to CDO: sample operations Categories Description Example File information Print information about the datasets cdo sinfo file.nc File operations Copy,split,merge datasets cdo cat fil1.nc file2.nc file12.nc Selection Select part of the dataset cdo selmon,06/08 file.nc out_jja.nc Comparison Compare datasets cdo eq Modification Arithmetic Perform arithmetic operation to dataset cdo add conv.nc lsp.nc totpr.nc Statistic Ensemble, field, vertical, time statistics cdo timmean input.nc out.nc interpolation Perform horizontal,vertical, time interpolation cdo remapcon,grid.txt inp.nc out.nc Adv.statistics Trend,correlation, eof, filtering cdo timcor sst.nc wnd.nc out.nc

Usage and output format Bash$ cdo <option> <operator>input.nc <out.nc> Global option for all operators: - h Help information for the operators e.g : $cdo -h <operator> - f <format> Format of the output file (e.g. grb, nc) e.g: $cdo -f nc copy input.grb out.nc -r Converts from absolute to relative time axis e.g: $cdo -r -f nc copy input.grb out.nc

1.2 Information about the structure and content of netCDF file Infov writes information about the structure and content of the netCDF file to screen. $ cdo infov inputfile.nc or $ cdo sinfov inputfile.nc Compare this with ncdump i.e. $ ncdump -h inputfile.nc For simple visualization of a netcdf file $ ncview inputfile.nc

2. Climatological seasonal mean calculation e.g. calculate the 1982-2002 seasonal (MAM) mean values. timmean calculate the mean over all time steps in a file. We have combined timmean with selmon and selyear to be selective about the time period (e.g . selecting only MAM-the 3rd,4th and the 5th months) Step by step: bash$cdo selmon,3,4,5 inputfile.nc out_mam.nc bash$cdo selyear,1982/2002 out_mam.nc out_mam_82_02.nc bash$cdo timmean out_mam_82_02.nc output.mam_mean.nc Piping Reduce unnecessary disk I/O Note sometimes commands are too long to fit on one line,if a line does not start with $,the command is continued on the next line and you should not press enter until it is complete. bash$ cdo timmean -selmon,3,4,5 -selyear,1982/2002 inputfile.nc output.mam_mean.nc bash$ ncview output.mam_mean.nc

3. Mean annual cycle calculation 1.a) Extract the area around Great Plains of the US from the monthly precipitation data by specifying long and lat co-ordinates. sellonlatbox allows you to extract an area from fields by choosing lon1,lon2,lat1,lat2. bash$ cdo sellonlatbox,-110,-95,40,48 inputfile.nc outputfile_grtplns.nc 1.b) calculate monthly mean fields for all the time steps 1982-2002 for each of the twelve months for the Great Plains area. ymonmean computes the mean of all the time steps of multiple years in each month. bash$cdo ymonmean -selyear,1982/2002 outputfile_grtplns.nc grtplns_monmean.out.nc To visualize the output bash$ ncview grtplns_monmean.out.nc

4. Annual Cycle averaged over Montreal area step by step bash$ cdo sellonlatbox ,-74,-70,42,45, input.nc out-box.nc bash$ cdo fldmean out-box.nc out-box-fldmean.nc bash$ cdo ymonmean out-box-fldmean.nc out-box-ymonmean.nc piping: bash$ cdo ymonmean -fldmean-sellonlatbox,-74,-70,42,45 input. nc out-box-ymonmean.nc bash$ ncview out-box-ymonmean.nc

Create your own ’ENSO index’ from ERA-Interim SST data Exercise Create your own ’ENSO index’ from ERA-Interim SST data (120W to 170W and 5S – 5N)

5. More on piping Eg: standard deviation of JJAS precipitation anomalies Step by step: bash$ cdo selmon,6,7,8,9 input.nc out-jjas.nc bash$ cdo timmean out-jjas.nc out-jjas-mean.nc bash$ cdo sub out-jjas.nc out-jjas-mean.nc out-jjas-anom.nc bash$ cdo timstd out–jjas-anom.nc out-jjas-std.nc Piping bash$ cdo timstd -sub -selmon,6,7,8,9 input.nc -timmean - selmon,6,7,8,9 input.nc out-jjas-std.nc bash$ncview out-jjas-std.nc

6. Wind speed from U and V component Wind speed=sqrt(u**2 + v**2) step by step bash$ cdo sqr uwind.nc uwind-sqr.nc bash$ cdo sqr vwind.nc vwind-sqr.nc bash$ cdo add uwind-sqr.nc vwind-sqr.nc wind-add.nc bash$ cdo sqrt wind-add.nc wind-spd.nc Piping Bash$ cdo sqrt -add -sqr uwnd.nc-sqr vwind.nc wind-spd.nc bash$ncview wind-spd.nc

Interpolation with CDO You can use remapbil or remapcon operators for interpolation N.B. first,you need to prepare the grid description of the target domain. You can use cdo griddes e.g. to interpolate Era-interim data to GPCP grides $cdo griddes gpcp_dat.nc >gpcpgrid.txt $cdo remapcon,gpcpgrid.txt erain_data.nc erain_data_atgpcpresol.nc

Correlation with CDO