1. Powerful and Free: Open-source Software that Water Resources Professionals can use for Data Analysis and Visualization Kenneth R. Odom, PhD, PE Hydro Services - Reservoir Management Section Southern Company 2012 Alabama Water Resources Conference

2. What we’ll cover … Gnuplot – data visualization, smoothing, curve-fitting R – data visualization, probability, statistics, modeling, simulation, optimization, etc. Text editing Other open-source software

3. Gnuplot command window

4. Gnuplot example 1 #year count 1700 5 1701 11 1702 16 1703 23 1704 36 1705 58 1706 29 1707 20 1708 10 … gnuplot> plot sunspot_data.txtgnuplot> plot sunspot_data.txt with lines FILE: sunspot_data.txt

5. Gnuplot example 2 #DATE PPT TEMP 1931 0115 75 1931 0267 74 1931 03193 73 1931 04173 86 1931 05110 90 1931 06210 97 1931 07421 97 1931 0884 95 1931 0980 97 … FILE: fairhope_data.txt gnuplot> load ‘fairhope_data.gp’ reset set xdata time set timefmt ‘%Y %m’ set format x ‘%Y-%m’ set grid plot fairhope_data.txt using 1:3 with lines FILE: fairhope_data.gp

6. Gnuplot example 2 #DATE PPT TEMP 1931 0115 75 1931 0267 74 1931 03193 73 1931 04173 86 1931 05110 90 1931 06210 97 1931 07421 97 1931 0884 95 1931 0980 97 … FILE: fairhope_data.txt gnuplot> load ‘fairhope_data.gp’ reset set xdata time set timefmt ‘%Y %m’ set format x ‘%Y-%m’ set grid set style line 2 lt 1 lw 2 pt 4 lc rgb ‘blue’ set title ‘Maximum Monthly Event Precipitation’ set xlabel ‘Year-Month’ set ylabel ‘Precipitation (in)’ plot [‘1970 01’: ‘1975 12’][]fairhope_data.txt \ using 1:($3/100) w lp ls 2 t ‘Fairhope’ FILE: fairhope_data.gp

7. Gnuplot example 3 USGS Fish River near Silver Hill, AL #DATE(1) TIME(2) CDT(3) FLOW(4) CODE(5) PPT(6) CODE(7) 2010-04-01 00:00 CDT 98 A 0.00 A 2010-04-01 00:15 CDT 0.00 A 2010-04-01 00:30 CDT 98 A 0.00 A 2010-04-01 00:45 CDT 0.00 A 2010-04-01 01:00 CDT 98 A 0.00 A 2010-04-01 01:15 CDT 0.00 A 2010-04-01 01:30 CDT 98 A 0.00 A … FILE: fish_river_data.txt

8. Gnuplot example 3 USGS Fish River near Silver Hill, AL

9. FILE: fish_river.gp gnuplot> load ‘fish_river.gp’

10. Gnuplot example 3 USGS Fish River near Silver Hill, AL

11. Gnuplot example 4 USGS Village Creek at Ensley, AL #DATE(1)TIME(2)CDT(3)FLOW(4)CODE(5)TEMP(6)CODE(7)SC(8)CODE(9)DO(10)CODE(11) 2012-08-08 00:00 CDT 44 P 26.1 P 435 P 5.6 P 2012-08-08 00:15 CDT 46 P 2012-08-08 00:30 CDT 46 P 2012-08-08 00:45 CDT 46 P 2012-08-08 01:00 CDT 46 P 25.9 P 422 P 5.4 P 2012-08-08 01:15 CDT 47 P 2012-08-08 01:30 CDT 53 P 2012-08-08 01:45 CDT 57 P 2012-08-08 02:00 CDT 58 P 25.8 P 417 P 5.4 P 2012-08-08 02:15 CDT 60 P 2012-08-08 02:30 CDT 58 P 2012-08-08 02:45 CDT 57 P 2012-08-08 03:00 CDT 55 P 25.6 P 426 P 5.4 P … FILE: village_creek.txt

12. Gnuplot example 4 USGS Village Creek at Ensley, AL FILE: village_creek.gp gnuplot> load ‘village_creek.gp’

13. Gnuplot example 4 USGS Village Creek at Ensley, AL

15. Gnuplot resources Website: www.gnuplot.infowww.gnuplot.info -Software -Examples -Documentation -Tutorials Google ‘gnuplot’

16. R – statistical computing www.r-project.org

17. R – ‘the old way’

18. USGS field streamflow measurements numdate timehtqratingqChanwidthareavel 4851987-04-29 16:200.7130.0FAIR30.029.023.01.30 4861987-05-27 12:301.0769.4FAIR69.431.033.12.10 4871987-07-10 11:151.0661.4FAIR61.431.033.01.86 4881987-08-04 14:050.8136.5FAIR36.528.025.41.44 4891987-09-03 11:400.5415.5FAIR15.526.318.00.86 4901987-10-08 12:150.5716.1FAIR16.127.018.30.88 … FILE: granby_colorado_gage.txt

19. Using R – ‘the new way’ R-studio

20. Cahaha River data

21. Stateline data (Coosa River)

22. www.rstudio.org

23. R Commander

26. R-stats books

27. r www.r-bloggers.com

28. emacs

32. Notepad ++

33. Other software Image processing: – Image J, Inkscape (similar to Illustrator), Gimp (similar to Photoshop) Matlab “like” software – Octave, Sage, SciLab Text editors – Emacs, XEmacs, Notepad2, Notepad++, PSPad, Gedit, Geany Programming/Scripting – Python 2.7.3 (Python 3.0 is working but under active development) – ERIC is a good python IDE – IPython and IPython notebook – http://vislab-ccom.unh.edu/~schwehr/rt/ (IPython, Emacs, R) http://vislab-ccom.unh.edu/~schwehr/rt/ – gawk (subset large data files, pattern searching) Office productivity – LibreOffice (similar to MS Office) – Gnumeric (good standalone spreadsheet but lacks full documentation) – Abiword (standalone word processor)

34. Contact information Email: kodom@southernco.comkodom@southernco.com Phone: 205-257-7783