28 Feb 2008UNI GeoTREE Visit Iowa Environmental Mesonet: Using Open Source GIS Tools and Web Services to Disseminate Environmental Data Daryl Herzmann.

Slides:



Advertisements
Similar presentations
Traditional Metadata *National Hydro Network, Natural Resources Canada.
Advertisements

A Roadmap of Open Source components for GI Web Services and Clients A Paul R Cooper MAGIC.
Windows NT server and workstation Name: Li Shen Course: COCS541 Instructor: Mort Anvari.
Kick-off meeting Delft, April FP – SPACE no Data Fast First step in data management – repository Gerrit Hendriksen Gerben.
Comparative Precipitation Analysis and Validation of NEXRAD (Stage III) Data, Stream Flow Data, and Rain Gauge Data located in the San Antonio Basin Jayar.
TOOLS FOR FINDING GIS DATA ON THE INTERNET Purdue University Erin Huang Graduate Research Assistant Purdue University Nicole Kong GIS.
Harish Sangireddy The University of Texas at Austin.
Building an online tool for spatial joins using open source software Karsten Vennemann Seattle.
Integrating NDFD with GIS Billy Brooks I.M. Systems Group, Inc. NOAA/NOS/Coastal Services Center NDFD Technical Workshop November 2, 2006.
Development of a Community Hydrologic Information System Jeffery S. Horsburgh Utah State University David G. Tarboton Utah State University.
Mapserver The Oregon Experience David Percy Geospatial Data Manager, Geology Department Portland State University Digital Mapping Techniques, 2006 Conference.
OPEN SOURCE GIS Comparing Quantum GIS to Open Jump.
Bentley Geospatial Server. Value Proposition The Geospatial Server provides a secured centralized environment to contain the explosion of information.
WHAT IS PHP PHP is an HTML-embedded scripting language primarily used for dynamic Web applications.
PHP and MySQL Week#1  Course Plan.  Introduction to Dynamic Web Content.  Setting Up Development Server Eng. Mohamed Ahmed Black 1.
Mobile Mapping Systems (MMS) for infrastructural monitoring and mapping are becoming more prevalent as the availability and affordability of solutions.
The Geo Portal Project 28 th Nov, 2014 Manarii Etches Emergency Management Cook Islands Please fill participants list.
FENIX Architecture Overview of the application framework FAO Statistics Division.
ASIACOVER Spatial Database Engine Based on GeoNetwork OpenSource Technology.
GIS technologies and Web Mapping Services
NWS VTEC/Polygon Stuff Daryl Herzmann Iowa Environmental Mesonet Iowa State University.
7 Nov Geospatial Interoperability Summit Iowa Environmental Mesonet: Using Open Source GIS Tools and Web Services to Disseminate Environmental.
27 Feb 2004: NWS WFO DVN The Iowa Environmental Mesonet Daryl Herzmann 1 Dr Ray Arritt 1 Dr Dennis Todey 2 1 Iowa State.
1 Web Server Administration Chapter 1 The Basics of Server and Web Server Administration.
Iowa Environmental Mesonet: Building the Iowa Environmental Mesonet Daryl Herzmann Iowa State University Department of.
Using PostGIS and MapServer in the Census Interaction Data Service Presentation to AGI Technical SIG 'Open-Source in GIS' British Antarctic Survey, Cambridge,
21 Nov 2003: NWS WFO FSD The Iowa Environmental Mesonet Daryl Herzmann 1 Dr Ray Arritt 1 Dr Dennis Todey 2 1 Iowa State.
Rainfall Runoff Prediction Designed and presented by George Limpert in association with CARES and Chris Barnett Mentor: Dr. Neil Fox.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
Environmental Monitoring: Database and Beyond Chengyang Zhang Computer Science Department University of North Texas.
12.3 Using Open GIS web services to serve environmental data 21rst IIPS: Session 12 GIS Applications 12.3 Using Open GIS web services to serve environmental.
Implementing Web GIS Solutions using open source software Karsten Vennemann Seattle.
The Open Source Spatial Services Kit: Lowering the Cost of Deploying Services on the Geo-Web Presented by Ben Lewis Advanced Technology Solutions, Inc.
Mini Group Presentations: php by Veronica Black + Jia Xu.
2010 MUG Meeting Jerrold Robaidek M cIDAS- XCD McIDAS X C onventional data D ecoder McIDAS-XCD files, decodes and indexes the NOAAPORT data stream (or.
Using the Mesonet Daryl 30 March 2015.
AMS 2003: IIPS, GIS APPLICATIONS 6.4 Iowa Environmental Mesonethttp://mesonet.agron.iastate.edu Using GIS for Environmental Data in Iowa Dr Dennis Todey.
PHP Features. Features Clean syntax. Object-oriented fundamentals. An extensible architecture that encourages innovation. Support for both current and.
The IEM-KCCI-NWS Partnership: Working Together to Save Lives and Increase Weather Data Distribution.
Exploring Spatial Data Infrastructure in an Open Source World Jacqueline Lowe UNC-Asheville National Environmental Modeling and Analysis Center Jacqueline.
National Weather Service Goes Digital With Internet Mapping Ken Waters National Weather Service, Honolulu HI Jack Settelmaier National Weather Service,
GIS and the National Weather Service
Iowa Environmental Mesonet Iowa Environmental Mesonet Past, Present, & Future Dr Dennis Todey Daryl Herzmann Department.
Utilizing your School Network John McLaughlin KCCI-TV, Des Moines, IA Daryl Herzmann Iowa State University.
27 Nov Fall AS Seminar Iowa Environmental Mesonet: “Where’s the Science?” Daryl Herzmann Iowa State University.
KCCI SchoolNet8 Workshop Daryl Herzmann Iowa Environmental Mesonet Iowa State University.
KNOWLEDGE SYSTEMS Open Source GIS The Ecotrust mission to utilize new innovative technology Aaron Racicot – GIS Programmer
22 Oct 2003: IGIC Quarterly IEM Access & Free GIS Daryl Herzmann Department of Agronomy Iowa State University.
Central Region Snowfall Analysis Brian P. Walawender NWS Central Region Headquarters Matt W. Davis NWS WFO La Crosse, WI 5/26/2011.
New Methods of Disseminating Statistics Hiren Bhimjiyani Data Science and Visualisation Team BIS.
The Iowa Environmental Mesonet - KCCI SchoolNet - National Weather Service Partnership Working together to save lives and increase data distribution Contacts:
Powered by Microsoft Azure, PointMatter Is a Flexible Solution to Move and Share Data between Business Groups and IT MICROSOFT AZURE ISV PROFILE: LOGICMATTER.
KCCI SchoolNet8 Workshop Daryl Herzmann Iowa Environmental Mesonet Iowa State University.
Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.
20 April 2005: Iowa-NASA Data Integration Workshop Using Open GIS web services to serve environmental data Daryl Herzmann Raymond Arritt Iowa Environmental.
Open Source GIS The Ecotrust mission to utilize new innovative technology Aaron Racicot – GIS Programmer
Engineering Projects In Community Service Matt Mooney Community Based Research University of Notre Dame.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
3-D rendering of jet stream with temperature on Earth’s surface ESIP Air Domain Overview The Air Domain encompasses a variety of topic areas, but its focus.
15 Jan 2004: AMS IIPS GIS Serving NEXRAD imagery with Open-Source GIS Daryl Herzmann Dr Raymond Arritt Iowa Environmental.
24 March Central Iowa NWA Severe Storms Conference Iowa Environmental Mesonet: Supporting the real-time and research needs of the national severe.
The National Weather Service Goes Geospatial – Serving Weather Data on the Web Ken Waters Regional Scientist National Weather Service Pacific Region HQ.
Proposal of Satellite Data Center India Meteorological Department A.K.Sharma (Chairman), Virendera Singh (Member), R.K.Giri (Member) and N.Puviarasan (Member.
Serving Iowa Mesonet data with U of Minnesota’s MapServer Daryl Herzmann Iowa Environmental Mesonet 31 Jul 2002.
The Case for Relational Databases (make databases great again!)
Docker Birthday #3.
GIS + IEM + Other Acronyms
Daryl Herzmann and Raymond Arritt
Building an online tool for spatial joins using open source software
Performance and Scalability Issues of Multimedia Digital Library
Presentation transcript:

28 Feb 2008UNI GeoTREE Visit Iowa Environmental Mesonet: Using Open Source GIS Tools and Web Services to Disseminate Environmental Data Daryl Herzmann Iowa State University

28 Feb 2008UNI GeoTREE Visit Data, data, everywhere data

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit The Desperate Challenge Disparate Formats –Grib –METAR –Text CSV –Free form text –ADAS III –SHEF –Excel (gasp!) Disparate Network Protocols –HTTP –FTP –LDM IDD (tcp) –TCP stream –Modems The data comprising the IEM is made available to us in the following formats and network protocols.

28 Feb 2008UNI GeoTREE Visit Why an Open Source solution? 1.They are the best tools out there. UNIX mentality -> Do something small and do it well. 2.Transparency. We are a public institution doing public funded research. 3.Excellent Support Public bug trackers Community forums IRC Motivated developers

28 Feb 2008UNI GeoTREE Visit Open Source Solution PostGIS / PostgreSQL Spatial Database Map Server Mapping Engine + Scripting Red Hat Linux Operating System Python Data processing and network services GDAL Swiss Army Knife of all things GIS PHP Dynamic Website

28 Feb 2008UNI GeoTREE Visit Key Component: PostGIS Early IEM code (2001) was a series of flat files in Shapefile format and database of observations. This was a disaster. PostGIS provided the opportunity to manage data, metadata, and the GIS data in one location. –Network scalability –Transaction / stored procedure support –Speed / functionality with merge of GEOS library

28 Feb 2008UNI GeoTREE Visit Look at all of my data!

28 Feb 2008UNI GeoTREE Visit Here’s an idea, lets create a webpage where they can download the data!

28 Feb 2008UNI GeoTREE Visit The Open Geospatial Consortium (OGC) Way

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit Supporting the Load

28 Feb 2008UNI GeoTREE Visit Available OGC Services

28 Feb 2008UNI GeoTREE Visit CONUS GOES (Infrared, Visible) CONUS NEXRAD Base Reflectivity, Storm Total Precip, 1 Hour Precip NWS issued advisories,watches, and warnings Iowa Rainfall Estimates Iowa Road Conditions IEM Data Services (temp, winds, etc)

28 Feb 2008UNI GeoTREE Visit Raw NEXRAD Composites Have a large amount of noise due to ground clutter. A simple GDAL script comparing radar echos to its elevation quickly gets rid of most noise.

28 Feb 2008UNI GeoTREE Visit Cleaned Composite

28 Feb 2008UNI GeoTREE Visit Some IEM developed GIS webapps

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit 4 May 2003, heavy rains on freshly tilled soils 25 Sep 2005, heavy rains on mature crops

28 Feb 2008UNI GeoTREE Visit What others have done.

28 Feb 2008UNI GeoTREE Visit

28 Feb 2008UNI GeoTREE Visit Future Work Work with end users on getting IEM data into their platform.

28 Feb 2008UNI GeoTREE Visit Time for Questions? Daryl Herzmann