Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance.

Slides:



Advertisements
Similar presentations
Debugging ACL Scripts.
Advertisements

Week 1: Introduction to GIS
WITHOUT LANGUAGE [ DEVELOPING GEO-PROCESSING MODELS USING ARCGIS MODELBUILDER 10 ] PROGRAMMING R. RYAN STEVENS / GIS RESEARCH ANALYST / THE POLIS CENTER.
Geographic Information Systems Using ESRI ArcGIS 9.3 Join and Relate Tables.
JTX Overview Overview of Job Tracking for ArcGIS (JTX)
Concepts of Maintaining Your Data Simple Ways to Edit Your Data By Lorne Woods.
Why python? Automate processes Batch programming Faster Open source Easy recognition of errors Good for data management What is python? Scripting programming.
Key Considerations for Report Generation & Customization Richard Wzorek Director, Production IT Confidential © Almac Group 2012.
GIS Level 2 MIT GIS Services
Taking Core Products a Step Further USG Software and Customized Applications.
UP206A: Introduction to GIS. » The ArcGIS Network Analyst extension allows you to build a network dataset and perform analysis on a network dataset »
Return to Outline Copyright © 2009 by Maribeth H. Price 6-1 Chapter 6 Spatial Joins.
Algorithms and Problem Solving-1 Algorithms and Problem Solving.
EAS781 Practical Geophysics: The Tools and How to Use Them ArcGis Introduction ArcView ArcInfo ArcGis ?
Visualizing Multiple Physician Office Locations Exercise 9 GIS in Planning and Public Health Wansoo Im, Ph.D.
Technical Support: (989) GIS and Mapping Procedures in ArcMap 9.x Creating an ArcMap Project Editing an ArcMap Project Printing an ArcMap Project.
ModelBuilder In ArcGIS 9.x By Tim Weigel GEOG 407/607 April 3 rd, 2006.
Geography 465 Overview Geoprocessing in ArcGIS. MODELING Geoprocessing as modeling.
Using ESRI ArcGIS 9.3 3D Analyst T I N
GIS Tutorial 1 Lecture 6 Digitizing.
ModelBuilder at ArcGIS 9.2 Lyna Wiggins Rutgers University May 2008.
19 th Advanced Summer School in Regional Science Overview and more advanced directions with ArcGIS.
Intro. To GIS Lecture 6 Spatial Analysis April 8th, 2013
Editing Basics (in ArcGIS 9.2) By Alma Vargas. Levels of Desktop ArcGIS Arc View Version that most clients will use The version that this session will.
ArcGIS Extensions Expanding the Use of ArcGIS
Spatial Statistics UP206A: Introduction to GIS. Central Feature.
Advance Model Builder Features. Advance Features Using Lists (also Batching) Iteration Feedback Model Only Tools Inline Variable Substitution Preconditions.
Introduction to ArcGIS for Environmental Sciences Day 2 – Fundamentals Module 8 Creating & Editing Data Creating Metadata.
Enterprise ETL & the Home Again
Esri International User Conference | San Diego, CA Technical Workshops | Python – Getting Started Drew Flater, Ghislain Prince July 12 - July 14, 2011.
Multimodal Analysis Using Network Analyst. Outline Summarizing accessibility Summarizing accessibility Adding transportation modes to a network Adding.
Creating a GIS Based Traffic Control Planning Tool for the Dallas District Andrew Karl Dr. Maidment CE 394K.3 GIS in Water Resources Term Project Due:
Creating the Leased Site database This will be a database that has: Leased Site ID Parent Parcel ID Township Range Section Etc. Some Counties have the.
Python: An Introduction
Introduction to ArcGIS for Environmental Scientists Module 2 – Fundamentals Chapter 7 – Queries.
ArcGIS Network Analyst: Automating Workflows with Geoprocessing
Data Interoperability Basics Bruce Harold & Dale Lutz.
Automating Analyses with ModelBuilder. Overview Why Use ModelBuilder? Why Use ModelBuilder? ModelBuilder Basics ModelBuilder Basics Common ModelBuilder.
Introduction of Geoprocessing Topic 7a 4/10/2007.
.LAS files (Log ASCII Standard) Not useable directly in ArcGIS A single X-Y position can have multiple Z values Must be converted to MultiPoint file.
LTER Information Management Training Materials LTER Information Managers Committee Documenting Spatial Data Theresa Valentine Andrews LTER.
ARCSDE & ARCIMS Mr. David A. Perini. ARCIMS  Internet Mapping Server Distribute GIS information over the Internet Integrates with addition ESRI softwareESRI.
Data Queries Selecting features in ArcMap Data queries  Important part of a GIS project Can be a part of your data preparation or final analysis  Data.
Queries Select by Attribute Select by Location. What is a Query? A query extracts information from a data table for further use –Once extracted you can:
Introduction of Geoprocessing Lecture 9. Geoprocessing  Geoprocessing is any GIS operation used to manipulate data. A typical geoprocessing operation.
UP206A: Introduction to GIS. » The ArcGIS Network Analyst extension allows you to build a network dataset and perform analysis on a network dataset.
NSF DUE ; Wen M. Andrews J. Sargeant Reynolds Community College Richmond, Virginia.
Jessica D. Perkins GIS Programmer Analyst 2 Geospatial Transportation Information Section Program Planning & Administration Division of Highways West Virginia.
Selecting features in ArcMap
Advanced GIS Using ESRI ArcGIS 9.3 Arc ToolBox 7 (Linear Referencing - Mobile)
DEM TRAINING (DIGITAL ELEVATION MODEL). STEP 1 OPEN GIS.
Introduction of Geoprocessing Lecture 9 3/24/2008.
Python: Building Geoprocessing Tools David Wynne, Ghislain Prince.
Intro. To GIS Pre-Lab Spatial Analysis April 1 st, 2013.
William Perry U.S. Geological Survey Western Ecological Research Center Geography 375 Final Project May 22, 2013.
Introduction GIS often represent spatial information with a two-dimensional x,y coordinate system. Some data linearly measured. In order to use the information.
Designing a Spatial/GIS Project
Improving Georeferencing Workflow with Python
processing tabular data
How to automatise the grid production - using model builder in ArcGIS
Mastering ArcGIS Attribute Data (Continued)
Accessing Spatial Information from MaineDOT
Tan Hoang GEOG 362 – Final Project
String several geoprocessing processes
Preliminaries: -- vector, raster, shapefiles, feature classes.
Introduction to Computer Programming
Why Projections Matter in an Active Horizontal Drilling Program
Automating Analyses with ModelBuilder
Network Analyst – Automating Workflows with Geoprocessing
Survey Results Respondents: 39 of 51 – 76%
Presentation transcript:

Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance measures. (Linear Referencing Tools) 3)Locate features along routes (Linear Referencing Tools) 4)Open.dbf in Excel, save as.xls, and write a formula to adjust MEAS values +/- 100 meters and 250 meters to “bracket-in” site (200 m & 500 m). 5)Add.xls file to ArcMap 6)Make route event layer (Linear Referencing Tools) 7)Turn.xls file into shapefile called basin_Extents_Up_Down_+/-dist 8)Extract values to points (Get elevations for the endpoints) (Spatial Analyst Tools – Extraction) 9)Open attribute table and export to.dbf 10)Combine elevation values and route location values to calculate gradient. Task: How to do all of this in an automated way, and all in ArcMap? Solution: Use ModelBuilder

Determining Gradient Site 100 m DS 100 m US 250 m US 250 m DS “Short” reach “Long” reach Get elevations from each upstream and downstream reach endpoint

Why (not) ModelBuilder? I don’t often do GIS processes that need to be repeated multiple times. My workflows tend to be “custom”, created as needed to solve a particular solution. If I need to repeat a process each year, I create and use a written protocol, or look at my notes from the previous year. I often work between “platforms” (ArcGIS, Access, Excel, etc.).

So, why ModelBuilder this time? Main reason: Repeated processes – This GIS process needed to be repeated multiple times (once for each subbasin). – Rather than working manually through the same process six times, I could set up one Model and click “Run” six times. – Or, even better, I could set it up to “iterate” through all six basins on its own. Other Benefits: Readily adaptable – Elements of this workflow are relatively common in my work, so now that a Model is created, I will likely use or adapt it multiple times in the future. Easily brought “out of retirement” – If I need to repeat this process in the future, it is relatively simple to update the Model and run it. Metadata (sort of) – processing methods – If I want to remember what the workflow was, I can open the model and review the processes and tools involved. Forces me to work in one platform – While working cross-platform isn’t inherently bad, it doesn’t lend itself to easily replicated or transferable solutions. Thus, I wanted to see if I could do the whole workflow within ArcGIS.

Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance measures. (Linear Referencing Tools) 3)Locate features along routes (Linear Referencing Tools) 4)Open.dbf in Excel, save as.xls, and write a formula to adjust MEAS values +/- 100 meters and 250 meters to “bracket-in” site (200 m & 500 m). 5)Add.xls file to ArcMap 6)Make route event layer (Linear Referencing Tools) 7)Turn.xls file into shapefile called basin_Extents_Up_Down_+/-dist 8)Extract values to points (Get elevations for the endpoints) (Spatial Analyst Tools – Extraction) 9)Open attribute table and export to.dbf 10)Combine elevation values and route location values to calculate gradient. Task: How to do all of this in an automated way, and all in ArcMap? Solution: Use ModelBuilder

First Model: Locate Features Along Routes (Iteration – Series)

Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance measures. (Linear Referencing Tools) 3)Locate features along routes (Linear Referencing Tools) 4)Open.dbf in Excel, save as.xls, and write a formula to adjust MEAS values +/- 100 meters and 250 meters to “bracket-in” site (200 m & 500 m). 5)Add.xls file to ArcMap 6)Make route event layer (Linear Referencing Tools) 7)Turn.xls file into shapefile called basin_Extents_Up_Down_+/-dist 8)Extract values to points (Get elevations for the endpoints) (Spatial Analyst Tools – Extraction) 9)Open attribute table and export to.dbf 10)Combine elevation values and route location values to calculate gradient. Task: How to do all of this in an automated way, and all in ArcMap? Solution: Use ModelBuilder

Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance measures. (Linear Referencing Tools) 3)Locate features along routes (Linear Referencing Tools) 4)Open.dbf in Excel, save as.xls, and write a formula to adjust MEAS values +/- 100 meters and 250 meters to “bracket-in” site (200 m & 500 m). 5)Add.xls file to ArcMap 6)Make route event layer (Linear Referencing Tools) 7)Turn.xls file into shapefile called basin_Extents_Up_Down_+/-dist 8)Extract values to points (Get elevations for the endpoints) (Spatial Analyst Tools – Extraction) 9)Open attribute table and export to.dbf 10)Combine elevation values and route location values to calculate gradient. Task: How to do all of this in an automated way, and all in ArcMap? Solution: Use ModelBuilder

Second Model: Calculate Fields (Iteration – List) Iteration types: List – The tool connected to the List variable – and all downstream tools – execute once for each value in the List Series – Entire model is executed once for each value in the Series

Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance measures. (Linear Referencing Tools) 3)Locate features along routes (Linear Referencing Tools) 4)Open.dbf in Excel, save as.xls, and write a formula to adjust MEAS values +/- 100 meters and 250 meters to “bracket-in” site (200 m & 500 m). 5)Add.xls file to ArcMap 6)Make route event layer (Linear Referencing Tools) 7)Turn.xls file into shapefile called basin_Extents_Up_Down_+/-dist 8)Extract values to points (Get elevations for the endpoints) (Spatial Analyst Tools – Extraction) 9)Open attribute table and export to.dbf 10)Combine elevation values and route location values to calculate gradient. Task: How to do all of this in an automated way, and all in ArcMap? Solution: Use ModelBuilder

Third Model: Extract Values; Join Table; Calc. Fields

Protocol: How to Derive Gradient from GIS Outline: 1)Add X,Y site points, using GPS-collected UTM coordinates. 2)Create “routed” streams, with linear distance measures. (Linear Referencing Tools) 3)Locate features along routes (Linear Referencing Tools) 4)Open.dbf in Excel, save as.xls, and write a formula to adjust MEAS values +/- 100 meters and 250 meters to “bracket-in” site (200 m & 500 m). 5)Add.xls file to ArcMap 6)Make route event layer (Linear Referencing Tools) 7)Turn.xls file into shapefile called basin_Extents_Up_Down_+/-dist 8)Extract values to points (Get elevations for the endpoints) (Spatial Analyst Tools – Extraction) 9)Open attribute table and export to.dbf 10)Combine elevation values and route location values to calculate gradient. Task: How to do all of this in an automated way, and all in ArcMap? Solution: Use ModelBuilder

Fourth Model: Extract Values; Spatial Join; Calc. Fields

Issues with ModelBuilder: (aka things that aggravated me) Not always easy to know what went wrong – Extract Values tool did not work on route event layers and failed in seemingly random ways: ERROR : Error in executing grid expression. Assignment to non-variable / Failed to execute (Extract Values to Points). – Tools “executed successfully” in the log, but the subsequent step failed Join Field tool – Identical field names get changed, so any subsequent use of those field names must take that into account Using Calculate Field in a Series doesn’t work – No output variable in the tool, so no ability to set “%n%”; keeps the first filename as the intermediate variable You have to remember *every* little detail of a workflow – Forgot to select by attribute after joining; overwrote previous calculations (User Error) Calculating the joined, selected fields didn’t work consistently: – WARNING : No records within table – Running the same series of processes manually *DID* work. Moving files into a new, clean MXD seemed to help, as did restarting ArcMap periodically.

Wrestling with the Model After two days of tweaking the Model and trying to get it to work, I gave up and went back to a manual approach. I didn’t relish having to go through all of the necessary steps manually, but couldn’t figure out why the Model wouldn’t work. But when I did my first Extract Values to Points manually, it didn’t work either (inexplicably). This was enough to push me back into trying to find an alternative solution with the Model. Soon enough, I did (Add Join).