Data Acquisition for a Regional Geographic Information System to Support Water Planning in the Paso del Norte Region Presentedby John Kennedy GIS Coordinator New Mexico Water Resources Research Institute March 2002

Lecture Overview Present an active GIS project Present an active GIS project –Participants in Project –Data Requirements –Data Acquisition Data Sources Data Sources Data Processing Data Processing Data Standards Data Standards GIS Support GIS Support Recap Recap

Project Participants Bobby Creel Bobby Creel –Project Manager, Water Resources Research Institute, New Mexico State University (NMWRRI) John Kennedy John Kennedy –GIS Coordinator for the NMWRRI Dr. G. Randy Keller & Raed Aldouri Dr. G. Randy Keller & Raed Aldouri –Professor and Co-principle Investigator of Geoscience Applications for the Pan-American Center for Earth and Environmental Sciences, University of Texas at El Paso. –GIS Technician, Geoscience Applications for the Pan-American Center for Earth and Environmental Sciences, University of Texas at El Paso. Dr. Alfredo Granados Olivas Dr. Alfredo Granados Olivas –Professor of Hydrology and GIS Coordinator, Centro de Información Geográfica, Universidad Autónoma de Ciudad Juárez.

Problem A majority of the maps available for water planning in the Paso del Norte region, whether produced by the US or Mexico, have the typical “blank” region on the other side of the border. A majority of the maps available for water planning in the Paso del Norte region, whether produced by the US or Mexico, have the typical “blank” region on the other side of the border. This is also true to a lesser extent for maps of Texas and New Mexico. This is also true to a lesser extent for maps of Texas and New Mexico. In most cases the information is available, but the basic layers are at different spatial scale, resolution, and extent. In most cases the information is available, but the basic layers are at different spatial scale, resolution, and extent. This has precluded their combined use. This has precluded their combined use.

Smerltertown 7.5’ USGS Topographic map

Purpose The purpose of the project is to develop and create a regional geographic information system (GIS) to support regional water planning in the Paso del Norte region. The purpose of the project is to develop and create a regional geographic information system (GIS) to support regional water planning in the Paso del Norte region. The basic geographic spatial databases, also known as framework or basemap data, consists of seven components. The basic geographic spatial databases, also known as framework or basemap data, consists of seven components. These are: geodetic control, orthoimagery, elevation, transportation, hydrography, governmental units, and cadastral information. These are: geodetic control, orthoimagery, elevation, transportation, hydrography, governmental units, and cadastral information.

Support The William and Flora Hewlett Foundation - $74,999 The William and Flora Hewlett Foundation - $74,999 Matching from Cooperators - $16,227 Matching from Cooperators - $16,227

Approach The project involves the cooperation of GIS professionals at the three universities in the region. The project involves the cooperation of GIS professionals at the three universities in the region. Cooperation among the three universities will allow for the gathering of required data and natural resource information for the purpose of creating a regional GIS system. Cooperation among the three universities will allow for the gathering of required data and natural resource information for the purpose of creating a regional GIS system. A major task of this project is to acquire and evaluate existing digital data useful to water planning activities with a goal of combining them into seamless products. A major task of this project is to acquire and evaluate existing digital data useful to water planning activities with a goal of combining them into seamless products.

Approach Continued Where digital data are not available, tasks will be designed to assess requirements for their development. Where digital data are not available, tasks will be designed to assess requirements for their development. In addition, the GIS system should contain other databases that would be useful for regional water planning. In addition, the GIS system should contain other databases that would be useful for regional water planning. –Examples include groundwater aquifer boundaries, water well locations, watershed boundaries, and landuse classifications.

Approach Continued Project team members will work closely with regional planners to identify and incorporate other useful information. Project team members will work closely with regional planners to identify and incorporate other useful information. As the combined products are developed, they will be shared broadly, with each participating unit making them available via their websites. As the combined products are developed, they will be shared broadly, with each participating unit making them available via their websites. Procedures developed in this project could be used as a template for other border areas. Procedures developed in this project could be used as a template for other border areas.

Schedule and Deliverables Project initiated June 1, 2001 (with a 1 year duration). Project initiated June 1, 2001 (with a 1 year duration). Deliverables from the project would consist of digital GIS layers of relevant themes useful for water planning within the framework and basemap data for the seven geospatial components described above. Deliverables from the project would consist of digital GIS layers of relevant themes useful for water planning within the framework and basemap data for the seven geospatial components described above. In addition, other useful information would be incorporated into the system. In addition, other useful information would be incorporated into the system. The information would be provided jointly by the participating entities from Internet websites as well as a completion report with a CDROM for the data. The information would be provided jointly by the participating entities from Internet websites as well as a completion report with a CDROM for the data.

Data Requirements of the Project GIS basemap datasets that are “seamless” across the International Border. GIS basemap datasets that are “seamless” across the International Border. GIS datasets that have common classification systems. GIS datasets that have common classification systems. –Elevation contours are at the the same units and in the unit same intervals Features have both English and Spanish attributes. Features have both English and Spanish attributes.

Framework Data Start with basemap data at a common regional scale of 1:100,000 Start with basemap data at a common regional scale of 1:100,000 –Geodetic control –Elevation –Orthoimagery –Transportation –Hydrography –Governmental units –Cadastral information Incorporate other data as needed Incorporate other data as needed

Framework Data Detail The geodetic component consists of a database of geographic points, with surveyed location and elevation. The geodetic component consists of a database of geographic points, with surveyed location and elevation. The orthoimagery component consists primarily of aerial photography that can be used as a source of information or as a backdrop to other databases. The orthoimagery component consists primarily of aerial photography that can be used as a source of information or as a backdrop to other databases. The elevation component consists of two data types. The first data type consists of regular interval contours that represent elevation of the land surface and the second data type is called a digital elevation model (DEM). The elevation component consists of two data types. The first data type consists of regular interval contours that represent elevation of the land surface and the second data type is called a digital elevation model (DEM).

Framework Data Detail Continued The transportation component consists of linear data that represent transportation networks. The transportation component consists of linear data that represent transportation networks. The hydrography component represents surface- water features, such as streams, rivers, lakes, and playas. The hydrography component represents surface- water features, such as streams, rivers, lakes, and playas. The governmental unit component represents boundaries such as county/state lines and municipal jurisdictions. The governmental unit component represents boundaries such as county/state lines and municipal jurisdictions. The cadastral component represents the ownership or control of land parcels. The cadastral component represents the ownership or control of land parcels.

Data Sources USGS USGS –USGS Mapping Webpage » –National Spatial Data Inventory » –USGS Geographic Data Download »

Data Sources Continued GIS Data Depot GIS Data Depot – –Free data for download –Arc/Info format –Metadata –Images Resource Geographic Information System Resource Geographic Information System – –Data for the state of New Mexico –Arc/Info format –Metadata

Data Sources Continued Universities Universities –NMWRRI –NMSU Geography Department –University of Texas El Paso PACES »LANDSAT Imagery » State Agencies State Agencies –NM OSE –EBID County County –Doña Ana County City City –City of Las Cruces Others? Others?

Data Processing Data Formats Data Formats –Arc/Info Export/Import Format »*.e00 files »Very common file format for exchanging data »Import 7.1 Utility comes with ArcView 3 and will import Arc/Info export files –Shape Files »Minimum of three files *.shp, *.dbf, *.shx *.shp, *.dbf, *.shx »Often compressed and combined into a WinZip file –AutoCAD Files »Export files have a *.dxf extension »Drawing files can be used with the CAD Reader Extension

Data Processing Continued Other data types Other data types –Access databases, Excel Spreadsheets »Can be connected through ODBC »Export to dBase III format (*.dbf). –Flat Files »Require some editing in Notepad and processing in Excel to create a *.dbf file. –The above files can be shown in ArcView as “Event Themes”

Geodetic Control Data acquired from the RGIS Data acquired from the RGIS –They created the database from an acquired ASCII flat file, which was modified so that it can be imported into Arc/Info –ArcView 3.2 can also be used to import data and display the data as an event theme National Geodetic Survey National Geodetic Survey – –Control points for vertical and horizontal control

Elevation Hypsography Hypsography – –Select scale and geographic extent –Download file and use WinZip to extract the files –Use sdts2cov.aml found at to convert the SDTS data and combine –Some data available from RGIS, but most are small- scale datasets

Elevation Continued Digital Elevation Models (DEMs) Digital Elevation Models (DEMs) –Raster data –3 arc seconds –SDTS Format can be imported using an ArcView script For this project For this project –1:250K DEMs –Used UNIX commands to import data –Used UNIX Arc/Info

Start at the web site

Move on to the 1:100K DLG files

Locate the state of interest

Locate the quadrangles

Choose the theme type

Select the SDTS file format

Click and hold the right mouse button on the SDTS file and select Save Target As.. and save file in your workspace.

WinZip When using WinZip to un-zip an SDTS.tar.gz file, make sure you UN-CHECK WinZip's Options / Configuration / Miscellaneous option that says "TAR file smart CR/LF conversion." Otherwise, SDTSIMPORT will not work. When using WinZip to un-zip an SDTS.tar.gz file, make sure you UN-CHECK WinZip's Options / Configuration / Miscellaneous option that says "TAR file smart CR/LF conversion." Otherwise, SDTSIMPORT will not work.

Master Data Dictionary 100K 100K – ASTERDD_100K.SDTS/ Large Scale Large Scale – LE/00MASTERDD_LRG.SDTS Small Scale Small Scale – ERDD_2M.SDTS Copy the files into a directory called masterdd Copy the files into a directory called masterdd

A master data dictionary is needed in a directory at the same level as your data.

Use the sdts2cov.aml file found on the ESRI web site to import the data.

These are the coverages created with the sdts2cov.aml file.

Files shown in ArcView

DEM Conversion The data is collected from the following web site: The data is collected from the following web site: This conversion was done on UNIX machine This conversion was done on UNIX machine The files are compressed using "gzip", use gunzip to uncompress the files. Once unzipped, the files have to be delimited use the following syntax: The files are compressed using "gzip", use gunzip to uncompress the files. Once unzipped, the files have to be delimited use the following syntax: dd if=filename of=outline ibs=4096 cbs=1024 conv=unblock Then the file DEM file is converted to a lattice in Arc/Info: Then the file DEM file is converted to a lattice in Arc/Info: demlattice infilename outfilename USGS demlattice infilename outfilename USGS The data is in the WGS72 coordinate system The data is in the WGS72 coordinate system Can project lattice to other coordinate systems Can project lattice to other coordinate systems The lattice is now ready for use in Arc/Info and ArcView. The lattice is now ready for use in Arc/Info and ArcView.

gunzip files dd files

Demlattice to convert the DEM to a lattice

Merge lattices using latticemerge

Project grid to UTM.

Projection File input Projection GEOGRAPHIC Datum WGS72 Zunits METERS Units DD Spheroid WGS1972 seven Parametersoutput Projection UTM Zone 13 Datum nar_c three Units METERS ParametersEND

DEM and Transportation

Orthoimagery Digital imagery Digital imagery –7.5’ USGS Topographic map – LANDSAT LANDSAT –

USGS DOQQ

LANDSAT 7 Data obtain from PACES

Transportation Select scale and geographic extent Select scale and geographic extent

Transportation Continued Download file and use WinZip to extract the files Download file and use WinZip to extract the files Use sdts2cov.aml found at to convert the SDTS data and combine Use sdts2cov.aml found at to convert the SDTS data and combine Use the same steps as for hypsography Use the same steps as for hypsography Some data available from RGIS, but most are small- scale datasets Some data available from RGIS, but most are small- scale datasets

Deference's in the databases

How to overcome the differences? When merging the datasets, start with the coverage that has the largest number of fields. When merging the datasets, start with the coverage that has the largest number of fields. –Route_number1, Route_number2, etc. –This ensures that all fields will be included in the final product.

Hydrography Select scale and geographic extent Select scale and geographic extent

Hydrography Continued Download file and use WinZip to extract the files Download file and use WinZip to extract the files Use sdts2cov.aml found at to convert the SDTS data and combine Use sdts2cov.aml found at to convert the SDTS data and combine Use the same steps as for hypsography Use the same steps as for hypsography Some data available from RGIS, but most are small- scale datasets Some data available from RGIS, but most are small- scale datasets

Governmental Units (Boundaries) Select scale and geographic extent Select scale and geographic extent

Governmental Units Continued Download file and use WinZip to extract the files Download file and use WinZip to extract the files Use sdts2cov.aml found at to convert the SDTS data and combine Use sdts2cov.aml found at to convert the SDTS data and combine Use the same steps as for hypsography Use the same steps as for hypsography Some data available from RGIS, but most are small- scale datasets Some data available from RGIS, but most are small- scale datasets

Cadastral Information (Public Lands) Select scale and geographic extent Select scale and geographic extent

Cadastral Information Continued Download file and use WinZip to extract the files Download file and use WinZip to extract the files Use sdts2cov.aml found at to convert the SDTS data and combine Use sdts2cov.aml found at to convert the SDTS data and combine Use the same steps as for hypsography Use the same steps as for hypsography Some data available from RGIS, but most are small- scale datasets Some data available from RGIS, but most are small- scale datasets

Mexico GIS Most of the basemap data had to be digitized from published maps Most of the basemap data had to be digitized from published maps Classifications somewhat based on the USGS data model Classifications somewhat based on the USGS data model Digital data somewhat limited Digital data somewhat limited

Putting it all together The final project will contain databases that were be built upon the basemap information presented. The final project will contain databases that were be built upon the basemap information presented. Major Tasks Major Tasks –Matching classifications systems –English/Spanish translations –Metadata creation

Combine English and Spanish Attributes

Standards Standards webpage Standards webpage – –

GIS Support ESRI Products ESRI Products –Support » –Free Resources » –ArcScripts » »Great sources for tools –ArcUser »

GIS Support Continued GIS Groups GIS Groups –SWUG »South West Users Group » (old) –New Mexico Geographic Information Council » Departments on campus using GIS Departments on campus using GIS –Geography –NMWRRI –Engineering –Agriculture College –Biology –Geology

Lecture Highlights Presented an ongoing project that uses GIS data from many different sources Presented an ongoing project that uses GIS data from many different sources Listed sources for basemap GIS data Listed sources for basemap GIS data Described procedures to process data Described procedures to process data Presented some of the output from the project Presented some of the output from the project Identified possible source or information and contacts for GIS assistance Identified possible source or information and contacts for GIS assistance

Time to Go!!