Data Driven Farming: Week 5: Evaluation

Slides:



Advertisements
Similar presentations
CDMS Web Portal: FEMAS SOFTWARE PROGRAM FOR UPDATING STATEWIDE DATASETS CDMS Web Portal Version 1.0 The standardized role-based application to update statewide.
Advertisements

Data Science for Business: Semantic Verses Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for Tackling the Challenges of Big Data
IS 466 ADVANCED TOPICS IN INFORMATION SYSTEMS LECTURER : NOUF ALMUJALLY 20 – 11 – 2011 College Of Computer Science and Information, Information Systems.
Acquiring and Downloading Digital Data With support from: NSF DUE in partnership with: John McGee Jennifer McKee Geospatial Technician Education.
Geodatabase basic. The geodatabase The geodatabase is a collection of geographic datasets of various types used in ArcGIS and managed in either a file.
West Hills College Farm of the Future. West Hills College Farm of the Future Where are you NOW?! Precision Agriculture – Lesson 3.
Welcome to EDINA Digimap Digimap is an EDINA service offering online access to a range of spatial data. It is authenticated using Athens and is available.
Introduction to GIS Lecture 18: Public Data 2: Other Public Data Sources Lecture notes by Austin Troy, University of Vermont © Using GIS--
P. Joseph Lehman, Inc., Consulting Engineers incorporates Geographic Information Systems (GIS) software services with new and existing clients. Presentation.
EPA Big Data Analytics: EnviroAtlas Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Rebecca Boger Earth and Environmental Sciences Brooklyn College.
Database Design IST 7-10 Presented by Miss Egan and Miss Richards.
SSURGO Dataset to File Geodatabase Import Tool One Example of Extending Capabilities through Python 2013 IGIC Conference Muncie, Indiana Chris Morse, NRCS.
NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi
EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Lecture 4 Data. Why GIS? Ask questions Solve a problem Support a decision Make Maps Involve others, share data, procedures, ideas.
Overview of Features and Reports Version 2.0 Send inquiries to:
ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,
September 18-19, 2006 – Denver, Colorado Sponsored by the U.S. Department of Housing and Urban Development Using Geographic Information Systems (GIS) as.
Geographic Information Systems Other Digital Data.
Step by Step Instruction: How to Conduct Direct Certification using File Upload: SAIS IDs Released January 2014 “How to Conduct Direct Certification using.
GIS Data Science for Collaboration Across Communities: GIScience 2.0 and Beyond Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Data Science Publication for NSF Polar Cyberinfrastructure Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Managing your References Sue Bird Bodleian Bio- & Environmental Sciences October 2010.
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect.
Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
NEPAnode is a Geospatial Data and Document Management System It provides a centralized and collaborative site to access the data.
GIS 1 GIS Lecture 4 Geodatabases. GIS 2 Outline Administrative Data Example Data Tables Data Joins Common Datasets Spatial Joins ArcCatalog Geodatabases.
Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
1 Emissions Inventory System (EIS) Overview and Exporting Data from the EIS Sally Dombrowski EPA–OAQPS.
Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.
Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Wendy Welch ADAPTING THE ARC HYDRO DATA MODEL AND TOOLS TO A HYDROGEOLOGIC FRAMEWORK KITSAP PENINSULA, KITSAP, MASON AND PIERCE COUNTIES, WASHINGTON.
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Data Science for USDA Big Data
How do we represent the world in a GIS database?
Data Science for EPA Big Data Analytics: Oregon Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Intro to GIS and ESRI Trainers: Randy Jones, GIS Technician, Douglas County Jon Fiskness, GISP GIS Coordinator, City of Superior.
Putting SSURGO to work Developing meaningful Soil Data with ArcGIS & Microsoft Access 2005 Users Conference.
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Oregon GIS Framework Forum 05/20/2015 Oregon Soils Data Standard.
An Internet of Things: People, Processes, and Products in the Spotfire Cloud Library Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist.
GIS 1 GIS Lecture 4 Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University.
Data Driven Farming: Week 6: Deployment Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Week 6 Deployment.
Data Science for Semantics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Semantics.
INTRODUCTION TO GEOGRAPHICAL INFORMATION SCIENCE RSG620 Week 1, Lecture 2 April 11, 2012 Department of RS and GISc Institute of Space Technology, Karachi.
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.
Data Science for Joint Doctrine Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Joint.
Exploring Spatial Data Infrastructure in an Open Source World Jacqueline Lowe UNC-Asheville National Environmental Modeling and Analysis Center Jacqueline.
Data Science for Conservation International's Big Ecosystem Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
U.S. Department of the Interior U.S. Geological Survey Norman B. Bliss, ASRC Federal InuTeq Contractor to the USGS 6/4/2015 A continental view of soil.
GIS Data Structures How do we represent the world in a GIS database?
Finding Geospatial Data A closer look at several useful sources of free geospatial data René Duplain Data Analyst,
Intro to GIS & Pictometry Trainers: Randy Jones, GIS Technician, Douglas County Jon Fiskness, GISP GIS Coordinator, City of Superior.
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
A Review of CPD Maps | ArcGIS | HUD Open Data Online Mapping Tools.
-gSSURGO- Using the Soil Data Management Toolbox Steve Peaslee USDA-NRCS National Soil Survey Center Lincoln, Nebraska March.
NRCS Business Processes and Geospatial Integration Kansas Natural Resources GIS Technical Meeting March 16, 2016 Natural Resources Conservation Service.
Fundamentals of GIS Lecture 17: Public Data II: Other Data Sources Lecture notes by Austin Troy, University of Vermont © Using GIS--
Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Flood Map Library MD. M. HAQUE DWR-HYDROLOGY. Building a Flood Map Library Indexing existing flood maps and geospatial data for search and retrieval Separate.
USDA Big Data Science for Precision Farming With FarmLogs
Presentation transcript:

Data Driven Farming: Week 5: Evaluation Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Week 5 Evaluation August 14, 2015

Outline Knowledge Base: UNL Cropwatch: Mindtouch Spreadsheet UNL Cropwatch: Software Tools Powerpoint Presentations Tutorials International Plant Nutrition Institute: AgriStats An International Journal on Advances in Precision Agriculture Data Science Data Publication USDA Soils Data Sets: Natural Resources Conservation Service: Soils FY2015 gSSURGO Database Release Soil Survey Sidebar Hierarchy Digital Soil Geographic Databases (GIS-ready) Weeks 4 and 5 Soil File Inventory for Visualization and Modeling in Spotfire: NCSS_Soil_Characterization_Database SoilDataAvailabilityShapefile Otoe County, Nebraska: PDF, GIF, and PNG Master_query and NCSS_Site_Location wss_SSA_NE131_soildb_NE_2003_[2014-09-02] wss_gsmsoil_NE_[2006-07-06] nrcs142p2_052440 and PDF Image Map NCSSSoilSurvey FarmData-Spotfire LandCover XLS?

Semantic Community Data Science Big Data Science for Precision Farming Business Week 5 Evaluation

FarmData.xlsx

UNL Cropwatch Software Tools: Yield Editor Get Newest Version: Yield Editor 2.0.7. See next slide Yield Check FOViewer (MapShots) Powerpoint Presentations: These are PDFs and 2013 Yield Data Cleaning: Why it's Important Yield Data Collection BMPs: Minimizing errors and downtime Yield Monitoring Systems: Understanding How Yield is Estimated Tutorials: See Ag Leader's industry-leading SMS Software and Free Download Trial and Webinars Comparison Analysis Tutorial Creating Grid or Contour Maps Data into SMS Tutorial Bringing Yield Data Importing Clean Data Tutorial Bringing Yield Data Back Using Yield Editor Tutorial http://cropwatch.unl.edu/ssm

Yield Editor Get Newest Version: Yield Editor 2.0.7: Yield Editor v. 2.0.7 is a tool which allows the user to select, apply and analyze a variety of automated filters and editing techniques used to process and clean yield data. The software imports either AgLeader advanced or Greenstar text file formats, and exports data in a delimited ASCII format. http://www.ars.usda.gov/services/sof tware/software.htm?modecode=50- 70-10-00 Yield Editor 2.0

Yield Monitoring Systems: Understanding How Yield is Estimated

http://www.agleader.com/support/training-and-resources/sms-software-101/

https://dealer.agleader.com/kbp/ Free Download Trial

International Plant Nutrition Institute AgriStats (APPLIED FOR ACCESS) A unique web-based information system that is available to all IPNI Members and their Staff. The system is designed to collect yield and associated fertilizer use data from regions in which we conduct our Programs. Please consult the AgriStats Manual. A glossary section is available within AgriStats for help on the available functions, the current dataset, and the terms and definitions used to describe the data. Access to AgriStats, its data tables, and reports represents a license to use these materials as a resource and does not grant permission for indiscriminate copying or unauthorized use. Although IPNI asks to be cited as a source when AgriStats data are used, the Institute cannot endorse external analyses resulting from its use or guarantee future nutrient use based on AgriStat predictions. An International Journal on Advances in Precision Agriculture: Index in Spreadsheet for Search and Identify Free Downloads Data Science Data Publication: NuGIS – See Data Science for USDA Big Data Other Selected from Free Downloads Above (IN PROCESS)

http://agristats.ipni.net/

Glossary Section

FarmData.xlsx An International Journal on Advances in Precision Agriculture: Index in Spreadsheet for Search and Identify Free Downloads

Data Science Data Publication

Web Player 10 MB

USDA Soils Data Sets Natural Resources Conservation Service: Soils FY2015 gSSURGO Database Release Soil Survey Sidebar Hierarchy: Home By State Soil Classification Soil Geography: Soil Geographic Data Sets Digital Soil Geographic Databases (GIS-ready) Land Resource Regions (LRR) and Major Land Resource Areas (MLRA) Common Resource Areas (CRA) U.S. General Soil Map (STATSGO2) Soil Survey Geographic (SSURGO) Database Gridded Soil Survey Geographic (gSSURGO) Database (See Previous Slides) National Cooperative Soil Survey Soil Characterization Database (Pedons)

http://www.nrcs.usda.gov/wps/portal/nrcs/site/soils/home/ FY2015 gSSURGO Database ReleaseThe FY2015 Gridded Soil Survey Geographic (gSSURGO) Database was released on February 23, 2015. These data are derived from a December 1, 2014, snapshot of the Soil Data Mart database. These new data are available in both state-wide tiles and the Conterminous U.S. (CONUS).

http://www. nrcs. usda. gov/wps/portal/nrcs/detail/soils/survey/geo/ http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=NRCS142P2_053628

Description of Gridded Soil Survey Geographic (gSSURGO) Database Gridded SSURGO (gSSURGO) is similar to the standard USDA-NRCS Soil Survey Geographic (SSURGO) Database product but in the format of an Environmental Systems Research Institute, Inc. (ESRI®) file geodatabase. A file geodatabase has the capacity to store much more data and thus greater spatial extents than the traditional SSURGO product. This makes it possible to offer these data in statewide or even Conterminous United States (CONUS) tiles. gSSURGO contains all of the original soil attribute tables in SSURGO. All spatial data are stored within the geodatabase instead of externally as separate shapefiles. Both SSURGO and gSSURGO are considered products of the National Cooperative Soil Survey (NCSS) partnership. The gridded SSURGO (gSSURGO) dataset was created for use in national, regional, and statewide resource planning and analysis of soils data. The raster map layer data can be readily combined with other national, regional, and local raster layers, including the National Land Cover Database (NLCD), the National Agricultural Statistics Service (NASS) Crop Data Layer (CDL), and the National Elevation Dataset (NED).

http://www.nrcs.usda.gov/wps/portal/nrcs/main/soils/survey/

http://www.nrcs.usda.gov/wps/portal/nrcs/surveylist/soils/survey/state/?stateId=NE My Note: This is where I Got: Otoe County: Manuscript (PDF; 19.7 MB ) Date: Current Archived PDF On-line: No Web Soil Survey (generated from official soil data): Yes

http://www.nrcs.usda.gov/wps/portal/nrcs/main/soils/survey/class/ My Note: Lots of valuable information here. I am focused on the actual geographic data sets.

http://www.nrcs.usda.gov/wps/portal/nrcs/main/soils/survey/geo/

Digital Soil Geographic Databases (GIS-ready) Land Resource Regions (LRR) and Major Land Resource Areas (MLRA): http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053624 Common Resource Areas (CRA): http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053635 U.S. General Soil Map (STATSGO2): http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053629 Soil Survey Geographic (SSURGO) Database: http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053627 Gridded Soil Survey Geographic (gSSURGO) Database (See Previous Slides): http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053628 National Cooperative Soil Survey Soil Characterization Database (Pedons): http://ncsslabdatamart.sc.egov.usda.gov/

http://www. nrcs. usda. gov/wps/portal/nrcs/detail/soils/survey/geo/ http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053624

http://www. nrcs. usda. gov/wps/portal/nrcs/detail/soils/survey/geo/ http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053635 My Note: Only By State? CRA Geographic Database version 1.2 GIS data products are available for downloading. Go to Geospatial Data Gateway and click on Order by State. Select the State, then find Common Resource Areas by State under the Soils section.

http://www. nrcs. usda. gov/wps/portal/nrcs/detail/soils/survey/geo/ http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053629 My Note: See Next Slide

http://websoilsurvey. sc. egov. usda http://websoilsurvey.sc.egov.usda.gov/DSD/Download/Cache/STATSGO2/wss_gsmsoil_US_[2006-07-06].zip My Note: Did Not Download

http://www. nrcs. usda. gov/wps/portal/nrcs/detail/soils/survey/geo/ http://www.nrcs.usda.gov/wps/portal/nrcs/detail/soils/survey/geo/?cid=nrcs142p2_053627 My Note: See Next Slide

http://websoilsurvey.sc.egov.usda.gov/App/WebSoilSurvey.aspx http://www.nrcs.usda.gov/wps/portal/nrcs/detail/national/soils/?cid=nrcs142p2_053631 My Note: Pick All States But Only Got All 3262 Counties, Etc. Downloaded Nebraska http://websoilsurvey.sc.egov.usda.gov/DSD/Download/Cache/SSA/wss_SSA_NE131_soildb_NE_2003_[2014-09-02].zip

https://gdg.sc.egov.usda.gov/GDGHome_StatusMaps.aspx

Map Layer Status Map/Spotfire Source Format Projection Major Land Resource Areas by State Link Yes USDA ESRI Shape, ESRI File GeoDataBase Geographic,UTM,State Plane Common Resource Areas by State Link State Only? Soil Survey Spatial and Tabular Data (SSURGO 2.2) ESRI Shape WGS84Geographic Raster Soil Survey Link GDB-to-SHP, Not Yet ESRI File GeoDataBase AutoUTM to county U.S. General Soil Map (STATSGO2) by State Link Nebraska, Yes Gridded Soil Survey Geographic (gSSURGO) by State or Conterminous U.S. Link GDB-to-SHP, Yes Albers My Note: These Links Do Not Go To Data Download

National Cooperative Soil Survey (NCSS) Soil Characterization Database Pedons: The smallest unit or volume of soil that contains all the soil horizons of a particular soil type. It usually has a surface area of approximately 1 sq m (10.76 sq ft) and extends from the ground surface down to bedrock. A Microsoft Access database that contains the most commonly requested data from the National Cooperative Soil Survey Laboratories is available. The database includes data from the Kellogg Soil Survey Laboratory and cooperating universities. In addition to commonly requested data, the Access database includes metadata tables that describe the column headings of the laboratory data tables. In the Access database, the results of similar analyses have been combined and are presented in common columns. Users that wish to obtain the original data, which is separated by method codes, can download the data from the Basic or Advanced query pages. Click on the following link to download the Access database: NCSS Microsoft Access Soil Characterization Database (Zip file; 1.1 MB). http://ncsslabdatamart.sc.egov.usda.gov/

Weeks 4 and 5 Soil File Inventory for Spotfire NCSS_Soil_Characterization_Database: GDB and Access (NCSSSoilCharacterizationDatabase6302015GDB-Spotfire) SoilDataAvailabilityShapefile: Shape (NCSSSoilSurvey-Spotfire) Otoe County, Nebraska: PDF, GIF, and PNG (FarmData-Spotfire) Master_query 72 MB Excel and NCSS_Site_Location 7 MB Excel (NCSSSoilSurvey- Spotfire) and (FarmData-Spotfire) Week 5: wss_SSA_NE131_soildb_NE_2003_[2014-09-02] 19 MB Shape and 12 MB Access (NCSSSoilCharacterizationDatabase6302015GDB-Spotfire) wss_gsmsoil_NE_[2006-07-06] 8 MB Shape and 11 MB Access (NCSSSoilCharacterizationDatabase6302015GDB-Spotfire) nrcs142p2_052440 28 MB Shape and Excel and PDF Image Map (NCSSSoilSurvey- Spotfire) and (FarmData-Spotfire)