1 U.S. Department of the Interior U.S. Geological Survey LP DAAC Stacie Doman Bennett, LP DAAC Scientist.

Slides:



Advertisements
Similar presentations
Product Quality and Documentation – Recent Developments H. K. Ramapriyan Assistant Project Manager ESDIS Project, Code 423, NASA GFSC
Advertisements

NASA Earth Science Data Preservation Content Specification H. K. (Rama) Ramapriyan John Moses 10 th ESDSWG Meeting – November 2, 2011 Newport News, VA.
Metrics Planning Group (MPG) Report to Plenary Clyde Brown ESDSWG Nov 3, 2011.
North American Croplands Richard Massey & Dr. Teki Sankey.
How to Download MODIS Images Dr. A.K.M. Saiful Islam, IWFM, BUET Dr. Sujit Kumar Bala, IWFM, BUET Mr. M. Golam Mahboob, BARI December 2007.
Geographic data: sources and considerations. Geographical Concepts: Geographic coordinate system: defines locations on the earth using an angular unit.
11-12 June 2015, Bari-Italy Coordinating an Observation Network of Networks EnCompassing saTellite and IN-situ to fill the Gaps in European Observations.
MPARWG Deborah K Smith DISCOVER MEaSUREs Project Remote Sensing Systems.
Rebecca Boger Earth and Environmental Sciences Brooklyn College.
Global Croplands Project Remote Sensing of Global Croplands and their Water Use for Food Security in the Twenty-first Century Prasad S. Thenkabail
U.S. Geological Survey U.S. Department of Interior GFSAD30m Global Cropland Extent Products of Nominal 250 m (GCE V2.0) Updates Pardhasaradhi.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
U.S. Geological Survey U.S. Department of Interior GFSAD30m Global Cropland Extent Products of Nominal 250 m (GCE V2.0) Updates Pardhasaradhi.
Applied Cartography and Introduction to GIS GEOG 2017 EL Lecture-3 Chapters 5 and 6.
SAFARI 2000 Data Activities at the ORNL DAAC Bob Cook, Les Hook, Stan Attenberger, Dick Olson, and Tim Rhyne Oak Ridge National Laboratory.
1ESDIS HDF-EOS Workshop IV Landover, Maryland, September 20, 2000 The Landsat 7 Processing System ( LPS ) Level Zero-R Science Products Michael R. Reid.
, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.
, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
MODIS Land and HDF-EOS HDF-EOS Workshop Presentation September 20, 2000 Robert Wolfe NASA GSFC Code 922, Raytheon ITSS MODIS Land Science Team Support.
Elements of a Data Management Plan Bill Michener University Libraries University of New Mexico Data Management Practices for.
U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
CC&E Best Data Management Practices, April 19, 2015 Please take the Workshop Survey 1.
Welcome to the MODIS Land Collection 5 / Long Term Data Record Workshop Chris Justice MODIS Land Discipline Lead.
Pardhasaradhi Teluguntla, Jun Xiong, and Prasad Thenkabail Global Cropland Extent Version 1.0 (GCE V1.0) January 16-17, 2014 third Workshop on Global Food.
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
2007 EOSDIS User Survey Carol Boquist ESDIS Outreach Manager Science Operations Office 11/7/2007 Carol Boquist ESDIS Outreach Manager Science Operations.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
Archival Information Packages for NASA HDF-EOS Data R. Duerr, Kent Yang, Azhar Sikander.
Transitioning Low Earth Orbit Satellite Archive Data from Informix (Geodetic DataBlade) to PostgreSQL (PostGIS) Churngwei Chu [
U.S. Department of the Interior U.S. Geological Survey GFSAD30 Field Work Planning: Progress in Australia Pardha, Prasad, and Jun GFSAD30 monthly meeting,
AN ENHANCED SST COMPOSITE FOR WEATHER FORECASTING AND REGIONAL CLIMATE STUDIES Gary Jedlovec 1, Jorge Vazquez 2, and Ed Armstrong 2 1NASA/MSFC Earth Science.
Managing the Impacts of Change on Archiving Research Data A Presentation for “International Workshop on Strategies for Preservation of and Open Access.
U.S. Department of the Interior U.S. Geological Survey GFSAD30 Monthly Meeting Status Review Prasad GFSAD30 monthly meeting, August 21 st, 2014, Webex\Telecon.
Speeding Nano Progress Using Information Diffusion Walt Warnick, Ph.D. Director, Office of Scientific and Technical Information U.S. Department of Energy.
U.S. Department of the Interior U.S. Geological Survey Entering A New Landsat Era – The Future is Now Tom Loveland U.S. Geological Survey Earth Resources.
Aquarius Level-3 Binning and Mapping Fred Patt. Definitions Projection - any process which transforms a spatially organized data set from one coordinate.
1 U.S. Department of the Interior U.S. Geological Survey LP DAAC Stacie Doman Bennett, LP DAAC Scientist Dave Meyer, LP DAAC Project Scientist.
Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.
MODIS Snow and Sea Ice Data Products George Riggs SSAI Cryospheric Sciences Branch, NASA/GSFC Greenbelt, Md. Dorothy K.
Croplands.org Aiming to release to public in next couple weeks. There will likely be a separation of work space from public space.
U.S. Department of the Interior U.S. Geological Survey GFSAD30 Field Work Planning: Progress in Australia Pardha, Prasad, and Jun GFSAD30 monthly meeting,
ORNL DAAC: Introduction Bob Cook ORNL DAAC Environmental Sciences Division Oak Ridge National Laboratory.
1 U.S. Department of the Interior U.S. Geological Survey LP DAAC Dave Meyer, LP DAAC Project Scientist Stacie Doman Bennett, LP DAAC Scientist.
U.S. Department of the Interior U.S. Geological Survey Monthly Progress for Africa GCEV2 Jun Xiong, Prasad, Pardha 23 October, 2014.
U.S. Geological Survey U.S. Department of Interior GFSAD 30 Cropland Products of Nominal 250 m Using MODIS Data and Cropland Mapping Algorithms:
ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
Trials and Tribulations of a Small Archive Presented at the THIC Conference, NCAR, Boulder CO June 30, 2004 Presented at the THIC Meeting at the National.
NSIDC—Enhancing NASA’s Contribution to Polar Science A response to the NRC Polar Research Board’s review of NASA’s polar geophysical data sets Mark Parsons.
More Information Working Group Composition End Users Data Modelers Data Analysts Airborne Measurement Scientists Airborne Instrument Scientists Data Management.
Data Templates Jeanne Behnke
MODIS Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
Spatially Complete Global Spectral Surface Albedos: Value-Added Datasets Derived From Terra MODIS Land Products Eric G. Moody 1,2, Michael D. King 1, Steven.
U.S. Geological Survey U.S. Department of Interior GFSAD30m Global Cropland Extent Products of Nominal 250 m (GCE V2.0) Area claculations Pardhasaradhi.
Providing access to your data: Determining your audience Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.
Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.
U.S. Geological Survey U.S. Department of Interior GFSAD30m Global Cropland Extent Products of Nominal 250 m (GCE V2.0) Updates Pardha Teluguntla.
CLASS Metadata and Remote Sensing Extensions CLASS Data Provider’s Conference September 2005 Anna Milan, Ted.Habermann,
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
1 Current Plans for Long Term Archiving of MODIS Data Martha Maiden Program Executive Earth Science Data Systems NASA Headquarters MODIS Meeting November.
U.S. Geological Survey U.S. Department of Interior Automated Cropland Mapping Algorithms (ACMA) for Global Food Security Assessment Across Years Pardhasaradhi.
Website: Croplands.org. User Authentication Full user authentication system with roles. User passwords hashed (one way encrypted) with a salt using modern.
US Croplands Richard Massey Dr Teki Sankey. Objectives 1.Classify annual cropland extent, Rainfed-Irrigated, and crop types for the US at 250m resolution.
NASA Earth Science Data Stewardship
Standardization Promotes Biogeochemical Data Management and Use in Multidisciplinary Environmental Research Yaxing Wei, Suresh Vannan, Robert B. Cook,
GEOGRAPHICAL INFORMATION SYSTEM
Persistent Identifiers Implementation in EOSDIS
CEOS WGISS Carbon Data Portal: Progress and Demo CEOS WGISS Carbon Portal Team Reported at WGISS’48 Vietnam Academy of Science and Technology, Hanoi,
Presentation transcript:

1 U.S. Department of the Interior U.S. Geological Survey LP DAAC Stacie Doman Bennett, LP DAAC Scientist

2 LP DAAC & MEaSUREs GOALS Expand Understanding of the Earth System Using Consistent Records Preserve NASA’s Earth Science Data For Future Generations Data Distribution

3 GFSAD Communicating Project Status

4 GFSAD ECE Project Space  View of events, documentation, checklist deliverables received (NASA HQ review).  ATBDs & Product User Guide (e.g. ASTER GED).ASTER GED  Documentation drop locations – user/password protected.

5

6 GFSAD Global Cropland Mobile Application

7 GFSAD Future of Mobile Application  Use (current & future):  How will the ground data process be described?  Will the ground data be considered a GFSAD dataset?  How will ground data be validated & documented?  Can the validation be validated? Favorable agreement %?

8 GFSAD Documentation ATBDs / NASA ESDIS Data Template / Product Quality Checklist

9 GFSAD ATBDs  The ATBD(s) should:  Be a clear description of the algorithms used to generate the products.  Be understandable to the intended users of the products.  Be applicable to the version of the product delivered to the DAAC.  Datasets that use inputs for which ATBDs are available can just point to those ATBDs; but there needs to be documentation on how the delivered products were generated using those inputs.  For example, using MODIS EVI as in input to a MEaSUREs product algorithm  The form and review process used for an ATBD is at the discretion of the funding NASA Program Manager.  Peer reviewed articles as ATBDs – Five requirements: 1. Background/Intro 2. Algorithm descriptions 3. External dependencies/product interdependencies 4. Approach to validation/uncertainty analysis 5. Anticipated/known issues

10 GFSAD NASA ESDIS Data Template  Requirements  Project Overview  Project Objectives  Science Objectives  Mission Summary  Instrument Overview  Project Data Flow  Mission Operations  Science Operations  Products  For Each Product  Science Data Product Summary  Associated Archive Products  Special Considerations Caveats / Known Issues / Micro Issues (e.g. crop failure/replant)

11 GFSAD NASA Product Quality Checklist  Each project is asked to coordinate with its partner DAAC to complete checklists for ESDRs or groups of ESDRs as they are completed and provided to the DAAC for archive and distribution. The completed checklists will then document the completion, delivery to the DAAC, archive, and preparation for or beginning of distribution of the ESDR(s) to the science community. The products documented in the checklists should be those new ESDRs developed by the project under MEaSUREs funding.  The checklists would be completed for each ESDR, or group of ESDRs that are handled as a package by a project or DAAC. The project and DAAC can split out the tables (i.e. clip off the introductory text) and make as many copies of the tables as needed, and fill in responses for each ESDR or group of ESDRs.  The response to each question (in the box following each question) would be yes, partially, or no. Explanations of a ‘partial’ response or any other explanatory comments would be entered into the ‘comments’ row below each question. Then comments may be as long as needed; as text is entered into the comment fields they will grow to accommodate it, and the number of pages occupied by the checklist will grow as needed.

12 GFSAD NASA Product Quality Checklist

13 Provisional LP DAAC

14 GFSAD 1KM

15 GFSAD 250M

16 GFSAD croplands.org WMS

17 GFSAD LP DAAC WMS  LP DAAC will not continue development of a GFSAD WMS:  Considering Justin’s work, provisional needs are met (?).  If there exist reasons to continue:  What are the (new/not included/missing) features ?

18 GFSAD GCE Versions  GCE V0.0, 1.0, 2.0, 3.0  Existing journal references exist for V0.0 & V1.0.  Known requirement to re- document V0.0 & V1.0 products.  Team versions vs algorithm versions = confused users.  LP DAAC Versions  GFSAD1KMCD V1.0  GFSAD1KMCM V1.0  GFSAD250M<> V1.0  GFSAD30M<> V1.0  Going Forward  LP DAAC recommends eliminating current team versions.  Instead, describe the products, such as “GFSAD Crop Mask at 1KM”, “GFSAD Crop Dominance at 1KM”, “GFSAD at 250M”.  Not recommended, a compromise is GFSAD1KMCD (GCE V1.0)

19

20  Note:  “…develop a checklist of a small number of questions that represented progress in the product quality area. We considered product quality to be a combination of scientific quality and the completeness of associated documentation and ancillary information. The responsibility for the product quality is shared between the projects generating the ESDRs and the DAACs that eventually archive and distribute them.”  Each project is asked to coordinate with its partner DAAC to complete checklists for ESDRs or groups of ESDRs as they are completed and provided to the DAAC for archive and distribution. The completed checklists will then document the completion, delivery to the DAAC, archive, and preparation for or beginning of distribution of the ESDR(s) to the science community. The products documented in the checklists should be those new ESDRs developed by the project under MEaSUREs funding.  The checklists would be completed for each ESDR, or group of ESDRs that are handled as a package by a project or DAAC. The project and DAAC can split out the tables (i.e. clip off the introductory text) and make as many copies of the tables as needed, and fill in responses for each ESDR or group of ESDRs.  The response to each question (in the box following each question) would be yes, partially, or no. Explanations of a ‘partial’ response or any other explanatory comments would be entered into the ‘comments’ row below each question. Then comments may be as long as needed; as text is entered into the comment fields they will grow to accommodate it, and the number of pages occupied by the checklist will grow as needed.

21 Provisional Data Distribution GFSADCD1KM aka GCE V0.0 The GFSAD Global Crop Dominance at nominal 1KM(GFSADCD1KM), aka Global Cropland Extent 1km Crop Dominance (GCE V0.0), provides information on the spatial distribution of the five major global cropland types (wheat, rice, corn, barley, and soybeans), which occupy 60 percent of the total cropland area at nominal 1km. The map is produced by overlying the five major cropland types of the world produced by Ramankutty et al. (2008), Monfreda et al. (2008), and Portman et al. (2009) over the remote sensing derived global irrigated and rainfed cropland area map of the International Water Management Institute (IWMI; Thenkabail et al., 2009a, 2009b, 2011). The GFSADCD1KM product is an 8 class digital product that provides, at nominal 1 km, information on global: 1. Cropland extent\areas; 2. irrigated versus rainfed cropping; 3. Crop dominance; and 4. Cropping intensity (single, double, triple, and continuous crops). Geographic Extent: Global Map Projection: Geographic (Lat/Long) Datum: World Geodetic System 84 Raster Type: Thematic Spatial Coordinates: Min/Max Longitude -180 to 180, Min/Max Latitude -90 to 90 Temporal Coverage: Nominal Year 2000 Columns: 40430, Rows: Size: 845MB

22 Provisional Data Distribution GFSADCM1KM aka GCE V1.0 The GFSAD Multi-Study Global Crop Mask (GFSADCM1KM), aka Global Crop Extent (GCE V1.0), provides the spatial distribution of a disaggregated five class global cropland extent map derived at nominal 1km based on four major studies: Thenkabail et al. (2009a, 2011), Pittman et al. (2010), Yu et al. (2013), and Friedl et al. (2010). Classes 1 to Class 5 are cropland classes, that are dominated by irrigated and rainfed agriculture. Class 4 and Class 5 have minor/very minor fractions of croplands. GCE 1KM Multi-study Crop Mask is a 5 class digital product that provides, at nominal 1 km, information on global: 1. cropland extent\areas, 2. irrigated versus rainfed cropping. There is no crop type or crop type dominance information. Cropping intensity (single, double, triple, and continuous crops) can be obtained for every pixel using time-series remote sensing data. Geographic Extent: Global Map Projection: Geographic (Lat/Long) Datum: World Geodetic System 84 Raster Type: Thematic Spatial Coordinates: Min/Max Longitude -180 to 180, Min/Max Latitude -90 to 90 Temporal Coverage: Nominal Year 2000 Columns: 40457, Rows: Size: 25.67MB

23 GFSAD Product Formats  NASA encourages use of Climate and Forecast (CF) Metadata Conventions.encourages use of  Using CF conventions will enhance data discoverability, accessibility and usability.  NASA standards and references:standards and references  HDF 5 HDF 5  HDF EOS 5 HDF EOS 5  NetCDF Classic NetCDF Classic  NetCDF-4/HDF5 File Format NetCDF-4/HDF5 File Format  OGC KML OGC KML  International Consortium for Atmospheric Research on Transport and Transformation (ICARTT) File Format Standards International Consortium for Atmospheric Research on Transport and Transformation (ICARTT) File Format Standards