Improving Data Access, Discovery, and Usability

Slides:



Advertisements
Similar presentations
BEDI -Big Earth Data Initiative
Advertisements

MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January
ACE Technical Overview Paul Meyer, ACE Systems Engineer Rob Cermak, ARSC Life Sciences Informatics Support 1.
LP DAAC Status MODIS Science Team Meeting April , 2014 Chris Doescher, PMP LP DAAC Project Manager Dr. David Meyer.
2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.
Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.
Christine White, Esri Growing OPeNDAP Support: Current ArcGIS Workflows and Future Directions Christine White, Esri
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.
Ice Bridge Data Management Scope, Challenges, Solutions Ron Weaver, NSIDC DAAC Manager National Snow and Ice Data Center Supporting Cryospheric Research.
GADS: A Web Service for accessing large environmental data sets Jon Blower, Keith Haines, Adit Santokhee Reading e-Science Centre University of Reading.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
1PoDAG XXX: IceBridge October 12, 2011 PoDAG XXX: IceBridge Marilyn Kaminski IceBridge Project Manager October 12, 2011.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Global Imagery Browse Services Overview AMSR Science Team Meeting Matt Cechini, GIBS Lead Helen Conover, AMSR-E SIPS.
ICESat/GLAS Tools at NSIDC Melinda Marquis NSIDC Product Team Lead, AMSR-E and GLAS Feb. 16, 2005.
MapServer Support for Web Coverage Services Stephen Lime - Minnesota DNR Dr. Thomas E. Burk - University of Minnesota MUM Ottawa, Canada.
BOE/Work Break Down The following slides provide a high level view of the BOE/WBS structure of the proposed NSIDC DAAC Contract.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell.
NSIDC DAAC Hightlights User Working Group Meeting Boulder, CO 3-4 September 2014 NSIDC Distributed Active Archive Center.
EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC
Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.
User Working Group 2013 Data Access Mechanisms – Status 12 March 2013
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
Evolving toward a Coherent, Collaborative Framework for Earth Science Data, Tools and Services Christopher Lynnes, Kwo-Sen Kuo and Kevin Murphy Earth Science.
1 ECHO and EDG Status May 9, 2006 Beth Weinstein, Yonsook Enloe,
s Donna J. Scott, Marilyn Kaminski, Jason Wolfe, Terry Haran NSIDC's MODIS Snow and Sea Ice Products NSIDC provides a suite.
The goal of this NASA ACCESS-funded project is to create easy to use, multi-faceted web services for access, browse, online analysis and delivery of data.
AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC June 2011.
1 The Polar HDF-EOS Data Imaging and Subsetting (PHDIS) Tool Siri Jodha Singh Khalsa Emergent Information Technologies, Inc. National Snow and Ice Data.
TERRA UPDATE Launch Date NSIDC DAAC Launch Readiness MODIS Snow and Ice Products General Product Release Timeline.
MODIS Data at NSIDC MODIS Science Team Meeting - Nov. 2, 2006.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
U.S. Department of the Interior U.S. Geological Survey LP DAAC Big Earth Data Initiative (BEDI) Developed Web Services 1 Jason Werpy LP DAACEnterprise.
LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert.
Earth Science Data and Information System (ESDIS) Project Update Jeanne Behnke, Deputy Project Manager for Operations NASA Earth Science Data & Information.
U.S. Department of the Interior U.S. Geological Survey July 2014 OPeNDAP Services – Present and Future at LP DAAC Brian Davis 1, Rob Quenzer 1, Jason Werpy.
Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.
Evolving the Management and Dissemination of NASA Earth Observation Data in a Big Data World Jeff Walter 1, Mark McInerney 2 (1)NASA Langley Research Center;
NSIDC DAAC Update 2016 UWG Annual Meeting Boulder, CO
Evolving Architecture at NSIDC
NSIDC UWG Telecon April 6, 2017.
Data Are from Mars, Tools Are from Venus
Brian Johnson and Doug Young
Joslynn Lee – Data Science Educator
Standardization Promotes Biogeochemical Data Management and Use in Multidisciplinary Environmental Research Yaxing Wei, Suresh Vannan, Robert B. Cook,
EOS ClearingHOuse Robin Pfister Code 423, NASA/GSFC
INTAROS WP5 Data integration and management
NASA NSIDC DAAC Metrics
Flanders Marine Institute (VLIZ)
WMO Snow Watch Team – Second Session June 2016
Donna J. Scott, Julia Collins, Peter Pulsifer
Amanda Leon ESIP Summer 2017
NSIDC DAAC UWG Meeting August 9-10 Boulder, CO
Paul Stackhouse, NASA LaRC
Accessing Spatial Information from MaineDOT
“Operation IceBridge, CryoSat-2, ICESat”
LP DAAC AppEEARS Data Access
NASA Earthdata Login Andrew Mitchell - NASA WGISS-44 Beijing, China
LP DAAC OPeNDAP Services
What's New in eCognition 9
NASA NSIDC DAAC Metrics
Data Discovery Tools and Services Part B
Introduction to Portal for ArcGIS
What's New in eCognition 9
Future Development Plans
What's New in eCognition 9
Presentation transcript:

Improving Data Access, Discovery, and Usability Amanda Leon - Deputy DAAC Manager Renea Ericson - DAAC Software Project Lead

Current DAAC efforts to improve: DISCOVERY ACCESS Programmatic access to services Worldview/GIBS Polar Map Application AppEEARS On-demand services USAGE

Imagery exploration in NASA Worldview/GIBS Visual data exploration benefits a range of users The DAAC and SIPS are producing GIBS imagery for targeted data Available now: MODIS 500 m Snow | SMAP | MEaSUREs Freeze/Thaw Available by end of FY16: SSM/I-SSMIS TBs & Sea Ice | MEaSUREs Greenland & Antarctic Ice Sheet, NH State of Cryo | Aquarius Soil Moisture Future: MODIS ? | ICESat-2 | Others? “Visualize” button takes users to preloaded imagery and date in Worldview Overlay and compare hundreds of NASA data layers Download a GeoTIFF or native data files

On-demand data services Addresses main data challenges and use cases cited by our user communities Heterogeneous data formats and projections Specific parameters or regions of interest Data volumes Establishing a service baseline for our high level-of-service, EOSDIS products Current: AMSR | ICESat | MODIS | SMAP | SSM/I-SSMIS Planned: AMSR-U | ICESat-2 | MeASUREs | VIIRS Requires an extensible, sustainable architecture Leverage technologies (gdal, OPenDAP) to efficiently extend to new data Scalable processes for testing and maintaining Subset Parameter Spatial Temporal Reformat Reproject GeoTIFF NetCDF ASCII HDF KML UTM Geographic Polar stereo EASE

Programmatic access to data services Access to on-demand services has been through a user interface (Reverb, Earthdata Search) Offering programmatic (machine-to-machine) access will allow expert users to integrate them into their data workflows Identified as key ICESat-2 user need Will expose OPeNDAP API with instructions for accessing with common applications (Matlab, Panoply) Working with ESDIS and EED on a standards-based (WCS) API access to the suite of existing on-demand services

Polar Map Application Integrated tile caching Replaces desired functionality of Atlas of The Cryosphere (EOL) Including key polar-focused data layers Sea Ice Extent |Sea Ice concentration |GLIMS Glacier Outlines Using relevant imagery layers from GIBS Coastlines | Graticule | Blue Marble Technology can be leveraged for other domain-focused map applications (e.g. snow, soil moisture) Uses GeoServer Integrated tile caching Robust support of OGC protocols Maturity – Large user base, active internet community

Polar Map Application Progress to-Date Next Step Ingest utility Currently command line Functional with raster and vector data Can be leveraged by other project GeoServer REST interface Admin GUI Next Step Complete user Interface Evaluate other datasets for incorporation into Polar Map Application (PMA) Leverage PMA to replace functionality of other NSIDC tools

AppEEARS – LP and NSIDC DAAC Collaboration Application for Extracting and Exploring Analysis Ready Samples Developed at LP DAAC Provides aggregated time series at a point; will be extended to polygons Current NSIDC subsetting services do not aggregate into single file Data aggregation using OPeNDAP

AppEEARS – LP and NSIDC DAAC Collaboration Progress to-Date NSIDC used LPDAAC code to create prototype Ingested MODIS MOD10A1 data Successful testing LP & NSIDC DAACs have found and addressed some collaboration issues Planning next phase Phase 2 Build Operational Server Ingest, test and operationalize all MODIS snow data Development starts late August Target for operational functionality 12/2016 Potential next use cases - SMAP

Putting the pieces together Providing more capabilities, not more decisions Continued efforts to centralize services through a focused set of UIs Evaluate Web site workflows to align user goals with appropriate UIs and services NSIDC Search Earthdata Search OIB Portal Worldview Polar Map App API User Interface ? ? HTTPS Data Access CMR On-demand services GIBS Imagery OPeNDAP AppEEARS Services