U.S. Department of the Interior U.S. Geological Survey July 2014 OPeNDAP Services – Present and Future at LP DAAC Brian Davis 1, Rob Quenzer 1, Jason Werpy.

Slides:



Advertisements
Similar presentations
U.S. Department of the Interior U.S. Geological Survey WTF Core Test Sites Status and Plans WGISS #24, DLR, Oberpfaffenhofen/Munich, Germany October 15,
Advertisements

U.S. Department of the Interior U.S. Geological Survey MRTWeb: Enhanced MODIS data discovery and delivery services from the LP DAAC January 18, 2007 Tom.
A Web-based Community Approach to Model Evaluation using AMET Saravanan Arunachalam 1, Nathan Rice 2 and Pradeepa Vennam 1 1 Institute for the Environment.
LP DAAC Status MODIS Science Team Meeting April , 2014 Chris Doescher, PMP LP DAAC Project Manager Dr. David Meyer.
C van Ingen, D Agarwal, M Goode, J Gupchup, J Hunt, R Leonardson, M Rodriguez, N Li Berkeley Water Center John Hopkins University Lawrence Berkeley Laboratory.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
BlogMyData A Virtual Research Environment for collaborative visualization of environmental data Andrew Milsted | 14 September 2010.
Development of mobile applications using PhoneGap and HTML 5
U.S. Department of the Interior U.S. Geological Survey U.S. National Water Census “Cyber – Platform” Update Progress and challenges to overcome in realizing.
The PHP Story. PHP Story PHP is a programming language. Incorporate(join) sophisticated business logic. Widely used general purpose scripting language.
U.S. Department of the Interior U.S. Geological Survey Biodiversity Information Serving Our Nation (BISON): A National Resource for Species Occurrence.
CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:
U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.
Pi In The Sky (Web Interface) Gaston Seneza Philander Smith College, Little Rock, AR SIParCS Intern Mentors: Dr. Richard Loft & Dr. Raghu Raj Kumar 1.
Global Imagery Browse Services Overview AMSR Science Team Meeting Matt Cechini, GIBS Lead Helen Conover, AMSR-E SIPS.
Cloud Computing in NASA Missions Dan Whorton CTO, Stinger Ghaffarian Technologies June 25, 2010 All material in RED will be updated.
Global Land Cover Facility The Global Land Cover Facility (GLCF) is a member of the Earth Science Information Partnership (ESIP) Federation providing data,
Giovanni for AQ Gregory Leptoukh NASA Goddard Space Flight Center Goddard Earth Sciences Data and Information Services Center (GES DISC)
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
THE LWA SOFTWARE LIBRARY Jayce Dowell – LWA Users’ Meeting – July 27, 2012.
Introduction to the Adapter Server Rob Mace June, 2008.
Center Pixel Value Mean Value of All Pixels Percent of Pixels that meet QC Criteria Web and Web Services based tool that provides subsets and visualization.
1Computer Sciences Department Princess Nourah bint Abdulrahman University.
Where to find LiDAR: Online Data Resources.
U.S. Department of the Interior U.S. Geological Survey USGS/EROS WCS Experience and Ideas for Landsat Data Access WGISS #27 May, 2009 Toulouse, France.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
September 4, 2003MODIS Ocean Data Products Workshop, Oregon State University1 Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) MODIS.
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
U.S. Department of the Interior U.S. Geological Survey Entering A New Landsat Era – The Future is Now Tom Loveland U.S. Geological Survey Earth Resources.
EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.
User Working Group 2013 Data Access Mechanisms – Status 12 March 2013
Rational Unified Process Fundamentals Module 7: Process for e-Business Development Rational Unified Process Fundamentals Module 7: Process for e-Business.
Jianchun Qin, Liguang Wu, Michael Theobald, A. K. Sharma, George Serafino, Sunmi Cho, Carrie Phelps NASA Goddard Space Flight Center, Code 902 Greenbelt,
Evolving toward a Coherent, Collaborative Framework for Earth Science Data, Tools and Services Christopher Lynnes, Kwo-Sen Kuo and Kevin Murphy Earth Science.
Web Pages with Features. Features on Web Pages Interactive Pages –Shows current date, get server’s IP, interactive quizzes Processing Forms –Serach a.
A Data Access Framework for ESMF Model Outputs Roland Schweitzer Steve Hankin Jonathan Callahan Kevin O’Brien Ansley Manke.
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.
Vegetation Index Visualization of individual composite period. The tool provides a color coded grid display of the subset region. The tool provides time.
Future Geospatial Database Technologies and the NHD U.S. Department of the Interior U.S. Geological Survey Jerry Ornelas / Paul Wiese (USGS)
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
U.S. Department of the Interior U.S. Geological Survey Decision Support Tools and USGS Data Management Best Practices Cassandra Ladino USGS Chesapeake.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 14 Database Connectivity and Web Technologies.
U.S. Department of the Interior U.S. Geological Survey LSI Constellation Portal Project WGISS #26, Boulder, Colorado, USA September, 2008 Lyndon R. Oleson.
U.S. Department of the Interior U.S. Geological Survey Discover MODIS Land at your Desk January 17, 2007 Calli B. Jenkerson* MODIS Science Data Specialist.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
U.S. Department of the Interior U.S. Geological Survey Water Data Sharing Using OGC Standards and the Internet David Blodgett USGS Center for Integrated.
Understanding Web-Based Digital Media Production Methods, Software, and Hardware Objective
ORNL DAAC MODIS Land Product Subsets 1 Suresh K. Santhana Vannan, Robert B. Cook, Bruce E. Wilson, Lisa M. Olsen Environmental Sciences Division, Oak Ridge.
Introduction to SQL Server 2000 Reporting Services Jeff Dumas Technical Specialist Microsoft Corporation
U.S. Department of the Interior U.S. Geological Survey LP DAAC Big Earth Data Initiative (BEDI) Developed Web Services 1 Jason Werpy LP DAACEnterprise.
LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert.
NASA Tools for Remote-Sensing in Ecology Research Workshop 2: NASA Tools for Remote-Sensing in Ecology Research 95 th Annual ESA Meeting, Workshop 2, July.
Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.
VertexPlus Softwares Pvt. Ltd. WEB TECHNOLOGIES BEFORE CHOOSING WEBSITE DEVELOPMENT SERVICES FOR WEBSITE vertexplus.com.
USGS EROS LCMAP System Status Briefing for CEOS
Chapter 8 Environments, Alternatives, and Decisions.
Brian Johnson and Doug Young
Global Precipitation Data Access, Value-added Services and Scientific Exploration Tools at NASA GES DISC Zhong Liu1,4, D. Ostrenga1,2, G. Leptoukh4, S.
Joseph JaJa, Mike Smorul, and Sangchul Song
Improving Data Access, Discovery, and Usability
Introduction to R.
LP DAAC AppEEARS Data Access
LP DAAC OPeNDAP Services
What's New in eCognition 9
What's New in eCognition 9
What's New in eCognition 9
Web Application Development Using PHP
Presentation transcript:

U.S. Department of the Interior U.S. Geological Survey July 2014 OPeNDAP Services – Present and Future at LP DAAC Brian Davis 1, Rob Quenzer 1, Jason Werpy 2, David Meyer 3, Chris Doescher 3, Chris Torbert 3 1 Stinger-Ghaffarian Technologies, contractor to U.S. Geological Survey (USGS) Earth Resources Observation and Science (EROS) Center, Sioux Falls, SD, 2 Information Dynamics, contractor to the USGS EROS Center, 3 USGS EROS OPeNDAP Prototype Environment The LP DAAC began offering OPeNDAP services to select science stakeholders in This has allowed us to evaluate OPeNDAP as a data access protocol and investigate what types of data and access methods LP DAAC users will require in the future. All LP DAAC MODIS tile data was made available and some of the LP DAAC’s MODIS tile data was aggregated in to full time series coverage data sets. OPeNDAP access through other tools and partners OPeNDAP services allow other interfaces from outside of the LP DAAC to make LP DAAC data available. The USGS Center for Integrated Data Analytics (CIDA) group’s Geo Data Portal (GDP) can access OPeNDAP datasets from the LP DAAC and provide subsets across time. The Giovanni interface from the Goddard Earth Sciences (GES) Data and Information Services Center (DISC) is planning on using LP DAAC OPeNDAP data access to pull LP DAAC data into its system for viewing and analysis by its users. National Snow and Ice Data Center (NSDIC) is working on accessing LP DAAC data through OPeNDAP to develop an Earth Data Cube. Coding/Scripting with OPeNDAP services Using R and Shiny, the LP DAAC has developed a prototype application to interactively extract Normalized Difference Vegetation Index (NDVI) values derived from a single tile of 500m resolution 16-day composite MODerate resolution Infrared Spectrometer (MODIS) data from both the Terra and Aqua platforms, and graphically plot the variations by date. Shiny applications have two components: a user-interface definition and a server script. These components define the input controls and reactive functions which generate textual and graphical data descriptions. The R libraries incorporate the connectivity to OPeNDAP services which provide interactive data archive exploration. Future Production Environment The production environment that is being planned to provide OPeNDAP services to the public will utilize a cluster of servers to maintain performance. The servers will be configured with access to the products on the LP DAAC Data Pool. CIDA GDP Giovanni Open-source Project for a Network Data Access Protocol (OPeNDAP) services allow Earth Science data users of the LP DAAC to directly access data in a flexible, open manner that lets them customize data selection and delivery. Users can focus more on what they do with the data and less on how to find, download, arrange, manipulate, and alter it to fit their needs. Dataset: MOD17A2.005.h10v04.ncml Gpp_1km[0][0], , , , , , , , , , , , , , , , , , 0.001, 0.001, Gpp_1km[0][1], , , 0.001, , , , , , , , , , , , , 0.001, 0.001, , 0.001, Gpp_1km[0][2], , , , , , , , 0.001, , , , , , , , , , , , Gpp_1km[0][3], , , , , , , , , , , , , , , , , 0.001, 0.001, , Gpp_1km[0][4], , , , , , , , , , , , , , , , , 0.001, , , Gpp_1km[0][5], , , , , , , , , , , , , , 0.001, , , , , , Gpp_1km[0][6], , , , , , , , , , , , , 0.001, , , , , , , Gpp_1km[0][7], , , , , , , , , 0.001, 0.001, , , 0.001, 0.001, , , , , , Gpp_1km[0][8], , , , , 0.001, , , , , , , , 0.001, , 0.001, , , , , Gpp_1km[0][9], , , , , 0.001, , , , 0.001, , , 0.001, , , , 0.001, , , , Gpp_1km[0][10], , , , , , , , 0.001, , 0.001, 0.001, , , , , , , , , … LP DAAC Prototype OPeNDAP Environment LP DAAC MODIS OPeNDAP Subset Example OPeNDAP Aggregation Selection Form Proposed LP DAAC OPeNDAP Cluster Production LP DAAC OPeNDAP Use Cases R is a free software environment for statistical computing and graphics. It compiles and runs on a wide variety of UNIX platforms, Windows, and MacOS. Shiny is an open source R package which provides an elegant and powerful web framework for building web applications using R. Shiny transforms analytical scripts into interactive web applications without requiring HTML, CSS, or JavaScript knowledge. Technologies like R and other scripting languages enable users of LP DAAC data to dynamically interact with datasets and increase the utilization of them for scientific analysis. Scripting Integration with OPeNDAP through a custom UI Example R/Shiny Application