Jianchun Qin, Liguang Wu, Michael Theobald, A. K. Sharma, George Serafino, Sunmi Cho, Carrie Phelps NASA Goddard Space Flight Center, Code 902 Greenbelt,

Slides:



Advertisements
Similar presentations
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Advertisements

Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%
May 17, Capabilities Description of a Rapid Prototyping Capability for Earth-Sun System Sciences RPC Project Team Mississippi State University.
November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
User Services Experience GSFC DAAC MODIS Science Team Meeting Greenbelt, MD July 2002
Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.
NASA Goddard Earth Sciences (GES), Data Information Service Center (DISC), Distributed Active and Archive Center (DAAC), Greenbelt, MD - USA Gilberto Vicente,
Kansas State University Department of Computing and Information Sciences CIS 830: Advanced Topics in Artificial Intelligence From Data Mining To Knowledge.
Crystal Hoyer Program Manager IIS Team Preview of features that will be announced at MIX09 Please do not blog, take pictures or video of session.
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
NASA/ESA Interoperability Efforts CEOS Subgroup - CINTEX Alexandria, Sept 12, 2002 Ananth Rao Yonsook Enloe SGT, Inc.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Liguang Wu, Jianchun Qin, A.K.Sharma, Sunmi Cho* and Carrie Phelps Goddard Earth Sciences DISC DAAC NASA Goddard Space Flight Center, Code 902 Greenbelt,
At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.
December 5, 2002HDF-EOS Workshop VI1 The Goddard Earth Sciences Distributed Active Archive Center The Goddard Earth Sciences Distributed Active Archive.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
BOE/Work Break Down The following slides provide a high level view of the BOE/WBS structure of the proposed NSIDC DAAC Contract.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
ASI-Eumetsat Meeting Matera, 4-5 Feb CNM Context Matera, February 4-5, 20092ASI-Eumetsat Meeting.
Data and Metadata Integrity AIRS DST Roles Monitor AIRS Products generation Monitor AIRS Distribution Monitor AIRS Subscription Operational QA flag Science.
, Key Components of a Successful Earth Science Subsetter Architecture ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
September 4, 2003MODIS Ocean Data Products Workshop, Oregon State University1 Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) MODIS.
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
MODIS OCEAN QA Browse Imagery (MQABI Browse Tool) NASA Goddard Space Flight Center Sept 4, 2003
A 04/10/2000 HHOB HJMS HOMA HDUN HUAF HNSG HCHL HPRE Cloud Cover and Ocean Area Search for SeaWiFS Ocean Color Data J.G. Acker 1 D. Nadeau 1 S. Shen 2.
EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)
GES DISC DAAC February 28, 2002HDF-EOS Workshop V1 The Goddard DAAC The Goddard DAAC Presented by:
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
Page 1 CSISS Center for Spatial Information Science and Systems Access HDF-EOS data with OGC Web Coverage Service - Earth Observation Application Profile.
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
Suhung Shen James G. Acker Denis Nadeau George Serafino Goddard Earth Sciences (GES) Data and Information Services Center (DISC) Distributed Active Archive.
Obtaining MISR Data and Information Nancy Ritchey Atmospheric Science Data Center March 20, 2006.
Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.
1 HDF-EOS Workshop II HDF-EOS Workshop II Introduction Candace Carlisle Earth Science Data and Information Systems (ESDIS) Project.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
KEY PERSONNEL Dr. Bob Schutz, GLAS Science Team Leader Dr. Jay Zwally, ICESat Project Scientist, GLAS Team Member Mr. David Hancock, Science Software Development.
ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
Evolution of the JPSS Ground Project Calibration and Validation System Patrick Purcell, Gyanesh Chander and Peyush Jain JPSS Ground Project NASA, GSFC.
WebDat: A Web-based Test Data Management System J.M.Nogiec January 2007 Overview.
MODIS SDST, STTG and SDDT MODIS Science Team Meeting (Land Discipline Breakout Session) July 13, 2004 Robert Wolfe Raytheon NASA GSFC Code 922.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
MODIS Data at NSIDC MODIS Science Team Meeting - Nov. 2, 2006.
HISTORICAL HIGHLIGHTS 1993 Coastal Zone Color Scanner (CZCS) data is archived at the Goddard Distributed Active Archive Center CZCS data files are.
AIRS/AMSU-A/HSB Data Subsetting and Visualization Services at GES DAAC Sunmi Cho, Jason Li, Donglian Sun, Jianchun Qin and Carrie Phelps, Code 902, NASA.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.
MODIS Distributed Active Archive Centers (DAACs) Level 1 Processing/Reprocessing Level 1+ Archive and Distribution Presentation to MODIS Science Team December.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
ISWG / SIF / GEOSS OOSSIW - November, 2008 GEOSS “Interoperability” Steven F. Browdy (ISWG, SIF, SCC)
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
07/07/ KDD Services at the Goddard DAAC Robert Mack NASA/Goddard Space Flight Center Distributed Active Archive Center.
AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.
NASA Earth Science Data Stewardship
New GES DISC Services Shortening the Path in Science Data Discovery
WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Earth Data Search Tool Demo
Intermountain West Data Warehouse
Presentation transcript:

Jianchun Qin, Liguang Wu, Michael Theobald, A. K. Sharma, George Serafino, Sunmi Cho, Carrie Phelps NASA Goddard Space Flight Center, Code 902 Greenbelt, Maryland Data Processing Support Data IntegrityValue-Added Data ServicesUser Assistance The AIRS Data Support Team at GES DISC DAAC provides science and data support to assist the AIRS data user in understanding, accessing and utilizing the AIRS data products. User assistance includes: » Informational webpages which provide access to: Various technical documents Readme, AIRS Guide, DIFs Product ordering and distribution Sample imagery HDF-EOS format information Online data tools AIRS Science Team web links Contact information » AIRS Data Access DAAC Search and Order Enables users to request data efficiently through hierarchical architecture. Shows temporal coverage, number of items, average item size, description and browse images for the AIRS data products available. At certain levels of the hierarchy, spatial, temporal, orbital and parameter search features are provided to customize searches. ECS Data Pool A new solution for distributing EOS data on-line. It will increase the distribution capacity by significantly reducing the need to access a tape archive. In addition, user accesses to the data should be made faster and easier. EOS Data Gateway The EOS Data Gateway (EDG) is the interface to all data available in NASA's Earth Observation System Data Information System and related data centers. The data support team will submit valids and provide online guide documents,data product definition, testing ordering. » “Golden Day” data archiving and distribution » Help desk for various user questions and special requests » Publicity of AIRS data products at various scientific conferences, meetings and seminars The AIRS data processing support involves the AIRS Earth Science Data Type (ESDT) management, integration of science software in the production systems (both the Planning and Data Processing Subsystems (PDPS) and the Simple Scalable Script-based Scientific Processor - Mission (S4PM)), monitoring data production, and trouble shooting. » ESDT Support AIRS Descriptors verification and updates ESDT installations and checkout in ECS operations EOS Data Gateway (EDG) Valids processing, submission and updates EDG testing and checkout for new products Coordinating the public release of AIRS products » Science Software Integration & Test (SSI&T) Support Goddard Automation Tools for Enhanced SSI&T (GATES) is a suite of tools for automating, standardizing, and documenting SSI&T activities. Activities of GATES include: Development of SSI&T Tools Maintenance of AIRS SSI&T Documents Development of Web Forms for Controlled Integration AIRS Test Summary Reports Maintenance of AIRS SSI&T Agreement » Replacement of PDPS by S4P-Mission Due to the successful deployment of S4PM for MODIS processing, ESDIS requested the incorporation of AIRS into S4PM. Implementation is scheduled for October February 2002 as follows: L1 Implementation: 1 October - 15 November L1 Testing: 29 October - 15 December L2 Implementation: 1 December - 15 January L2 Testing: 15 January - 15 February MOSS-6 w/S4PM (L1 only): Mid January » Other Support Supply of NOAA observational and forecast products as input for AIRS L2 processing, including raw data, documentation and decoding tools Work with AIRS Data Providers on data products definition to facilitate access of data by the larger user community Coordination between Data Provider and the data production team The AIRS Data Support Team assists the Data Producer by performing data integrity checks. These checks fall into three categories: production, ingest and distribution checks. » Production Production tools are helpful in checking the production at each stage. Data gaps due to data/system problems can be determined by these tools. Data integrity checks are also performed in the production stream and metadata validation to identify problems with science algorithms and corrupted data, and to ensure proper database population of attributes. » Data Ingest Metadata check tools are used to compare the metadata before and after the ingestion. This includes validation of all the attributes and ECS Core metadata quality check. » Distribution Distribution tools are designed to help many aspects of distribution system including the statistics of the data distributed to different users on different media. These tools are helpful in determining the most popular data products and media. » Other QA Support Application of MUSE/QAMUT (QA Metadata Update Tool) Identifying problems through tool development and team player’s knowledge of the data » Data production and distribution tools are listed as: AIRS L0 Data Monitor AIRS Data Production Monitor AIRS Data Production Request Monitor AIRS Shipping Monitor AIRS Data Distribution Monitor AIRS Data Archive Monitor AIRS Data Inventory Monitor » Channel/variable subsetting and restructuring The web-based AIRS on-the-fly/on-demand subsetter performs channel and variable subsetting and restructuring for AIRS Level 1A, Level1B and Level2 data products. One can narrow down criteria to subset data files with desired channels and variables and download the subsetted file. » Data mining Integrate and run user-provided data reduction algorithms to routinely generate value-added products. This type of procedure, so-called “knowledge discovery from data bases” (KDD), provides an external subsystem that interfaces with GES DISC DAAC system in a manner similar to that of other data producers. AIRS Data Support Team is developing, researching, integrating on- line/off-line tools in order to assist users in manipulating AIRS data files. » On-line data visualization and analysis The HTML/CGI interfaces interacting with data analysis software, such as IDL, allow users to search, select, analyze and manipulate » Data format and tools support AIRS data users will need certain tools to get full use out of AIRS data which is in HDF-EOS format. Tools that are available for reading, displaying and manipulating AIRS data will be tested and recommended to AIRS users as they become available. AIRS users can have a list of those tools from the AIRS Data Support web page. In addition, the AIRS Data Support Team will provide programs in various computer languages (e.g., C, FORTRAN, IDL, MATLAB) for this purpose. data, and assure data contents such as domain, parameters, data quality, physical features prior to ordering data product. The vertical profiling feature will be particularly useful with AIRS data. Web snapshots of monitoring tools are courtesy ECS.