1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.

Slides:



Advertisements
Similar presentations
1 HDF-EOS Status, Related Tools and Issues. 2 TOOLKIT / HDF-EOS Support.
Advertisements

MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January
Status of MODIS Production (C4/C5 Testing) Mike Teague 1/5/06.
LP DAAC Status MODIS Science Team Meeting April , 2014 Chris Doescher, PMP LP DAAC Project Manager Dr. David Meyer.
LP DAAC User Services Provide support to users on ASTER data related problems; Resources on ASTER: EROS Data Center Land Processes DAAC URL:
Abstract Terry HaranNational Snow and Ice Data Center, 449 UCB, University of Colorado, Boulder, CO 80309, USA Contact: A spheroid is.
1 Generalized Conversion of HDF-EOS Products to GIS Compatible Formats Larry Klein, Ray Milburn, Cid Praderas, and Abe Taaheri Emergent Information Technologies,
University of Illinois at Urbana-ChampaignHDF Mike Folk HDF-EOS Workshop IV Sept , 2000 HDF Update HDF.
Support EOS: Review and Discussions Kent Yang and Joe Lee The HDF Group October 16, 2012 Oct. 16, 2012Annual HDF Briefing to ESDIS1.
Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.
The HDF-EOS5 Tutorial Ray Milburn L3 Communciations, EER Systems Inc McCormick Drive, 170 Largo, MD USA
R A D I A T I O N B U D G E T C L O U D S A E R O S O L S T R O P O S P H E R I C C H E M I S T R Y L a n g l e y A t m o s p h e r i c S c i e n c e s.
What is HDF-EOS? Information compiled from HDF-EOS Workshop II HDF-EOS Workshop III, 1999 ESDIS Project, Code 423 NASA/Goddard Space Flight Center Greenbelt.
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
1 HDF-EOS and Related Tools Status Update. 2 Overview.
Introduction to MISR Data Analysis and Tools Linda Hunt Science Systems & Applications Inc., NASA LaRC Brian E. Rheingans Jet Propulsion Laboratory, California.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
1 HDF-EOS APIs, tools, etc. Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.
Page 1 HDF-EOS Tools Abe Taaheri, Raytheon IIS ESIP Meeting Chapel Hill, NC July 9, 2013.
ArcGIS and NASA EOS Data NASA GES DISC Team: Aijun Chen, Wenli Yang, Peisheng Zhao, Long Pham, Chris Lynnes, Gail Wade NASA ESDIS: Ross Bagwell, Francis.
MODIS Land and HDF-EOS HDF-EOS Workshop Presentation September 20, 2000 Robert Wolfe NASA GSFC Code 922, Raytheon ITSS MODIS Land Science Team Support.
April 6, 2010GMQS Meeting1 Optional Feature Support in HDF5 Tools Albert Cheng The HDF Group.
September 4 -5, 2013Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Leader Science Computing Facility Current Science Software.
1 HDF-EOS Status and Development Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
Introduction to MISR Data Analysis and Tools
Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
1 HDF-EOS Development Current Status and Schedule Larry Klein, Shen Zhao, Abe Taaheri and Ray Milburn L-3 Communications Government Services, Inc. September.
Page 1 Current Status of HDF-EOS, Maintenance, Developments, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshop XI November 2007.
25 June 2009 Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility.
HDF & HDF-EOS Workshop VIII 2004 October Aurora, CO Bruce Beaumont, Matt Smith, Helen Conover, Sara Graves Subsetting at UAH.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
WSL Workshop The Long and Winding Road to MODIS Data.
AMSR-E Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.
HDF-EOS Workshop IV September 19, 2000 MODIS Reprojection Tool presented by John M. Weiss, Ph.D. Department of Mathematics and Computer Science South Dakota.
LDOPE QA Tools Sadashiva Devadiga (SSAI) MODIS LDOPE January 18, 2007.
12/2/2015Fall 2002 AGU Meeting1 Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools Larry Klein, Ray Milburn, Cid Praderas and.
Facilitating Access to EOS Data at the NSIDC DAAC Siri Jodha Singh Khalsa ECS Science Coordinator for the National Snow and Ice Data Center, Distributed.
MODIS Snow and Sea Ice Data Products George Riggs SSAI Cryospheric Sciences Branch, NASA/GSFC Greenbelt, Md. Dorothy K.
1 HDF Vendors/Software Developers Workshop HDF And HDF-EOS Tools R.Suresh NASA/GSFC/HSTX Ph: FAX:
s Donna J. Scott, Marilyn Kaminski, Jason Wolfe, Terry Haran NSIDC's MODIS Snow and Sea Ice Products NSIDC provides a suite.
SWGData and Software Access - 1 UCB, Nov 15/16, 2006 THEMIS SCIENCE WORKING TEAM MEETING Data and Software Access Ken Bromund GST Inc., at NASA/GSFC.
Page 1 HDF-EOS Status, Related Tools and Issues Abe Taaheri, Raytheon IIS 2009 THG Briefing to ESDIS.
1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.
Vegetation Index Visualization of individual composite period. The tool provides a color coded grid display of the subset region. The tool provides time.
Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,
Comments from User Services C. Boquist/Code 423 The HDF Group Meeting 1 April 2009.
1 The Polar HDF-EOS Data Imaging and Subsetting (PHDIS) Tool Siri Jodha Singh Khalsa Emergent Information Technologies, Inc. National Snow and Ice Data.
Aura HDF-EOS File Format Guidelines: Overview and Status Cheryl Craig.
HDF-EOS Workshop IV September 19-21, 2000 Richard E. Ullman ESDIS Information Architect NASA/ GSFC, Code 423.
September 23-25, 2003HDF-EOS Workshop VII ECS-HSA the HEW Subsetting Appliance HDF-EOS Workshop VII Silver Spring, MD – September 23-25, 2003 Dr. Sara.
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
MODIS Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
MODIS Data at NSIDC MODIS Science Team Meeting - Nov. 2, 2006.
NASA HDF-EOS File Format Overview Joseph M Glassy, Director, MODIS Software Development at NTSG School of Forestry, Numerical Terradynamics Simulation.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
1 09/2003 Processing Library Update CF Checker – Script made available as a web based form on the BADC site -
September 11-12, 2012Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility New Browse Images Current Science Software.
AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.
Hierarchical Data Formats (HDF) Update
PoDAG XXII: MODIS Status
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF5 Performance Enhancements with the Elimination of Unlimited Dimension Debbie Mao, Daniel Ziskin, Merritt Deeter, Sara Martinez-alonso MOPITT is an.
Presentation transcript:

1 Status of HDF-EOS, Related Software and Tools

2 TOOLKIT / HDF-EOS Support

3 ECS Support of HDF-EOS

4 Downloadable Software

5 SDP Toolkit ( Science Data Processing Tools ) MTD Toolkit (Metadata, Time/ Date Tools ) HDF-EOS2 (HDF4 based) HDF-EOS5 (HDF5 based) heconvert (converts HDF4 - based Grid/Point/Swath structures to HDF-EOS 5 equivalents) DumpMetadata (Dump HDF-EOS metadata)

6 Downloadable Applications HEG (HDF-EOS2 to GeoTIFF conversion) HDFView Plug-in, Java-based browser (HDF4, HDF5, HDF-EOS 2 and 5 access) HE5View* (HDF5 - based browser) EOSView* (HDF4 - based browser) * Dropped support for OS updates on July 2006

7 Software/Tools

8 Toolkit Science Data Production (SDP) Toolkit : collection of tools used by - Science software developers who produce code to process instrument data. - HDF-EOS users who need to Access metadata in HDF-EOS files Perform Time/Date conversion Access Digital Elevation Model Data Access Ancillary Data, such as Digital Chart of the World database (DCW), Olson World Ecosystem files, DEM data files, etc.

9 Toolkit (cont.) Tools provided in SDP Toolkit: - AA(Ancillary Data Access) - CBP(CELESTIAL Body Position) - CSC(Coordinate System Conversion) - CUC(Constant and Unit Conversions) - DEM(Digital Elevation Model Access) - EPH(Ephemeris Data Access) - GCT(Geo Coordinate Transformation) - IO(Input Output (File I/O)) - MEM(Memory Management) - MET(Metadata Access) - PC(Process Control) - SMF(Status Message File (Error/Status)) - TD(Time and Date Conversion)

10 Toolkit (cont.) MTD Toolkit : – a short version of SDP Toolkit – Tools provided: MET(Metadata Access) TD(Time and Date Conversion) – Also supported in windows

11 HDF-EOS HDF-EOS: – an extension to HDF which standardizes storage of and access to common Earth Sciences data structures By providing a single interface to data structures common to earth science By providing a container for EOS inventory, archive and product specific metadata By establishing a consistent relationship between geolocation and science data.

12 HDF-EOS 2 HDF4 - based, storage format for EOS standard products. Used operationally by: – MODIS, MISR, ASTER, Landsat, AIRS – other EOS instruments Support for Grid/Point/Swath structures

13 HDF-EOS 5 HDF5 - based, a complete rewrite of HDF-EOS2 with a different user interface. Used operationally by EOS Aura instrument teams Designed to ‘resemble’ HDF-EOS 2 to the maximum extent possible. Supports same data structures (and more: Zonal average) Added prefix ‘HE5_’ to HDF-EOS 2 functions to distinguish two libraries

14 HDFView Plug-in HDFView: A Java-based browser from The HDF Group for HDF4 and HDF5 based data. HDF-EOS plug-in – Extends HDFView to browse HDF-EOS data in both versions. – Is a plug-in module and does not change The HDFView functionality – Have identical look and feel when displaying HDF and HDF-EOS objects – Users can access a complete breakdown of HDF-EOS objects. e.g. grid info, projection info, dims, datafields, and attributes

15 HEG

16

17 Software Releases SDP Toolkit/HDF-EOS : Last release – August 2010 – TOOLKIT – HDF-EOS 2.17, HDF- EOS with HDF4.2.5, HDF , Szip2.1, zlib1.2.5 Next release – (late 2010 – early 2011) – TOOLKIT ( with new 500m DEM data ) – HDF-EOS 2.18, HDF-EOS with new releases of HDF4 (2.6), 5 (1.8.6)

18 Software Releases MTD Toolkit: Last release – Dec 2006 – Version in-sync with SDP TOOLKIT with HDF4.2r0, HDF , Szip1.2 Next release – Oct 2010 – Version in-sync with SDP TOOLKIT with new releases of HDF4 (2.5), 5 (1.8.5)

19 HEG (HDF-EOS2 to GeoTIFF Converter): Last release – Dec 2009 – Version 2.10 – Patch release Jan 2010 Next release – Dec 2010 – Version 2.11 Software Releases

20 Software Releases HDF-EOS Plug-in for HDFView: Last release – Apr 2010 – For HDFView Version 2.6 Next release – Early 2011 – For HDFView Version 2.7 to be released – Version 2.6 plug-in works with HDFView 2.7

21 Software Releases HECONVERT ( HECONVERT (HDF-EOS2 to HDF-EOS5 Converter): Last releases – 2001, 2004 No Versioning, Oct Version 2.0 Next release – Nov Version 3.0 » Fix for some missing attributes in the converted file DumpMetadata DumpMetadata (ASCII Dump of HDF-EOS metadata) Last release – Dec Version 1.0

22 TOOLKIT: – XML metadata writing capability for inventory metadata in SDP toolkit ( release). Added XML style sheet to new TOOLKIT distribution for metadata display with Internet Explorer and other browsers – Fix for writing metadata into an HDF file when multiple HDF files are open – libiconv delivery in tar files for Mac and Cygwin – Fix for setting correct endianness flag in linux for eph tools (Fix is for MOPITT eph files reading) Recent Major Development/Fixes

23 HDF-EOS2: – Added Dimension scales for Swath and Grid Fix for: – Subsetting with GDdefboxregion results in an extra row and/or column in linux (round-off problem) – Inconsistency in dimensions between real dims and the values in the structure metadata – Problem on setting other compressions for swath and grid when disabling szip compression Recent Major Development/Fixes

24 – Segfault in creating swath when HDF files opened in read-only mode – Segfault in EHinquire function because of a VGroup with class "CDF0.0” – Segfault in GDapi (sincos redefinition problem) – Segfault in sample test grid subsetter – compinfo functions must return -1 only for errors (not for COMP_NONE) – GDrs2ll should fail for any projection other than BCEA Recent Major Development/Fixes

25 HDF-EOS5: – Added Dimension scales to Swath, Grid, and Zonal Average fields – Fix for problem in setting fillvalue; Fillvalue is only for the field defined right after setting fillvalue Recent Major Development/Fixes

26 HDF-EOS Plug-in for HDFView: – Support for all features in HDFView2.6 – Correction for displayed lat/lon in a swath around the international date line – Bug fix for HDF5 fillvalue and chunking info display – Bug fixes for saving HDF-EOS5 files after modification Recent Major Development/Fixes

27 HEG: Added Product Support: – AMSR-E Daily 25 Km Sea Ice AE_SI25 – AMSR-E Daily land AE_Land3 – MOD29E1D: MODIS/Terra Sea Ice Extent & IST Daily L3 Global 4km EASE-Grid Day, Version 4 – Tested many new products and updated the list of Hegable MODIS, ASTER, AIRS, MISR, and AMSR-E products in HEG Users Guide and HEG web site Recent Major Development/Fixes

28 Enhancement: – Added a new projection, Cylindrical Equa Area (CEA), to support AMSR-E Daily Land product. – Pixel resampling support for gridded data with No- Reprojection – Outputting all fields in a file to a single HDF-EOS output when HDF-EOS output is requested. – Setting of projection parameters for multiband geotiff only once in the GUI Recent Major Development/Fixes

29 Bug fixes: – Pixel size unit correction for consistency between conversion and stitch GUIs. – Problem resolution with several products MOD43C3, MOD10CM, MOD29P1N, AE_RnGd, AE_Rain – Correcting sphere radius written to outputs for MODIS SIN grids – Resolving problems with band selection in stitch GUI with occasional core dump (runs that take long time to complete) in Datapool HEGserver Recent Major Development/Fixes

30 Future Plans TOOLKIT/HDF-EOS: XML Metadata reading in TOOLKIT Support for new versions of HDF4 - HDF5 Update of DEM Tools for land-sea mask and new 500m DEM data Fix for getting correct compression info for a field in HDF-EOS5, when GDcompinfo/SWcompinfo fails to get the info from Structure metadata Support (or improvements) for 64-bit platforms Fix for Wrong values for some indices returned from SWindexinfo() in both hdfeos2 and hdfeos5

31 Future Plans Store info in structural metadata somewhere else Auto Configuration for TOOLKIT RPMs for HDF-EOS and Toolkit Validation tool for HDF-EOS5 files Fix for user/DAAC reported bugs

32 Future Plans (cont.) HDF-EOS Plug-in for HDFView: More functionalities : – Cut/paste objects, modify/delete attributes. – Create new grid/swath – Support Zonal Average object for HDF-EOS5 – Add World Coast Line map to HDFView Plug-inHEG: – Performance improvement for Lambert Azimuthal Projection conversion – Support HEG in MAC Intel – Resolve reported bugs or requests from DAACs/Users

33 Availability Access to libraries, applications, Documentation : TOOLKIT: HDFView: HEG: HDF-EOS: ( new look, sample codes + HDF-EOS Forum ) – –

34