HDF5 Tools Updates and Discussions

Slides:

Advertisements

Similar presentations

The HDF Group Ensuring Long Term Access to Remotely Sensed HDF4 Data with Layout Maps Ruth Duerr, NSIDC Christopher Lynnes, GES DISC Mike.

Advertisements

The HDF Group July 8, Summer ESIP Federation Meeting How to Meet the CF Conventions with NcML for NASA HDF/HDF-EOS Hyo-Kyung.

The HDF Group July 8, Summer ESIP Federation Meeting / HDF and HDF-EOS Workshop XVII Adding new services for HDF in THREDDS Data.

The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal The HDF Group HDF/HDF-EOS Workshop XIV September 30, 2010.

HDF and HDF-EOS Workshop VII, September 23-25, This work is supported in part by a Cooperative Agreement with the National Aeronautics and Space.

The HDF Group HDF/HDF-EOS Workshop XIV1 Easy Remote Access via OPeNDAP Kent Yang and Joe Lee The HDF Group The 14 th HDF/HDF-EOS Workshop.

The HDF Group November 3-5, 2009HDF/HDF-EOS Workshop XIII1 HDF-Java Products Peter Cao The HDF Group The 13 th HDF and HDF-EOS Workshop.

The HDF Group HDF Group Support for NPP/JPSS Mike Folk, Elena Pourmal, Larry Knox, Albert Cheng The HDF Group Briefing to ESDIS October.

The HDF Group HDF Group Support for NPP/JPSS Mike Folk, Elena Pourmal, Larry Knox, Albert Cheng The HDF Group The 15 th HDF and HDF-EOS.

The HDF Group November 3-5, 2009HDF/HDF-EOS Workshop XIII1 Using visualization tools to access HDF data via OPeNDAP Joe Lee and Kent Yang.

The HDF Group ESIP Summer Meeting HDF-Java Overview Joel Plutchak The HDF Group 1 July 8 – 11, 2014.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.)

The HDF Group HDF4 Mapping Status and Proposal Mike Folk, Ruth Aydt The HDF Group Oct. 17, 2012 Apr , 2012HDF/HDF-EOS Workshop XV.

The HDF Group Apr , 2012HDF/HDF-EOS Workshop XV1 Interoperability with netCDF-4 Kent Yang, Larry Knox, Elena Pourmal The HDF Group.

Improving long-term preservation of EOS data by independently mapping HDF4 data objects The HDF Group.

The HDF Group HDF/HDF-EOS Workshop XIV1 Easy Access of NASA HDF data via OPeNDAP Kent Yang and Joe Lee The HDF Group September 28,2010.

The HDF Group July 8, 2014HDF 2014 ESIP Summer Meeting HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann The.

Ensuring Long Term Access to Remotely Sensed HDF4 Data with Layout Maps Mike Folks, The HDF Group Ruth Duerr, NSIDC 1.

Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group June 30, NPOESS Data Formats Working Group.

HDF5 Tools Update Peter Cao - The HDF Group November 6, 2007 This report is based upon work supported in part by a Cooperative Agreement.

Experiments with Remote Access to Scientific Data using HDF5 Kun Yan Robert E. McGrath NCSA May 15, 2002.

EOSDIS User survey follow-up Mike Folk, Kent Yang, Elena Pourmal The HDF Group Oct. 17, 2012 Annual HDF Briefing to ESDIS1.

HDF Windows Support MuQun Yang, Xuan Bai, Elena Pourmal, Barbara Jones, Pedro Vincent, Robert E. McGrath National Center for Supercomputing Applications.

HDF Project Update Mike Folk, Kent Yang, Elena Pourmal The HDF Group April 5, 2010 April 5, 2011Annual HDF Briefing to ESDIS1.

NASA EOS DATA COMPRESSION WITH HDF5 SCALEOFFSET FILTER This work was funded by the NASA Earth Science Technology Office under NASA award AIST and.

Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.

DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.

Improving the usability of HDF-EOS2 data Kent Yang, Joe Lee, Choonghwan Lee The HDF Group March 31 st, /26/2016Annual briefing to ESDIS1.

HDF Converting between HDF4 and HDF5 MuQun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University of Illinois,

Tools for Interoperability between HDF and NetCDF Mike Folk and MuQun Yang The HDF Group The HDF Group provides the following tools for the NASA HDF and.

The HDF Group HDF5 Tools Updates Peter Cao, The HDF Group September 28-30, 20101HDF and HDF-EOS Workshop XIV.

HDF Dimension Scales in HDF5 HDF-EOS Workshop IX San Francisco, CA November 30 - December 2, 2005 Pedro Vicente Nunes THG/NCSA Champaign-Urbana, IL HDF.

Support for NPP/NPOESS by The HDF Group Mike Folk The HDF Group HDF and HDF-EOS Workshop XII October 17, 2008 Oct HDF and HDF-EOS Workshop XII1.

11/7/2007HDF and HDF-EOS Workshop XI, Landover, MD1 HDF5 Software Process MuQun Yang, Quincey Koziol, Elena Pourmal The HDF Group.

The HDF Group November 3-5, 2009 HDF-OPeNDAP Project Update HDF/HDF-EOS Workshop XIII1 Joe Lee and Kent Yang The HDF Group James Gallagher.

Ensuring Long Term Access to Remotely Sensed HDF4 Data with Layout Maps Ruth Duerr, NSIDC Christopher Lynnes, GES DISC The HDF Group Oct HDF and.

October 15, 2008HDF and HDF-EOS Workshop XII1 What will be new in HDF5?

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII10/17/2008.

Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.

HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications This work is supported in part by a.

1 N-bit and ScaleOffset filters MuQun Yang National Center for Supercomputing Applications University of Illinois at Urbana-Champaign Urbana, IL

HDF OPeNDAP Project Update MuQun Yang and Hyo-Kyung Lee The HDF Group March 31, Annual briefing to ESDIS10/31/2015.

The HDF Group HDF/HDF-EOS Workshop XV1 Tools to Improve the Usability of NASA HDF Data Kent Yang and Joe Lee The HDF Group April 17, 2012.

- 1 - HDF5, HDF-EOS and Geospatial Data Archives HDF and HDF-EOS Workshop VII September 24, 2003.

The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group November 5, 2009 November 3-5,

DM_PPT_NP_v01 SESIP_0715_JR HDF Server HDF for the Web John Readey The HDF Group Champaign Illinois USA.

HDF Windows Support MuQun Yang, Xuan Bai, Elena Pourmal, Barbara Jones, Pedro Vincent, Robert E. McGrath National Center for Supercomputing Applications.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1 HDF and HDF-EOS Workshop XII10/17/2008.

Using a Friendly OPeNDAP Client Library to Access HDF5 Data MuQun Yang and Hyo-Kyung Lee (The HDF Group) 1 25th IIPS Conference01/14/2009.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII, Aurora,

September 9, 2008SPEEDUP Workshop - HDF5 Tutorial1 Introduction to HDF5 Command-line Tools.

HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications Ray Milnurn, Dave Buto, L-3 Communications.

HDF and HDF-EOS Workshop VII September 24, 2003 HDF5, HDF-EOS and Geospatial Data Archives Don Keefer Illinois State Geological Survey Mike Folk Univ.

The HDF Group HDF Group Support for NPP/JPSS Mike Folk, Elena Pourmal, Larry Knox, Albert Cheng The HDF Group DEWG Meeting June 19, 2012.

10/16/2012Annual HDF briefing1 HDF OPeNDAP support Kent Yang, Joe Lee, Mike Folk The HDF Group Oct. 16, 2012.

The HDF Group 10/17/151 HDF5 Tools Tutorial ICALEPCS 2015.

The HDF Group New Elements and Lessons Learned for New Mission HDF5 Products Ideas for new mission HDF5 data products 1July 8, 2013 Larry.

11/8/2007HDF and HDF-EOS Workshop XI, Landover, MD1 Software to access HDF5 Datasets via OPeNDAP MuQun Yang, Hyo-Kyung Lee The HDF Group.

October 15-17, 2008HDF and HDF-EOS Workshop XII1 HDF-Java Products Peter Cao The HDF Group HDF and HDF-EOS Workshop XII October 15, 2008.

The HDF Group November 3-5, 2009HDF/HDF-EOS Workshop XIII1 The New HDF-EOS Web Site - How it can help you Kent Yang, Joe Lee The HDF Group.

Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal The HDF Group Annual HDF Briefing to ESDIS March 31, 2009 March Annual HDF Briefing.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII, Aurora,

HDF and HDF-EOS Workshop XII

Adding CF Attributes to an HDF5 File

Elena Pourmal The HDF Group

Hierarchical Data Formats (HDF) Update

Kent Yang, Mike Folk The HDF Group March 31, 2009

Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)

HDF Support for NASA Data Producers

Peter Cao The HDF Group November 28, 2006

Presentation transcript:

HDF5 Tools Updates and Discussions Peter Cao The HDF Group The 15th HDF and HDF-EOS Workshop April 17-19, 2012 Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Tools Updates Keep YOU updated Report YOUR feedback on the survey Want to know YOUR needs and thoughts Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF Java Products Highlights HDF-Java 2.8 (Dec. 2011) Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF Java Products Highlights 35 bug fixes/enhancements Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF Java Products Highlights All major HDF5 1.8 API functions Java 369 462 C functions V1.8 169 Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF Java Products Highlights Unit tests for all major HDF5 JNI functions Tested 300 Untested 69 Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Things in the Pipeline HDF-Java 2.9 (Dec. 2012) Build on HDF5 1.8.10 Add Cmake Continue bug fixes/enhancements Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Mac Issues Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Mac Issues No Support for MAC OS 10.5 Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Mac Issues Drop 32-bit Support ? Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Command-line Tools Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Major Improvements h5dump Fixed “-a” option to show attributes with name containing “/” h5dump -a "/bar_none/high\/low" quux.h5 Added support for using a wildcard in the filename OMI-Aura_L2G-OMAEROG_2004m1001_v003-2009m0112t161650.he5 OMI-Aura_L2G-OMAEROG_2004m1007_v003-2009m0112t161622.he5 OMI-Aura_L2G-OMAEROG_2004m1009_v003-2009m0112t161705.he5 h5dump *7_*.he5 Completed a major code refactoring Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Major Improvements h5repack Selecting data based on chunk layout Better performance (hundred times faster for some cases) Consider storage layout, smart Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Major Improvements h5diff Added –v1 and –v2 options to show different levels of information Added a new flag --exclude-path to exclude objects from comparison Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Tools Challenges Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Tools Challenges Comp of Vlen of Comp of ARRAY of Comp Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Tools Challenges Simple Design External links Compact layout Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Tools Challenges CMMI Team Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV New Development h5edit Command-line tool for editing an HDF5 file Create or Delete Attributes Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV New Development H5Ocompare API A function that compares two HDF5 objects or files RFC will be out in April or May 2012 An independent tool, h5compare, may follow after the API development Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV New Development h5augjpss a tool for modifying a JPSS product file to make it accessible by netCDF-4 based applications Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV HDF5-XML Tools HDF5 h5dump h5x xh5 old xml XLST xml HDF5/ XML Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV HDFView User Survey Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV surveymonkey.com HDFView Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Usage Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV File Types Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Easy Installation Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Easy-use GUI Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Wishful Things Over 70% users who responded to the survey think the following are important: Improve GUI interface Find objects by name Search objects by attributes (name or value) Search and query data content View datasets larger than machine memory Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Your Thoughts Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV A Wishful Thought HDF5 Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV A Wishful Thought My Favorite Things Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV A Wishful Thought My Favorite Things Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV A Wishful Thought My Favorite Things Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV

HDF/HDF-EOS Workshop XV Acknowledgements This work was supported by Subcontract number 114820 under Raytheon Contract number NNG10HP02C, funded by the National Aeronautics and Space Administration (NASA) and by cooperative agreement number NNX08AO77A from the NASA. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of Raytheon or the National Aeronautics and Space Administration. Apr. 17-19, 2012 HDF/HDF-EOS Workshop XV