Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

MS698: Implementing an Ocean Model Benchmark tests. Dealing with big data files. – (specifically big NetCDF files). Signell paper. Activity: – nctoolbox.

Office of Coast Survey NOS Coastal and Surge Modeling 2011 NCEP Production Suite Review Jesse C. Feyen Coast Survey Development Laboratory.

Crossing the Digital Divide

US IOOS Coastal and Ocean Modeling Testbed: Roundup and Progress Becky Baltes COMT Project Manager April 14, 2015.

Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.

Collaboration Tools and Techniques for ROMS Rich Signell,USGS Woods Hole, MA.

A Distributed Approach to Ocean, Atmosphere & Climate Model Data Interoperability Rich Signell USGS Woods Hole, MA COAWST Training Workshop Woods Hole,

U.S./European Partnerships in Coastal Atlases and Coastal/Ocean Informatics Coastal Zone 2007 – Portland, Oregon National Coastal Zone Management Community.

Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Unidata TDS Workshop THREDDS Data Server Overview October 2014.

Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.

ISO-2 and more NGDC Geoportal January 4 th, 2012.

Coast Survey Development Laboratory National Ocean Service, NOAA Mary Erickson March 2011.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Don Wright, SURA Principal.

Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Stefano Nativi, Ben Domenico OGC Technical Meeting – Met/Occean.

AdcircLite-NC Rapid computation of storm surge and waves for NC coastal waters Jesse Bikman 1, Brian Blanton 2, Alexander Taflandis 3, Andrew Kennedy 3.

Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.

Observing System Monitoring Center Integrating data and information across observing system networks.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.

U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.

Gulf of Maine / Scituate Harbor - Extratropical Domain Shelf Hypoxia ChesROMS Long & Hood UMCES Estuarine Hypoxia Inundation Cyber Infrastructure IOOS.

Super-Regional Modeling Testbed to Improve Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Super-Regional Modeling.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Don Wright, SURA Principal.

Super-Regional Modeling Testbed to Improve Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Wright, L.D.; Signell,

Cyberinfrastructure - Collaborative Portal for the IOOS Super-Regional Modeling Testbed Sara Graves, Manil Maskey, Ken Keiser Information Technology &

Glider data (*.*bd files) via Iridium or rsync from WHOI, Umaine or UMaryland Disk NetCDF/Acquire WMO ID IOOS Glider DAC ERDDAP OPeNDAP sequence or download.geoJson,.json.nc,.ncCF,.ncCFMA.csv,.tsv,

Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

Architecture Renovation Yoshiyuki Kudo (JAXA) WGISS-37.

DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.

Unidata and Oceanography Through the Ages Rich Signell USGS Coastal and Marine Science Center Woods Hole, MA & NOAA Integrated Ocean Observing System (IOOS)

IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF)

Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.

OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative External Observatory Integration Christopher Mueller, Matt Arrott, John Graybeal Life Cycle.

NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)

IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.

1 HYCOM Data Service HYCOM Data Service An overview Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL)

IOOS Coastal Ocean Modeling Testbed (COMT) Cyberinfrastructure Oceans 12 Becky Baltes, IOOS Liz Smith, SURA Rich Signell, USGS Eoin Howlett, Kyle Wilcox,

Unidata TDS Workshop THREDDS Data Server Overview

1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.

U.S. Integrated Ocean Observing System (IOOS ® ) IOOS ® Biological Observations Data Project A Multi-Agency Effort to Enable Access to Biological Observations.

IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.

UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.

1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe

Improving Data Catalogs with Free and Open Source Software Kevin O’Brien University of Washington Joint Institute for the Study of the Atmosphere and Ocean.

The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,

Collaborative Portal for the IOOS Super-Regional Modeling Testbed Sara Graves, Manil Maskey, Ken Keiser Information Technology & Systems Center University.

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

Catalog-driven workflows using CSW Rich Signell, USGS, Woods Hole, MA, USA Filipe Fernandes, SECOORA, Brazil Kyle Wilcox, Axiom Data Science, Wickford,

Ocean Observatories Initiative Serving Ocean Model Data on the Cloud M. Meisinger, C. Farcas, E. Farcas, C. Alexander, M. Arrott, J. de La Beaujardière,

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.

The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.

Rich Signell Roland Viger Curtis Price USGS Community for Data Integration Feb 15, 2012.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.

Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.

Update on Unidata Technologies for Data Access Russ Rew

Unidata Infrastructure for Data Services Russ Rew GO-ESSP Workshop, LLNL

24 January th Symposium on the Coastal Environment 92 nd Annual American Meteorological Society Meeting U.S. IOOS Coastal Ocean Modeling Testbed.

U.S. IOOS Coastal Ocean Modeling Testbed

Presentation transcript:

Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods Hole, MA Alex Crosby (Applied Science Associates), S.Kingston, RI Kyle Wilcox (Applied Science Associates), S.Kingston, RI Rich Signell (USGS), Woods Hole, MA Alex Crosby (Applied Science Associates), S.Kingston, RI Kyle Wilcox (Applied Science Associates), S.Kingston, RI ECM12: November 8, 2011

US Integrated Ocean Observing System (IOOS ® ) IOOS ® Plan defines: IOOS ® Plan defines: Global ComponentGlobal Component Coastal ComponentCoastal Component  17 Federal Agencies  11 Regional Associations

A Simple NetCDF File

A CF-Compliant NetCDF File

Unidata’s Common Data Model

Data Interoperability Model

14 Different Ocean Forecast Models Spanning CONUS Waters in IDV

Models used in DeepWater Horizon Spill

IOOS Modeling Testbed

1.Build a common infrastructure for access, analysis and visualization of all ocean model data produced by the Federal Backbone and the IOOS Regions. 2.Develop skill metrics and assess models in different regions and dynamical regimes 3.Transition models, tools, toolkits and other capabilities to federal operational facilities 4.Build stronger relationships between academia and operational centers through collaboration (improve R2O & O2R) 1.Build a common infrastructure for access, analysis and visualization of all ocean model data produced by the Federal Backbone and the IOOS Regions. 2.Develop skill metrics and assess models in different regions and dynamical regimes 3.Transition models, tools, toolkits and other capabilities to federal operational facilities 4.Build stronger relationships between academia and operational centers through collaboration (improve R2O & O2R) IOOS Modeling Testbed Goals

Data Interoperability Model

Matlab: NCTOOLBOX ArcGIS 10.0 NcISO Metadata Service GI-CAT

NCTOOLBOX on Google Code

Installing NCTOOLBOX

THREDDS Data Server dataset page

Subset Bathymetry with nj_subsetGrid

Geographic subsetting & striding

FVCOM Forecast Surface Temperature

Reading Unstructured Grid Data

Buoy_comp.m: Model/Data comparison of wave height

Virtual Glider Function from Toolbox

Isosurface Plot

Accessing Global RTOFS

Single Point of Access Catalog: GEO-IDE => IOOS Regions GEO-IDE Web Site:

THREDDS Data Server dataset page

Federated Search Model GI-CAT Geoportal Server Broker ServersClients THREDDS OGC-CSW THREDDS OGC-WCS OpenSearch OGC-CSW ISO Common Metadata Model Database

Accessing NAVO Fukushima Data

Example of full power of OpenSearch

30 year hindcast/data comparison

OPeNDAP Access via Python in ArcGIS10

Real benefits of Geoinformatics More usage of model results for science More feedback to modelers => Improved models More efficient retrieval of data => More time to do science More usage of model results for science More feedback to modelers => Improved models More efficient retrieval of data => More time to do science

Opportunities for modelers (1/2) Join the IOOS Model Data Interoperability Google Group: ata_interop Join the Unstructured Grid Interoperability Google Group: interoperability Join the IOOS Model Data Interoperability Google Group: ata_interop Join the Unstructured Grid Interoperability Google Group: interoperability

Opportunities for modelers (2/2) Try out the Matlab NCTOOLBOX to access CF- compliant model output: Give us feedback! Suggest more functionality! Toolbox is under active development ECM12 Signell Presentation Extra Info and Links: Try out the Matlab NCTOOLBOX to access CF- compliant model output: Give us feedback! Suggest more functionality! Toolbox is under active development ECM12 Signell Presentation Extra Info and Links: