Presentation is loading. Please wait.

Presentation is loading. Please wait.

2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information.

Published byAustin Fox Modified over 8 years ago

Similar presentations

Presentation on theme: "2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information."— Presentation transcript:

1 2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information Technology & Systems Center University of Alabama in Huntsville hconover@itsc.uah.edu

2 Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal These tools and services will o Leverage GHRC skills and processes o Re-use GHRC developed software o Not be part of the GHRC core data center infrastructure 9/9-11/20152GLM Science Team Meeting Cal/Val Developer's Forum

3 Global Hydrology Resource Center NASA Distributed Active Archive Center (DAAC) providing data ingest, routine and custom processing, archive, distribution, user support, and science data services Collaboration between NASA and the University of Alabama in Huntsville to infuse advanced information technologies to a variety of science data projects Global lightning data from space, airborne and ground based observations from hurricane science field campaigns and Global Precipitation Mission (GPM) ground validation experiments, and satellite passive and active microwave products 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum http://ghrc.nsstc.nasa.gov/ 3

4 Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal 9/9-11/20154GLM Science Team Meeting Cal/Val Developer's Forum

5 GOES-R Field Campaign Portal Collaboration Portal for planning and coordination o Project coordination docs (science plan, logistics, etc.) o Access to ancillary data and quicklooks during campaign o Mission science, project and instrument status reports Data Management o Science data product acquisition o Documentation and publication 9/9-11/20155GLM Science Team Meeting Cal/Val Developer's Forum

6 Current instrument status, weather forecasts, plan of the day Corporate knowledge (meeting minutes, presentations, etc.) Space to upload and share flight plans, mission reports and other documents Password protected for field campaign team access only Collaboration and Planning Tools 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 6

7 Mission information (mission objectives, science team, instrument characteristics, etc.) Near-real-time ground-based, satellite and/or aircraft data Forecasting resources Archive and distribution of all data products Field Catalog 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 7

8 Maps with instrument locations and base layers (state/county boundaries, roads, river networks) View current forecasts and ground-based, satellite and/or aircraft observations Data Visualization 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 8

9 GOES-R Field Campaign Portal: Rough Timeline FY 2016 – Planning and preparation phase o Acquire and configure field campaign data server o Customize portal platform for GOES-R campaign o Develop preliminary metadata and documentation FY 2017 – Field phase o Test and refine portal o Set up near real time data feeds o Support reporting, data visualization, etc. during campaign FY 2018 – Data acquisition and documentation o Acquire quality controlled datasets from instrument teams; translate to standard format as needed o Work with science team to develop metadata and documentation, based on information developed for earlier datasets from the same instruments, if available o Provide data access and visualization services to public 9/9-11/20159GLM Science Team Meeting Cal/Val Developer's Forum

10 Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal 9/9-11/201510GLM Science Team Meeting Cal/Val Developer's Forum

11 GLM L0 Storage at MSFC 9/9-11/201511GLM Science Team Meeting Cal/Val Developer's Forum Ingest, store and provide access to Global Lightning Mapper Level-0 (GLM L0) data from the GOES-R satellite series NOAA’S GOES-R Level 0 Storage System (LZSS) o Access is strictly limited o Data are maintained in rolling storage for 2 years only Planned local GLM LZSS at MSFC o UAH personnel (shared with GHRC data center) will procure, configure and administer the storage system o GLM lightning team members will download data from the NOAA GOES-R LZSS to the local system

12 GLM LZSS at MSFC - Plan 9/9-11/201512GLM Science Team Meeting Cal/Val Developer's Forum Sun ZFS Storage ZS3-2 system, with Sun ZFS file system for advanced error detection and self- healing capabilities Procure initial system in FY2016 o Storage capacity 50 TB o Goal to have in place for DOE#4 (Data Operations Exercise), June 2016 o Ready to support GOES-R testing and initial operations by FY2017 Add expansion unit each year o Additional capacity 70 TB o Sized for data from two operational satellites (32 TB/year per GLM instrument)

13 Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal 9/9-11/201513GLM Science Team Meeting Cal/Val Developer's Forum

14 GLM Cal/Val Portal Core functions o Provide access to GLM Level 0, (Level 1?), Level 2 & reference data o Provide basic tools for data discovery and access o Host or provide pointers to GLM Cal/Val tools Audience o GLM Cal/Val community, not for public data access o Password protection for restricted data 9/9-11/201514GLM Science Team Meeting Cal/Val Developer's Forum

15 GLM Cal/Val Portal - Data Data held at MSFC: o GLM L0 on local LZSS o GLM L2 ? o TRMM LIS, ISS LIS, NA LMA and DC LMA publicly available from GHRC o NLDN, GLD360, ENTLN, WWLLN at GHRC for lightning team only What additional lightning data do we need to acquire? What other lightning data can we point to? ABI to compare with GLM? 9/9-11/201515GLM Science Team Meeting Cal/Val Developer's Forum

16 GLM Cal/Val Portal - Tools What discovery / access tools are needed? o Basic catalog for data and documents o Data access services (e.g., WMS, IDL or Python API) o Visualization tools (maps, graphs) What cal / val tools are needed? o Basic tools catalog o Tools to host on portal server Web-based For download o Tools to point to 9/9-11/201516GLM Science Team Meeting Cal/Val Developer's Forum

17 Discussion What else do you need in a Cal / Val portal? Helen Conover hconover@itsc.uah.edu 9/9-11/201517GLM Science Team Meeting Cal/Val Developer's Forum

Download ppt "2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information."

Similar presentations

During spacecraft-level environmental testing, after all instruments were integrated, the government assembled a data clerk team to support test data collection.

During spacecraft-level environmental testing, after all instruments were integrated, the government assembled a data clerk team to support test data collection.
NG-CHC Northern Gulf Coastal Hazards Collaboratory Simulation Experiment Integration Sandra Harper 1, Manil Maskey 1, Sara Graves 1, Sabin Basyal 1, Jian.

NG-CHC Northern Gulf Coastal Hazards Collaboratory Simulation Experiment Integration Sandra Harper 1, Manil Maskey 1, Sara Graves 1, Sabin Basyal 1, Jian.
BEDI -Big Earth Data Initiative

BEDI -Big Earth Data Initiative
Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.
AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.

AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.
May 17, 2006 1 Capabilities Description of a Rapid Prototyping Capability for Earth-Sun System Sciences RPC Project Team Mississippi State University.

May 17, Capabilities Description of a Rapid Prototyping Capability for Earth-Sun System Sciences RPC Project Team Mississippi State University.
Reginald Lawrence Office of Systems Development

Reginald Lawrence Office of Systems Development
Inter-comparison of Lightning Trends from Ground-based Networks during Severe Weather: Applications toward GLM Lawrence D. Carey 1*, Chris J. Schultz 1,

Inter-comparison of Lightning Trends from Ground-based Networks during Severe Weather: Applications toward GLM Lawrence D. Carey 1*, Chris J. Schultz 1,
Building a Framework for Data Preservation of Large-Scale Astronomical Data ADASS London, UK September 23-26, 2007 Jeffrey Kantor (LSST Corporation), Ray.

Building a Framework for Data Preservation of Large-Scale Astronomical Data ADASS London, UK September 23-26, 2007 Jeffrey Kantor (LSST Corporation), Ray.
Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.

Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.
AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E.

AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E.
Science Mission Directorate National Aeronautics and Space Administration transitioning unique NASA data and research technologies The SPoRT Center – Infusing.

Science Mission Directorate National Aeronautics and Space Administration transitioning unique NASA data and research technologies The SPoRT Center – Infusing.
User Services Experience GSFC DAAC MODIS Science Team Meeting Greenbelt, MD July 2002

User Services Experience GSFC DAAC MODIS Science Team Meeting Greenbelt, MD July 2002
Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.

Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.
Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.

Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.

AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
U.S. Department of the Interior U.S. Geological Survey Integrated Data Management Network for LCCs and Partners: A Framework for Coordinated Data Discovery,

U.S. Department of the Interior U.S. Geological Survey Integrated Data Management Network for LCCs and Partners: A Framework for Coordinated Data Discovery,
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.

Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.

, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.
1 Richard Blakeslee / NASA Marshall Space Fight Center Larry Carey / University of Alabama in Huntsville Jeff Bailey / University of Alabama in Huntsville.

1 Richard Blakeslee / NASA Marshall Space Fight Center Larry Carey / University of Alabama in Huntsville Jeff Bailey / University of Alabama in Huntsville.

Similar presentations

Ads by Google