2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information.

Slides:

Advertisements

Similar presentations

During spacecraft-level environmental testing, after all instruments were integrated, the government assembled a data clerk team to support test data collection.

Advertisements

NG-CHC Northern Gulf Coastal Hazards Collaboratory Simulation Experiment Integration Sandra Harper 1, Manil Maskey 1, Sara Graves 1, Sabin Basyal 1, Jian.

BEDI -Big Earth Data Initiative

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.

AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.

May 17, Capabilities Description of a Rapid Prototyping Capability for Earth-Sun System Sciences RPC Project Team Mississippi State University.

Reginald Lawrence Office of Systems Development

Inter-comparison of Lightning Trends from Ground-based Networks during Severe Weather: Applications toward GLM Lawrence D. Carey 1*, Chris J. Schultz 1,

Building a Framework for Data Preservation of Large-Scale Astronomical Data ADASS London, UK September 23-26, 2007 Jeffrey Kantor (LSST Corporation), Ray.

Introducing the CUAHSI Hydrologic Information System Desktop Application (HydroDesktop) and Open Development Community Jiří Kadlec, Daniel Ames, Teva Velupillai.

AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E.

Science Mission Directorate National Aeronautics and Space Administration transitioning unique NASA data and research technologies The SPoRT Center – Infusing.

User Services Experience GSFC DAAC MODIS Science Team Meeting Greenbelt, MD July 2002

Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.

Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.

AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.

U.S. Department of the Interior U.S. Geological Survey Integrated Data Management Network for LCCs and Partners: A Framework for Coordinated Data Discovery,

Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.

, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.

1 Richard Blakeslee / NASA Marshall Space Fight Center Larry Carey / University of Alabama in Huntsville Jeff Bailey / University of Alabama in Huntsville.

, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.

At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.

GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

Aquarius Project Status 7 th Aquarius/SAC-D Science Team Meeting 11 April 2012.

Presented at the GHRC User Working Group Meeting September 25-26, 2014 INFRASTRUCTURE At the GHRC DAAC Will Ellett IT Manager

BOE/Work Break Down The following slides provide a high level view of the BOE/WBS structure of the proposed NSIDC DAAC Contract.

IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.

The Namibia Flood Dashboard Satellite Acquisition and Data Availability through the Namibia Flood Dashboard Matt Handy NASA Goddard Space Flight Center.

Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.

GHRC User Working Group Meeting WELCOME September 25-26, 2014 Huntsville, AL 9/25/14 – 9/26/141User Working Group Meeting.

NASA SPoRT’s Pseudo Geostationary Lightning Mapper (PGLM) GOES-R Science Week Meeting September, 2011 Huntsville, Alabama Geoffrey Stano ENSCO, Inc./NASA.

Mr. Gopi Nair Defense Technical Information Center Briefing at Board on Research Data and Information (BRDI) Meeting September 24, 2009 Approved for Public.

1 Richard Blakeslee / NASA Marshall Space Fight Center Larry Carey / University of Alabama in Huntsville Jeff Bailey / University of Alabama in Huntsville.

NASA Use Cases for the Earth Observation Sensor Web Karen Moe NASA Earth Science Technology Office WGISS-26 Boulder,

RAINEX Data Management UCAR Joint Office for Science Support José Meitín Jim Moore Dick Dirks UCAR Joint Office for Science Support José Meitín Jim Moore.

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.

The GOES-R Series: The Nation’s Next-Generation Geostationary Weather Satellites Greg Mandt GOES-R System Program Director SOO-DOH National Meeting September.

AMSR-E SIPS Processing Status Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville

11th OMI Science Team Meeting De Bilt, June The Aura Validation Data Center Bojan R. Bojkov.

Evolving toward a Coherent, Collaborative Framework for Earth Science Data, Tools and Services Christopher Lynnes, Kwo-Sen Kuo and Kevin Murphy Earth Science.

GLM Val Tool Overview Monte Bateman. Introduction GLM is an optical instrument Closest analog is LIS Have several ground-based, 24x7 networks; all are.

Session 2: Improved Situational Awareness Sixth Meeting of the Science Advisory Committee 28 February – 1 March 2012 Future Activities National Space Science.

Transitioning research data to the operational weather community Overview of GOES-R Proving Ground Activities at the Short-term Prediction Research and.

Communications Plan: Ji Young Kim, Chul Han Song, Saewung Kim, and Jim Crawford.

Tools for Coordinating Aircraft During Hurricane Field Campaigns: Real Time Mission Monitor and Waypoint Planning Tool Richard Blakeslee / NASA Marshall.

HDF and HDF-EOS Workshop November 30, 2006 The Homogenization and Reporting of Groundbased Atmospheric Datasets for the Validation.

LANCE Processing at the AMSR-E SIPS Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville Joint.

GOES-R GLM Lightning-Aviation Applications GOES-R GLM instrument will provide unique total lightning data products on the location and intensity of thunderstorms.

GLM Annual Science Team Meeting Cal/Val Tools Developers Forum 9-11 September 2015 GLM PLT & Cal/Val Status William Koshak, NASA/MSFC.

End-to-End Data Services A Few Personal Thoughts Unidata Staff Meeting 2 September 2009.

Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.

DA Task Report Report by Rick Lawford and Toshio Koike ADC Meeting September 2008 Boulder.

SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.

Use of GPM GMI at the Joint Center for Satellite Data Assimilation.

ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.

Session 2 Conclusion: Future Product Development Activities Science Advisory Committee Meeting 26 – 28 August, 2014 National Space Science and Technology.

March 2004 At A Glance The AutoFDS provides a web- based interface to acquire, generate, and distribute products, using the GMSEC Reference Architecture.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

EVOLVING SENSOR WEB PROTOCOLS FOR SENSOR DATA MANAGEMENT H. Conover, K. Regner, M. Maskey, J. Lu, X. Li (UA-Huntsville) and H. Michael Goodman (NASA MSFC)

OLYMPEX DATA: GHRC Archival and Services for a Variety of Data Users

NASA HDF and HDF-EOS Status Use in EOSDIS

NASA Earth Science Data Stewardship

Microwave Radiometer Processing for Carbon in the Arctic Reservoirs Experiment (CARVE) Nick Steiner1 1 - Advanced Science Research Center, City University.

AmeriGEOSS Regional Initiative A framework that seeks to promote collaboration and coordination among the GEO Members of the American Continent Angelica.

User Preparation for new Satellite generations

Exploitation of ISS Scientific data - sustainability

Dev Test on Windows Azure Solution in a Box

CEOS WGISS Carbon Data Portal: Progress and Demo CEOS WGISS Carbon Portal Team Reported at WGISS’48 Vietnam Academy of Science and Technology, Hanoi,

Presentation transcript:

2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information Technology & Systems Center University of Alabama in Huntsville

Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal These tools and services will o Leverage GHRC skills and processes o Re-use GHRC developed software o Not be part of the GHRC core data center infrastructure 9/9-11/20152GLM Science Team Meeting Cal/Val Developer's Forum

Global Hydrology Resource Center NASA Distributed Active Archive Center (DAAC) providing data ingest, routine and custom processing, archive, distribution, user support, and science data services Collaboration between NASA and the University of Alabama in Huntsville to infuse advanced information technologies to a variety of science data projects Global lightning data from space, airborne and ground based observations from hurricane science field campaigns and Global Precipitation Mission (GPM) ground validation experiments, and satellite passive and active microwave products 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 3

Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal 9/9-11/20154GLM Science Team Meeting Cal/Val Developer's Forum

GOES-R Field Campaign Portal Collaboration Portal for planning and coordination o Project coordination docs (science plan, logistics, etc.) o Access to ancillary data and quicklooks during campaign o Mission science, project and instrument status reports Data Management o Science data product acquisition o Documentation and publication 9/9-11/20155GLM Science Team Meeting Cal/Val Developer's Forum

Current instrument status, weather forecasts, plan of the day Corporate knowledge (meeting minutes, presentations, etc.) Space to upload and share flight plans, mission reports and other documents Password protected for field campaign team access only Collaboration and Planning Tools 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 6

Mission information (mission objectives, science team, instrument characteristics, etc.) Near-real-time ground-based, satellite and/or aircraft data Forecasting resources Archive and distribution of all data products Field Catalog 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 7

Maps with instrument locations and base layers (state/county boundaries, roads, river networks) View current forecasts and ground-based, satellite and/or aircraft observations Data Visualization 9/9-11/2015GLM Science Team Meeting Cal/Val Developer's Forum 8

GOES-R Field Campaign Portal: Rough Timeline FY 2016 – Planning and preparation phase o Acquire and configure field campaign data server o Customize portal platform for GOES-R campaign o Develop preliminary metadata and documentation FY 2017 – Field phase o Test and refine portal o Set up near real time data feeds o Support reporting, data visualization, etc. during campaign FY 2018 – Data acquisition and documentation o Acquire quality controlled datasets from instrument teams; translate to standard format as needed o Work with science team to develop metadata and documentation, based on information developed for earlier datasets from the same instruments, if available o Provide data access and visualization services to public 9/9-11/20159GLM Science Team Meeting Cal/Val Developer's Forum

Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal 9/9-11/201510GLM Science Team Meeting Cal/Val Developer's Forum

GLM L0 Storage at MSFC 9/9-11/201511GLM Science Team Meeting Cal/Val Developer's Forum Ingest, store and provide access to Global Lightning Mapper Level-0 (GLM L0) data from the GOES-R satellite series NOAA’S GOES-R Level 0 Storage System (LZSS) o Access is strictly limited o Data are maintained in rolling storage for 2 years only Planned local GLM LZSS at MSFC o UAH personnel (shared with GHRC data center) will procure, configure and administer the storage system o GLM lightning team members will download data from the NOAA GOES-R LZSS to the local system

GLM LZSS at MSFC - Plan 9/9-11/201512GLM Science Team Meeting Cal/Val Developer's Forum Sun ZFS Storage ZS3-2 system, with Sun ZFS file system for advanced error detection and self- healing capabilities Procure initial system in FY2016 o Storage capacity 50 TB o Goal to have in place for DOE#4 (Data Operations Exercise), June 2016 o Ready to support GOES-R testing and initial operations by FY2017 Add expansion unit each year o Additional capacity 70 TB o Sized for data from two operational satellites (32 TB/year per GLM instrument)

Overview UAH will work with the GLM Science Team to provide data management for GLM Cal/Val activities o GOES-R Field Campaign Portal o GLM Level 0 Data Storage at MSFC o GLM Cal/Val Data Portal 9/9-11/201513GLM Science Team Meeting Cal/Val Developer's Forum

GLM Cal/Val Portal Core functions o Provide access to GLM Level 0, (Level 1?), Level 2 & reference data o Provide basic tools for data discovery and access o Host or provide pointers to GLM Cal/Val tools Audience o GLM Cal/Val community, not for public data access o Password protection for restricted data 9/9-11/201514GLM Science Team Meeting Cal/Val Developer's Forum

GLM Cal/Val Portal - Data Data held at MSFC: o GLM L0 on local LZSS o GLM L2 ? o TRMM LIS, ISS LIS, NA LMA and DC LMA publicly available from GHRC o NLDN, GLD360, ENTLN, WWLLN at GHRC for lightning team only What additional lightning data do we need to acquire? What other lightning data can we point to? ABI to compare with GLM? 9/9-11/201515GLM Science Team Meeting Cal/Val Developer's Forum

GLM Cal/Val Portal - Tools What discovery / access tools are needed? o Basic catalog for data and documents o Data access services (e.g., WMS, IDL or Python API) o Visualization tools (maps, graphs) What cal / val tools are needed? o Basic tools catalog o Tools to host on portal server Web-based For download o Tools to point to 9/9-11/201516GLM Science Team Meeting Cal/Val Developer's Forum

Discussion What else do you need in a Cal / Val portal? Helen Conover 9/9-11/201517GLM Science Team Meeting Cal/Val Developer's Forum