AeroStat: Online Platform for the Statistical Intercomparison of Aerosols Gregory Leptoukh, NASA/GSFC (P.I.) Chris Lynnes, NASA/GSFC (Acting P.I.) Peter.

Slides:

Advertisements

Similar presentations

Product Quality and Documentation – Recent Developments H. K. Ramapriyan Assistant Project Manager ESDIS Project, Code 423, NASA GFSC

Advertisements

Earth Science Data: Why So Chris Lynnes.

What’s new in MODIS Collection 6 Aerosol Deep Blue Products? N. Christina Hsu, Rick Hansell, MJ Jeong, Jingfeng Huang, and Jeremy Warner Photo taken from.

Experiences Developing a User-centric Presentation of Provenance for a Web- based Science Data Analysis Tool Stephan Zednik 1, Gregory Leptoukh 2, Peter.

Gregory Leptoukh, David Lary, Suhung Shen, Christopher Lynnes What’s in a day?

Data Quality Screening Service Christopher Lynnes, Bruce Vollmer, Richard Strub, Thomas Hearty Goddard Earth Sciences Data and Information Sciences Center.

Global Climatology of Fine Particulate Matter Concentrations Estimated from Remote-Sensed Aerosol Optical Depth Aaron van Donkelaar 1, Randall Martin 1,2,

Data Quality Screening Service Christopher Lynnes, Richard Strub, Thomas Hearty, Bruce Vollmer Goddard Earth Sciences Data and Information Sciences Center.

2. Point Cloud x, y, z, … Complete LiDAR Workflow 1. Survey 4. Analyze / “Do Science” 3. Interpolate / Grid USGS Coastal & Marine.

Evaluating Remote Sensing Data Or How to Avoid Making Great Discoveries by Misinterpreting Data Richard Kleidman ARSET-AQ Applied Remote Sensing Education.

Satellite Imagery ARSET Applied Remote SEnsing Training A project of NASA Applied Sciences Introduction to Remote Sensing and Air Quality Applications.

1 Satellite Remote Sensing of Particulate Matter Air Quality ARSET Applied Remote Sensing Education and Training A project of NASA Applied Sciences Pawan.

IDEA - Infusing satellite Data into Environmental (air quality) Applications Summer 2003: Prototype Analysis, Fusion, and Visualization of NASA ESE and.

Aircraft spiral on July 20, 2011 at 14 UTC Validation of GOES-R ABI Surface PM2.5 Concentrations using AIRNOW and Aircraft Data Shobha Kondragunta (NOAA),

Visualization, Exploration, and Model Comparison of NASA Air Quality Remote Sensing data via Giovanni Ana I. Prados, Gregory Leptoukh, Arun Gopalan, and.

Application of Satellite Data to Particulate, Smoke and Dust Monitoring Spring 2015 ARSET - AQ Applied Remote Sensing Education and Training – Air Quality.

Experiences Developing a Semantic Representation of Product Quality, Bias, and Uncertainty for a Satellite Data Product Patrick West 1, Gregory Leptoukh.

AeroStat: Online Platform for the Statistical Intercomparison of Aerosols Gregory Leptoukh, NASA/GSFC (P.I.) Christopher Lynnes, NASA/GSFC (Co-I.) Robert.

, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

VALIDATION OF SUOMI NPP/VIIRS OPERATIONAL AEROSOL PRODUCTS THROUGH MULTI-SENSOR INTERCOMPARISONS Huang, J. I. Laszlo, S. Kondragunta,

Satellite Cross comparisonMorisette 1 Satellite LAI Cross Comparison Jeff Morisette, Jeff Privette – MODLAND Validation Eric Vermote – MODIS Surface Reflectance.

Giovanni for AQ Gregory Leptoukh NASA Goddard Space Flight Center Goddard Earth Sciences Data and Information Services Center (GES DISC)

Student Collection, Reporting, and Analysis of GLOBE Data Sandra Henderson, Chief Educator GLOBE Ed Geary, DLESE Community Services and GLOBE University.

1 AOD to PM2.5 to AQC – An excel sheet exercise ARSET Applied Remote Sensing Education and Training A project of NASA Applied Sciences Pawan Gupta Salt.

MODIS Sea-Surface Temperatures for GHRSST-PP Robert H. Evans & Peter J. Minnett Otis Brown, Erica Key, Goshka Szczodrak, Kay Kilpatrick, Warner Baringer,

A Data Quality Screening Service for Remote Sensing Data Christopher Lynnes, NASA/GSFC Edward Olsen, NASA/JPL Peter Fox, RPI Bruce Vollmer, NASA/GSFC Robert.

8th IOCCG Meeting in Florence, Italy (24-26 Feb 03) Current Status of MODIS (Terra and Aqua) by Chuck Trees for the MODIS Team Members.

Options for access to multi- source fire data John Owens Department of Geography University of Maryland.

1 CERES Results Norman Loeb and the CERES Science Team NASA Langley Research Center, Hampton, VA Reception NASA GSFC, Greenbelt, MD.

Collection 6 update: MODIS ‘Deep Blue’ aerosol Andrew M. Sayer, N. Christina Hsu, Corey Bettenhausen, Myeong-Jae Jeong, Jaehwa Lee.

MAPSS and AeroStat: integrated analysis of aerosol measurements using Level 2 Data and Point Data in Giovanni Maksym Petrenko Charles Ichoku (with the.

ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.

Variational Assimilation of MODIS AOD using GSI and WRF/Chem Zhiquan Liu NCAR/NESL/MMM Quanhua (Mark) Liu (JCSDA), Hui-Chuan Lin (NCAR),

Satellite observations of AOD and fires for Air Quality applications Edward Hyer Naval Research Laboratory AQAST June, Madison, Wisconsin 15 June.

1 Satellite Remote Sensing of Particulate Matter Air Quality ARSET Applied Remote SEnsing Training A project of NASA Applied Sciences Pawan Gupta Satellite.

QA filtering of individual pixels to enable a more accurate validation of aerosol products Maksym Petrenko Presented at MODIS Collection 7 and beyond Retreat.

NASA Earth Observing System Visualization Tools ARSET - AQ Applied Remote SEnsing Training – Air Quality A project of NASA Applied Sciences Introduction.

Provenance in Earth Science Gregory Leptoukh NASA GSFC.

As components of the GOES-R ABI Air Quality products, a multi-channel algorithm similar to MODIS/VIIRS for NOAA’s next generation geostationary satellite.

Federated Space-Time Query for Earth Science Data Using OpenSearch Conventions ESIP Federated Search Cluster Chris Lynnes Bruce Beaumont Ruth Duerr Hook.

Satellite Aerosol Validation Pawan Gupta NASA ARSET- AQ – GEPD & SESARM, Atlanta, GA September 1-3, 2015.

Ambiguity of Quality in Remote Sensing Data Christopher Lynnes, NASA/GSFC Greg Leptoukh, NASA/GSFC Funded by : NASA’s Advancing Collaborative Connections.

Characterization of Aerosol Data Quality from MODIS for Coastal Regions Jacob Anderson Mentor: Gregory Leptoukh.

Improving MISR-retrieved Aerosol Properties Using GOCART Simulations Yang Liu, PhD June 3, 2015 St. Louis, MO.

Experiences Developing a Semantic Representation of Product Quality, Bias, and Uncertainty for a Satellite Data Product Patrick West 1, Gregory Leptoukh.

Matt Rodell NASA GSFC Multi-Sensor Snow Data Assimilation Matt Rodell 1, Zhong-Liang Yang 2, Ben Zaitchik 3, Ed Kim 1, and Rolf Reichle 1 1 NASA Goddard.

Initial Analysis of the Pixel-Level Uncertainties in Global MODIS Cloud Optical Thickness and Effective Particle Size Retrievals Steven Platnick 1, Robert.

Aerosol Radiative Forcing from combined MODIS and CERES measurements

GEWEX Aerosol Assessment Panel members Sundar Christopher, Rich Ferrare, Paul Ginoux, Stefan Kinne, Jeff Reid, Paul Stackhouse Program Lead : Hal Maring,

Kamel Didan 12*, Armando Barreto 12, Javier Rivera 12, Muluneh Yitayew 2 VIP DATA EXPLORER: 30 Years of Vegetation Index and Phenology Observations 1 VIP.

Global Aerosol Forecasting System Applications to Houston/Costa Rica Aura Validation Experiments Arlindo da Silva Global Modeling and Assimilation Office,

Satellite Aerosol Comparative Analysis using the Multi-Sensor MAPSS and AeroStat, powered by Giovanni Presented at the Goddard Annual Aerosol Update, at.

Pushing the limits of dark-target aerosol remote sensing from MODIS Robert C. Levy (SSAI and 613.2) Contributors: S. Mattoo (SSAI), L. Remer (NASA), R.

MODIS Atmosphere Products: The Importance of Record Quality and Length in Quantifying Trends and Correlations S. Platnick 1, N. Amarasinghe 1,2, P. Hubanks.

International Ocean Color Science Meeting, Darmstadt, Germany, May 6-8, 2013 III. MODIS-Aqua normalized water leaving radiance nLw III.1. R2010 vs. R2012.

Spatial & Temporal Distribution of Cloud Properties observed by MODIS: Preliminary Level-3 Results from the Collection 5 Reprocessing Michael D. King,

Characterization of the Station Fire, Los Angeles Aug. – Sept NASA Team MODIS Data products: Robert Levy Lorraine Remer N. Christina Hsu Charles.

NASA, CGMS-43, May 2015 Coordination Group for Meteorological Satellites - CGMS Use of Satellite Observations in NASA Reanalyses: MERRA-2 and Future Plans.

MODIS Atmosphere Group Summary Summary of modifications and enhancements in collection 5 Summary of modifications and enhancements in collection 5 Impacts.

Visible vicarious calibration using RTM

Extinction measurements

MERRA Data Access and Services

Extending MICROS to include Solar Reflectance Bands (SRB)

ESIP Federated Search Cluster

Vicarious calibration by liquid cloud target

OVERVIEW OF THE AEROSTAT PROJECT

Using dynamic aerosol optical properties from a chemical transport model (CTM) to retrieve aerosol optical depths from MODIS reflectances over land Fall.

Global Climatology of Fine Particulate Matter Concentrations Estimated from Remote-Sensed Aerosol Optical Depth Aaron van Donkelaar1, Randall Martin1,2,

Global Climatology of Aerosol Optical Depth

ArcGIS Pro: An Introduction Overview

Presentation transcript:

AeroStat: Online Platform for the Statistical Intercomparison of Aerosols Gregory Leptoukh, NASA/GSFC (P.I.) Chris Lynnes, NASA/GSFC (Acting P.I.) Peter Fox, RPI (Co-I.) Jennifer Wei, Adnet/GSFC (Project Lead) M. Hegde, Adnet/GSFC (Software Lead) Contributions from S. Ahmad, R. Albayrak, K. Bryant, D. da Silva, J. Amrhein, F. Fang, X. Hu, N. Malakar, M. Petrenko, L. Petrov, C. Smit Advancing Collaborative Connections for Earth System Science (ACCESS) Program Robert Levy, SSAI/GSFC (Co-I.) David Lary, U. of Texas at Dallas (Co-I.) Ralph Kahn, NASA/GSFC (Collaborator) Lorraine Remer, NASA/GSFC (Collaborator) Charles Ichoku (Collaborator)

Outline Why AeroStat? Aerostat Features DEMO AeroStat Under the Hood Achievements / Results Going Forward

Why AeroStat?Why AeroStat?

Motive #1: Differences among aerosol measurements Different instruments and algorithms have different measurement characteristics Spatial coverage Spatial consistency Temporal consistency Diurnal coverage Vertical sensitivity Sensitivity to sunglint, clouds, surface reflectance, aerosol types,...

Motive #2: For phenomena such as dust transport, getting a full picture is challenging

Aerostat FeaturesAerostat Features

Aerostat is an environment for aerosol comparison and collocation with supporting documentation Essential documentation: Read Me First, quality statements, disclaimers, processing documentation, lineage... Compare satellite w/ground-based aerosol measurements Scatterplot Time Series Explore aerosol phenomena by merging multi-sensor data Experiment with quality filter settings and bias adjustment Save and share findings (and questions)

Essential documentationEssential documentation

DEMO (Please, try it out, its operational.)

AeroStat Under the HoodAeroStat Under the Hood

Talkoot Aerostat architecture pulls together several ACCESS-related resources ECHO LAADSASDC Aeronet MAPSS Aeronet: AErosol RObotic NETwork ASDC: Atmospheric Science Data Center (LaRC) ECHO: EOS Clearinghouse LAADS: Level 1 and Atmosphere Archive and Distribution System MAPSS: Multi-sensor Aerosol Products Sampling System MAPSS Database cache search fetch OpenSearch MODIS L2 MISR L2 matchup adjust merge/grid query map Giovanni GSocial scatterplot time series

GSocial: a reusable social annotation service Incorporates Talkoot Research Notebook Based on Drupal 6 Despite its name, GSocial can be integrated with other REST-based applications Proof of concept with SeaWiFS True Color application Plans to integrate with Hook Huas ACCESS project Currently in use by Aerostat developers for testing and review preparation Still a work in progress...

Neural Net Bias AdjustmentNeural Net Bias Adjustment Goal: 1.Adjust data to a common baseline to facilitate merging 2.Explore sources of difference among measurements Original plan: Linear regression, and Support vector machine Revised plan: neural network adjustment Linear regression complicated by: Non-Gaussian distribution Different bias causes at low AOD vs. high AOD values Many small contributors to bias, not one or two large ones Neural network previously used by A. da Silva and R. Albayrak

Neural Net ProcessNeural Net Process MAPSS database Aeronet AOD Satellite AOD + regressors Data Matrix Learn AOD Bias – (back-prop) NN coefficients feed train coeff. test Offline Processing Read netCDF file ReadAOD Read Regressors Data Matrix Adjust Bias Update netCDF file Online Processing Data Preparation Python NN module (ffnet)

Neural Net Results: MODIS Aqua LandNeural Net Results: MODIS Aqua Land

Neural Net Results SummaryNeural Net Results Summary Dataset / VariableCompliance – BeforeCompliance – After MODIS Aqua Land6279 MODIS Terra Land6277 MODIS Aqua Ocean5869 MODIS Terra Ocean5672 MODIS Aqua Deep Blue5561 MODIS Terra Deep Blue5463

Neural Network CaveatsNeural Network Caveats NN Tendency to smooth out outliers may not always be desired Hard to pin down adjustment to a few readily understandable factors, but......we can see some of the factors in an exhaustive study of regressor influence by David Lary et al.

Relevant Factors StudyRelevant Factors Study Run full neural network train/test cycle for all possible combinations Mutual Information used as proxy for effectiveness

Bias seems to arise from many small contributions

AeroStat Achievements and Results

Going Forward...Going Forward...

Coming soon...Coming soon... Summer Internships Aerostat Mobile Apps, targeting applications Interactive client-side visualization Linked scatterplot-map Where are these outliers located?

AeroStat RecapAeroStat Recap Comparing aerosol data from different sensors is difficult and time consuming for users AeroStat provides an easy-to-use collaborative environment for exploring aerosol phenomena using multi-sensor data The result should be: More consistency in dealing with multi-sensor aerosol data Easy sharing of results With less user effort

Backup SlidesBackup Slides

Collaboration FeaturesCollaboration Features Mark (tag) and categorize an interesting feature and/or anomaly in a plot View marked-up features in plots related to the one currently being viewed Save bias calculation Save fusion request settings (tag, comment, share a la Facebook) Bug report tags Provide user with list of tags (created by other users) for similar datasets Ability to re-run workflows from other user tags Have a "My Contributions" option, where user can click on previously tagged items, re-run workflow, view plots)

Percent of Biased Data in MODIS Aerosols Over Land Increase as Confidence Flag Decreases *Compliant data are within Aeronet Statistics from Hyer, E., J. Reid, and J. Zhang, 2010, An over-land aerosol optical depth data set for data assimilation by filtering, correction, and aggregation of MODIS Collection 5 optical depth retrievals, Atmos. Meas. Tech. Discuss., 3, 4091–4167.