Open Data Cube Demo and FDA Interfaces Brian Killough NASA Langley Research Center CEOS Systems Engineering Office (SEO) WGISS-47 Meeting April 29, 2019

What is the Open Data Cube (ODC)? Satellite Analysis-Ready Data Open Data Cube Infrastructure Data Cube Core Code, API and Database Applications and Tools Application Library User Interface

More ODC Details ODC = Open Data Cube (www.opendatacube.org) Started by several “ODC Partner” organizations in Jan 2017 as an open source data management solution with a community of contributors and users. The “ODC Partners” are ... GA, CSIRO, NASA-SEO, USGS, and UK-Catapult. They meet monthly (via telecon) and have a detailed work plan. The “ODC Steering Council” manages the technical development and open source code repository (https://github.com/opendatacube) CEOS Data Cube An ”extension” of the ODC goals to demonstrate data cubes around the world and maximize the impact of CEOS satellite data with a focus on developing countries Focused on ARD, user needs, and global capacity building 9 operational country cubes, 14 under development, and 33 more under review. Lots of data cube activity!

Africa Regional Data Cube (ARDC) Launched in May 2018 for 5 countries (Kenya, Tanzania, Sierra Leone, Senegal, Ghana). Initially based on Landsat, but S1, S2 and ALOS data are coming soon! Supported by CEOS (lead + technical support), Amazon (donated cloud services) and GPSDD (training + management support). Multiple instances of web-based remote training and face-to-face in-country training since the launch Initial country use-cases include agriculture, flooding, urbanization, deforestation and illegal mining. ARDC plans to transition to Digital Earth Africa in late 2019.

What are the ODC connections to WGISS and FDA? Based on Open Source Software Promoting the use of CEOS Analysis Ready Data for Land (CARD4L) Many implementations use cloud-based architectures (e.g. Amazon AWS) Sharing of algorithms through the use of Jupyter Notebooks

How can we use the Open Data Cube? Cloud-free Mosaics: Recent Pixel, Median, Geomedian, Max-NDVI Spectral Indices: NDVI, NDBI, NDSI, NDWI, SAVI, EVI, Fractional Cover Land Classification: K-Means, Random Forest, FAO 8-class decision tree Water: Landsat WOFS (Australia), Sentinel-1 WASARD (NASA), Landsat Water Quality (Australia) - Total Suspended Matter Land Change: Spectral Threshold Anomaly, Coastal Change, PyCCD (USGS)

Water Extent Mtera Reservoir in Tanzania This product is a 17-year time series (1999 thru 2016) showing the % time that every pixel has observed water.

Water Quality Lake Manyara in Tanzania Feb 2013 to Dec 2016 Total Suspended Matter (TSM) Maximum Variability

Coastal Change Fadioth, Senegal 2000 to 2015

Urbanization 2001 2017 Urbanization in Dar es Salaam, Tanzania – 2001 to 2017 (16 years) Urban Area Growth = 7% per year (Fractional Cover BS, 0.4 threshold) Population Growth = 5 % per year (reference: web sources)

Land Change Mau Forest in western Kenya Results from Data Cube (left) closely compare well with the Global Forest Watch product (right). Using an EVI threshold approach, there is a loss of 5.7% of the land to devegetation (likely deforestation) from 2002 to 2017.

Web-based User Interface http://tinyurl.com/datacubeui 16 sample data cubes + 10 common applications Free and Open, easy-to-use, menu-driven, GIS tool Applications focused on Landsat data GeoTIFF outputs, animations, pixel drill

Jupyter Python Notebook Hub There are 6 core notebooks (cloud statistics, custom mosaics, water extent, spectral products, land change, vegetation phenology) with You-Tube videos (https://tinyurl.com/odc-youtube). Many more algorithms are under development and testing.

http://tinyurl.com/datacubeui