1. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners Partners NASA NOAA EPA (?) USGS DOE NSF Industry… Agile Data Integration Infrastructure Flow of Data Flow of Control Air Quality Data Meteorology Data Emissions Data Informing Public AQ Compliance Status and Trends Network Assess. Tracking Progress Data to Knowledge Transformation Draft, June 2005 (intended as background for AQ Cluster discussions)

2. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition Data Acquisition and Usage Activities (Select View Show, click to step through PPT) The acquisition part processes the sensory data by firmly linked procedures The Federation focuses on data usage activities and presumes repositories The usage activities are more iterative, dynamic procedures The collected and cleaned data are stored in the repository Data Repository The usage cycle transform data into knowledge for decision making Decisions

3. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu Scientist Science DAACs Current info systems are project/program oriented and provide end-to-end solutions Info UsersData ProvidersInfo System AIRNow Public AIRNow Model Compliance Manager Sample AQ Information Usage Landscape a Part of the data resources of any project can be shared for re-use through DataFed Through the Federation, the data are homogenized into multi-dimensional cubes Data processing and rendering can then be performed through web services Each project/program can be augmented by Federation data and services

4. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu Data are distributed geographically by autonomous providers Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data includes emissions Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Information Landscape: Providers Geography, Content, Agency, Form Data includes emissions, ambient data, Ambient Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data includes emissions, ambient data, satellite data Satellite Ambient Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data includes emissions, ambient data, satellite data and model output Model Satellite Ambient Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data are provided by multiple agencies: EPA, NOAA, NASA and others NASA Mission NOAA GASP NASA IDEA NASA DAACs NOAA ASOS EPA-AQS DataMart EPA AIRNow RPO VIEWS FS FireInv State/Local Emission EPA NEISGEI EPA NEI NOAA WeaMod EPA AQModel NOAA Forecast Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form NASA DAACs NOAA GASP NASA IDEA NASA Missions EPA NEI EPA NEISGEI FS FireInv State/Local Emission NOAA ASOS RPO VIEWS EPA AIRNow EPA-AQS AIRS NOAA WeaMod EPA AQModel NASA GloModel NOAA Forecast Furthermore, data are provided in varied formats and access protocols Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data on Internet are geography-independent and can be ‘linearized’ Internet NASA DAACs EPA R&D Model EPA AIRNow others

5. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu Users are distributed geographically EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Policy Users includes policy makers EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users includes policy makers, the public Policy Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users includes policy makers, the public, AQ managers Policy Public Manager EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist and scientist Policy Public Manager Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others Policy Public Manager Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Information Landscape: Users Types, Agency, Info Needs Furthermore, users need various types of information provided in multiple formats Policy Manager Policy Scientist ManagerScientist Policy Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Since the users are also on the Internet, their geographic location is irrelevant Public Manager Scientist Internet other

6. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu Providers NASA DAACs EPA R&D Model EPA AIRNow others Public Manager Scientist Users other The info system transforms the data into info products for each user In the first stage the heterogeneous data are prepared for uniform access Uniform Access Information Landscape: Info System Data Access, Processing and Products The second stage performs filtering, aggregation, fusion and other operations Data Processing Web Service Chain Custom Processing SciFlo DataFed Info Products Reports, Websites Forecasting Compliance Other Sci. Reports The third stage prepares and delivers the needed info products

7. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu Current Delivery and Integration Systems Data: Emission, Surface Satellite, Model Single Datasets Currently distributed are web-accessible as files, through data warehouses and web portals Virtually all processing, analysis and synthesis is custom-programmed by people Reports The resulting information products are also hand-crafted by analysts

8. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu The challenge is to design a general supportive infrastructure Simply connecting the relevant provides and users for each info product is messy Integrated Data System for Air Quality-IDAQ ESIP AQ Cluster 050510 Draft rhusar@me.wustl.edu The info system infrastructure needs to facilitate the creation of info products AQ Compliance Nowcast/Forecast Status & Trends Find Data Gaps ID New Problems ……… Info Needs Reports Providers supply the ‘raw material’ (data and models) for ‘refined’ info products Emission Surface Satellite Model Single Datasets Providers Wrappers Where? What? When? Federate Data Structuring Structuring the heterogeneous data into where-when-what ‘cubes’ simplifies the mess Slice & Dice Explore Data Viewers The ‘cubed’ data can be accessed and explored by slicing-dicing tools Programs Integrate Understand More elaborate data integration and fusion can be done by web service chaining This infrastructure support for IDAQ can be provided by the ESIP Federation Non-intrusive Linking & MediationData UsersData Providers

9. DRAFT June 6, 2005 ESIP AQ Cluster, rhusar@me.wustl.edu A Sample of Datasets Accessible through ESIP – DataFed Mediation Near Real Time (~ day)DatasetsDataFed It has been demonstrated (project FASTNET) that these and other datasets can be accessed, repackaged and delivered by AIRNow through ‘Consoles’FASTNET MODIS Reflectance MODIS AOT TOMS Index GOES AOT GOES 1km Reflec NEXTRAD Radar MODIS Fire Pix NRL MODEL NWS Surf Wind, Bext