1 st Quarter 2009 Status Update The Visibility Information Exchange Web System (VIEWS) Cooperative Institute for Research in the Atmosphere.

Slides:



Advertisements
Similar presentations
Air Quality and Health Scenario Stefan Falke, Rudy Husar, Frank Lindsay, David McCabe.
Advertisements

An Integrated Systems Solution to Air Quality Data and Decision Support on the Web GEO Architecture Implementation Pilot – Phase 2 (AIP-2) Kickoff Workshop.
1 GEOSS Architecture Implementation Pilot (AIP) Phase 2 Air Quality and Health Working Group Stefan Falke, Rudy Husar, Frank Lindsay, David McCabe, Erin.
Business Development Suit Presented by Thomas Mathews.
The North American Carbon Program Google Earth Collection Peter C. Griffith, NACP Coordinator; Lisa E. Wilcox; Amy L. Morrell, NACP Web Group Organization:
REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.
Attribution of Haze Phase 2 and Technical Support System Project Update AoH Meeting – San Francisco, CA September 14/15, 2005 Joe Adlhoch - Air Resource.
Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University.
Integrated Decision Support: A Tale of Two Systems “It was the best of times, it was the worst of times…” Charles Dickens, A Tale of Two Cities, 1859 “Actually,
Improving an Air Quality Decision Support System through the Integration of Satellite Data with Ground-based, Modeled, and Emissions Data NASA ROSES 2007:
TSS Project Update WRAP Technical Analysis Forum San Francisco, CA October 11, 2007.
2 nd Quarter 2009 Status Update The Visibility Information Exchange Web System (VIEWS) Cooperative Institute for Research in the Atmosphere.
 Provides integrated online access to:  Monitoring data: from over 3 dozen networks  Modeling data: from a variety of modeling scenarios  Emissions.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore, Western Regional Air Partnership, Western Governor’s Association.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
VIEWS/TSS: An Integrated Systems Solution for Air Quality and Regional Haze Planning The Visibility Information Exchange Web System (VIEWS) is an online.
Improving an Air Quality Decision Support System through the Integration of Satellite Data with Ground-based, Modeled, and Emissions Data NASA ROSES 2007:
 Keep it simple and sufficient (do not multiply it unnecessarily)  Make it intuitive and self-explanatory  Make it easily discoverable and accessible.
Proposal Outline: Extensions to the VIEWS: General CATT Analysis Tool R. Husar, CAPITA Revised, June 26, 2003 Proposed Sub-Projects CATT for VIEWS$20k.
Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.
WRAP Technical Support System Project Update AoH Call October 19, 2005.
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Dissemination of Haze Data, Data Products and Information Bret Schichtel, Rodger Ames, Shawn McClure and Doug Fox.
GEOSS Common Infrastructure: A practical tour Doug Nebert U.S. Geological Survey September 2008.
Global Earth Observation System of Systems (GEOSS) Architecture Implementation Pilot (AIP) Air Quality and Health Working Group Stefan Falke, Rudy Husar,
Air Quality Cluster Earth Science Information Partners Goals 1. Serve as facilitator and advisor.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
2009 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP link to cop site ) Rudolf Husar (Point of Contact, Washington.
material assembled from the web pages at
TSS Project Update WRAP Technical Analysis Forum San Francisco, CA October 11, 2007.
AIR TWITTER: USING SOCIAL MEDIA AND SCIENTIFIC DATA TO SENSE AIR QUALITY EVENTS E. M. Robinson 1 ; W.E. Fialkowski 1 1. Energy, Environmental and Chemical.
August 2003 At A Glance VMOC-CE is an application framework that facilitates real- time, remote cooperative work among geographically dispersed mission.
Linking Tasks, Data, and Architecture Doug Nebert AR-09-01A May 2010.
An Integrated Systems Solution to Air Quality Data and Decision Support on the Web GEO Architecture Implementation Pilot – Phase 2 (AIP-2) Kickoff Workshop.
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
NASA Air Quality Applications Program and the ESIP Air Quality Cluster The goal of the NASA Air Quality Management program is to: Enable partners’ beneficial.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.
REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.
R.Husar From Dedicated to Federated Data Systems Data ProvidersDecisionsDSS CIRA VIEWS Reg. Haze EPA AQS NAAQS EPA AirNow.
TSS Database Inventory. CIRA has… Received and imported the 2002 and 2018 modeling data Decided to initially store only IMPROVE site-specific data Decided.
2010 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP) Rudolf Husar (Point of Contact, Washington University in.
COMMUNITY. Data Acquisition and Usage Value Chain.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
2009 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP link to cop site ) Rudolf Husar (Point of Contact, Washington.
An Integrated Fire, Smoke and Air Quality Data & Tools Network Stefan Falke and Rudolf Husar Center for Air Pollution Impact and Trend Analysis Washington.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
: Data Sharing/Processing Infrastructure Data Catalog and Access Dozens of datasets on aerosols, emissions, fire, meteorology,
TSS Workshop WRAP-up June 20, June 19 th - PRP18 report Major findings - Emissions results detailed in Lee’s talk –Fixed errors in assumptions.
Application of NASA ESE Data and Tools to Particulate Air Quality Management A proposal to NASA Earth Science REASoN Solicitation CAN-02-OES-01 REASoN:
Technical Support System Review Board Meeting March 8, 2007.
The Federated Data System DataFed R. Husar, K. Hoijarvi, S. Falke, DaFed Community EPA Data Summit, Feb. 12, 2008, RTP Non-intrusive data integration infrastructure.
Key Findings from May & July 2008 WRAP Technical Workshops September 30, 2008 Steve Arnold, Colorado DPHE & Bob Kotchenruther, EPA R10 (Co-Chairs, WRAP.
Federal Land Manager Environmental Database (FED) Overview and Update June 6, 2011 Shawn McClure.
Fire, Smoke & Air Quality: Tools for Data Exploration & Analysis : Data Sharing/Processing Infrastructure This project integrates.
Air Quality Community Summer 2009 Meeting Santa Barbara The Visibility Information Exchange Web System (VIEWS) Cooperative Institute for Research in the.
NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Reuse Working Group Earth Science Data Systems Reuse Working Group Case Study: SHAirED Services for.
Global Earth Observation System of Systems (GEOSS) Architecture Implementation Pilot (AIP) Air Quality and Health Working Group Stefan Falke, Rudy Husar,
Intermountain West Data Warehouse - Western Air Quality Study
Current and Future State of the IMPROVE Website
DataNet Collaboration
Federal Land Manager Environmental Database (FED)
NASA ROSES 2007: Decision Support through Earth Science Research Results Improving an Air Quality Decision Support System through the Integration of Satellite.
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Presentation transcript:

1 st Quarter 2009 Status Update The Visibility Information Exchange Web System (VIEWS) Cooperative Institute for Research in the Atmosphere

2007 NASA ROSES proposal EPA ozone and multiple pollutant project Recent collaborations and activities Interoperability efforts and connected systems Leveraging the VIEWS architecture Expanding the VIEWS team Hardware infrastructure update New VIEWS website coming Future goals and plans Annotated Screenshots Presentation Outline

Title: Improving Air Quality Analysis and Planning through the Integration of Satellite Data with Ground-based Observations, Modeling Results, and Emissions Estimates (Co-PIs: Shankar, McClure; awarded in 2008; work ongoing through 2011) Goals: Provide for the visualization and analysis of satellite data in combination with monitoring, modeling, and emissions data Develop routine capture, analysis, and processing algorithms with high temporal and spatial resolution in order to provide better land use/land cover model inputs Obtain finer temporal and spatial resolution of emissions data in remote areas and from individual sources and source clusters Improve boundary and other modeling inputs with four-dimensional pollutant data Evaluate gridded chemistry-transport models, such as CMAQ NASA ROSES Project: Overview

Conducted a project design workshop (May 2008, CIRA) Refined the project scope and plan Acquired the following datasets:  Aura OMI Level 2G  Aura OMI Level 3  Aqua MODIS Level 3  Terra MODIS Level 3  Terra and Aqua MODIS AOD on the CMAQ grid  CALIPSO Level 2 on a 12x12km CMAQ NCEP grid Explored the structure and organization of available data Identified the parameters to extract and/or utilize from the raw data Determined bandwidth and speed limits for data download operations Estimated storage requirements and data download frequencies Created a prototype visualization tool: Created a project website and wiki: NASA ROSES Project: CIRA activities so far

Goals: Evolve VIEWS into a multiple-pollutant data system Expand the scope of VIEWS beyond regional haze Tasks: Collaborate with the EPA to define requirements, tasks, and output products Import the raw hourly ozone data into the VIEWS integrated database Determine the desired aggregations and subsets of the data to provide Design the end user output products and tools for exploring and analyzing the data EPA Ozone and Multiple Pollutant Project

EPA Data Summit (RTP): Convened groups with key roles in managing, analyzing, and disseminating earth observation data in order to explore efficient means of leveraging existing efforts Explored mechanisms and potential opportunities for “interoperability” between systems Assisted EPA/OAQPS in honing its role in the larger earth observation community Established a community-wide strategy for responding to user-defined needs EPA Data Summit link: Earth Science Information Partners (ESIP) Federation Collaborate on interoperability efforts for data/metadata discovery and exchange Contribute data and services to the Earth Information Exchange ESIP website: GEO/GEOSS Architecture Implementation Pilot (AIP) 2 Contribute components and services to the GEOSS registry Participate in efforts to standardize and streamline data discovery and exchange Develop VIEWS/TSS as an “persistent operational exemplar” of the GEOSS architecture GEOSS AIP 2 link: Collaborations and Community Activities

“Interoperability”: The ability of diverse systems and organizations to work together to exchange and utilize information. To facilitate this, VIEWS will offer the following services and features:  Discovery, retrieval, and exchange of data and metadata  On-the-fly transformation and formatting of data and metadata  Upload and management of user-supplied data and metadata  Generation of visualization and analysis products  Availability of “embeddable” components and tools  Support of OGC web standards for spatial data exchange VIEWS Interoperability: Services and standards

WRAP FETS: Incoming prescribed fire data via a co-located database WRAP EDMS: Incoming WRAP emissions inventories WRAP Regional Modeling Center (RMC): Incoming modeled emissions data; necessary for chemical transport modeling data, modeling data results, and gridded emissions inventories that cannot be obtained elsewhere AQS: Outgoing IMPROVE data, incoming PM2.5, PM10, Ozone, etc AirQuest: Incoming satellite data; other datasets being considered AirNow: Incoming Air Quality Index maps and ozone data DataFed: Outgoing IMPROVE data via direct ODBC connection to the VIEWS database; various incoming datasets RSIG: Incoming satellite data and products (future) Giovanni: Incoming satellite data and products NASA DAACs: Incoming satellite data and products BlueSky Framework: Pending proposal; Hybrid source apportionment model to be provided by NPS to BlueSky through web services VIEWS Interoperability: Connected systems

Leveraging the VIEWS Architecture

First question we ask ourselves when designing a new feature: “Can its design be generalized for VIEWS while providing for customization and domain-specific use by connected systems?” If “yes”, then the benefits are: Project and configuration management are simplified Dependent systems can be more “lightweight” The system as a whole can be extended more easily Past and current investments are leveraged and maximized Interoperability and data sharing with external systems is made easier Developers can “implement once, reuse often” Collaboration is facilitated and expedited Leveraging the VIEWS Architecture (cont’d)

John Huddleston Design and development System administration Data acquisition and management Duli Chand Data analysis Scientific research Design of visualization and analysis features Additions to the VIEWS team

Database server: 2.5 – 5 Terabytes of storage; data storage, transformation, and access Web server: Pages, services, and tools File server: Documents, images, photos GIS Server: ESRI suite of tools, static base map collection Processing Server: IDL operations, contour maps, intensive processing Relocation to dedicated server room Overall, ongoing goal: Leverage resources and facilities already available from CIRA Updated hardware infrastructure

New VIEWS website The new website has been in development for approximately 24 months The first official launch is planned for the latter part of Q Additional updates and additions are planned throughout 2009 as part of a progressive roll-out Introduces a new look-and-feel, layout, and navigation scheme Incorporates new web technologies, design principles, and performance optimizations Adds a “developer center” that contains instructions and guidelines for using VIEWS web services and embeddable components Integrates the user registration and authentication infrastructure for VIEWS, TSS, ATDA, and other VIEWS systems Uses Google Analytics for website traffic and usage statistics Incorporates Google Maps into key tools Provides context-sensitive tooltips and “hot links” that are integrated with the VIEWS glossary

New VIEWS website (cont’d) Provides an updated version of the Database Query Wizard that allows the user to obtain much more than just raw data Introduces a “Dataset Catalog” that facilitates the browsing, searching, and exploration of VIEWS datasets Offers an updated Metadata Browser that uses Google Maps for exploring monitoring site metadata Introduces dynamic Air Quality Index (AQI) maps via real-time retrieval from the AirNow website Provides an improved webcams page that is better organized and allows for searching and sorting Adds a large Glossary of Terms that allows for quick browsing and mouse- over tooltips throughout the website Introduces a “Rosetta Stone” for comparing and cross-referencing parameter definitions across different datasets Links IMPROVE data advisories to relevant data products Links exceptional event metadata to relevant data products

Work with UCD to decrease the time lag for disseminating IMPROVE datasets Goal for routine data updates: No more than a 3 month lag between data availability and public dissemination Goal for RHR datasets: No more than a 4 month lag between routine IMPROVE data dissemination and RHR data dissemination Increase the efficiency of preliminary IMPROVE data review: Consider creating an online review and approval tool for expediting the review process Import other datasets on a more frequent, up-to-date basis Work with partners in the air quality community to create more uniform flags, codes, and descriptions for data and metadata Offer future data products as web services and re-factor existing products as web services Offer metadata management tools for program and site managers Future goals and plans

Continue participating in community interoperability efforts Establish long term data exchange mechanisms with connected systems Implement an online forum for questions, comments, discussions, and news Expand the scope of the “Air Data Wiki”: Participate in two potential NASA ROSES projects: Exceptional Event Decision Support System (Rudy Husar) Make monitoring data available online and via web services Participate in event analyses Assist with the development of decision support tools NAAPS Products for Air Quality Decision-making (Doug Westphal) Discovery, display, analysis, and retrieval of NAAPS data Future goals and plans (cont’d)

New and updated VIEWS tools Query WizardDataset IndexMetadata Browser AirNow AQI MapsWebcams PageGlossary

New Query Wizard and Mouse-over Help

New Metadata Browser Google Maps used for showing site locations Site photos Site details and history Tabular site list for sorting and quick selection

Glossary And Codes Key Glossary entries show up as tooltips whenever they’re used in web pages. Jump to beginning letters.

“Rosetta Stone” for Dataset Parameters

Exceptional event metadata (such as fires) is stored and dynamically associated with data at run time in order to better inform the user about the context of the data. “Bisquit” fire impacting Crater Lake in 2002 Exceptional Event Metadata

IMPROVE Data Advisories document interesting findings from the IMPROVE database such as data anomalies, potential problems, and new uses for the IMPROVE data. These advisories are stored as metadata in the VIEWS database and dynamically associated with data and products. When a user selects data, the systems checks for any advisories relevant to the data selected and attaches them to the output. IMPROVE Data Advisories