Presentation is loading. Please wait.

Presentation is loading. Please wait.

3SAQS Technical Workshop May 29-30, 2013 Data Warehouse Update, Assessment, and Work Plan Review Zac Adelman (UNC-IE) Shawn McClure (CSU-CIRA) Tom Moore.

Similar presentations


Presentation on theme: "3SAQS Technical Workshop May 29-30, 2013 Data Warehouse Update, Assessment, and Work Plan Review Zac Adelman (UNC-IE) Shawn McClure (CSU-CIRA) Tom Moore."— Presentation transcript:

1 3SAQS Technical Workshop May 29-30, 2013 Data Warehouse Update, Assessment, and Work Plan Review Zac Adelman (UNC-IE) Shawn McClure (CSU-CIRA) Tom Moore (WGA-WRAP)

2 Summary Status of 3SAQS Technical Work Completed To Date Via Cooperative Agreements

3 Review of the 3SDW Overall System Ecosystem and Architecture

4 Continued to refine the database, software, and website infrastructure supporting the data warehouse Refined various pre-processing components XML Generator for metadata SQL scripts for importing modeled emissions data Extended portions of the data import system SQL scripts for importing modeled emissions data Integration layer for the Emissions Management Framework (EMF) Refined the logical and physical file system design Refined the data verification and validation system Refined the system for acquiring and managing emissions data Summary of Past Quarter Activities

5 Interviewed several applicants for the TSDW software developer position Offered the position to the best candidate and received a verbal acceptance Candidate reneged on their acceptance the week before starting the appointment Designed an alternate plan for continuing the work plan with minimal impacts via an increased involvement by UNC Populated the data warehouse with the full complement of WestJump Base08b CAMx Input/Output data for June/July ‘08 Refined the modeled emissions review tool Conducted the First Use Case Beta Test Summary of Past Quarter Activities (cont’d)

6 Operational Website Components User Login Form User Registration/Modification Form User Profile/Account Form User Feedback Form Dataset Request Form Database Query Wizard Raw Data Download Interactive Charts Dynamic Contour Maps Site Metadata Reports Monitoring Site Metadata Browser File Explorer Authentication and Authorization System

7 Future Website Components Modeled Emissions Summary Tool Modeled-to-Observed Data Comparison Tool Air Quality Summary Reports o Visibility o Deposition o Ozone o Other Model Data Mapping Tool Source Apportionment Tool Various Unpublished Monitoring Data Tools Backend Web Services and Processing Components

8 User Login Form

9 User Registration/Modification Form

10 User Profile/Account Form

11 User Feedback Form

12 Dataset Request Form

13

14 Raw Data Download (Query Wizard)

15 Time Series Charts (Query Wizard)

16 Dynamic Contour Maps (Query Wizard)

17 Site Metadata Report (Query Wizard)

18 Monitoring Site Browser

19

20 Modeled Emissions Summary Tool

21 Modeled-to-Obs Comparison Tool

22 Air Quality Summary Reports

23 Model Data Mapping Tool

24 Future Online Visualization Tools

25 First TSDW Modeling Use Case Report and Results

26 Testers visited the TSDW website and registered with the system to create an account Testers visited the Data Request web page and entered their requests for the WestJump Base08b dataset Each request was stored in the database The system determined whether or not each request could be automatically filled or had to be manually assembled The system sent emails to the appropriate TSDW team members to notify them of the data requests TSDW team members assembled the dataset requests (copied the relevant data files onto hard drives) The datasets (hard drives) were delivered to the beta testers The system updated the dataset requests to reflect their “filled” status First Use Case - Beta Test Steps

27 Using the delivered datasets, testers ran the models and generated results Testers returned the model output results to the 3SDW The test results were assessed by TSDW team members Testing outcomes were summarized for the May 3-State AQ Study Technical Workshop The TSDW team refines the dataset ordering, download, packaging, and delivery system according to lessons learned The TSDW team develops the next Use Case testing scenario(s) First Use Case - Beta Test Steps (cont’d)

28 Summer (June – October) 2013 3SAQS Technical Work Review Data Warehouse Activities

29 Implement the collaborative components of the warehouse Implement the ongoing news and updates section 3SDW on-line for NEPA air quality analysis projects by end of October Out-bound data delivery and in-bound data ingestion for NEPA and other air quality studies Data warehouse operations (hosting, data analysis and processing, maintenance, et cetera) Plans for storage/access/visualization for modeling results and evaluation tools Store UT BLM ARMS and other studies’ data in 3SDW after evaluation using protocols Summary of Coming Activities

30 Testing and Refinement Help All users, collaborators, and partners can help with testing Please report bugs – don’t endure them Use the website Feedback form Send direct email to team members Provide as much information as possible up-front Stay abreast of ongoing additions and updates Be an active part of the design process - make suggestions for features and refinements Don’t assume it can’t be done Don’t assume it can be done

31 Thanks.

32 FullNameStartYearEndYearFrequencyNumSitesNumParametersNumRecords CASTNet Dry Chemistry19872010Daily115161450592 CASTNet Visibility Chemistry19932001Daily1245166950 CASTNet Total Deposition19872009Annual1131524195 SEARCH All Variables19982005Daily826438650 SEARCH Best Estimate19982005Daily88153416 SEARCH FRM19982005Daily88153392 NADP National Trends Network19782011Weekly322154865670 NADP Atmospheric Integrated Research Monitoring Network19922010Weekly1217349656 NADP National Trends Network (NTN) - Precipitation-Weighted Means19782011Annual322232475513 NADP National Trends Network (NTN) - Total Wet Deposition19782011Annual32221664482 Guelph Aerosol and Visibility Monitoring Program19942001Daily54565366 Air Sciences, Inc. (Douglas Pass and Ripple Creek, Colorado)20032006Daily24330573 Atmospheric Ammonia & Related Compounds in the Midwest20032005Daily14711858 NPS W126 Ozone Metrics19872011Daily205414307594 NPS Ozone Daily 8hr Max19872011Daily2060212443336 Monitoring Data Inventory (cont’d)

33 FullNameStartYearEndYearFrequencyNumSitesNumParametersNumRecords IMPROVE Aerosol19882011Daily2176318427682 IMPROVE Nephelometer19932012Hourly66418416544 IMPROVE Aerosol, RHR (Original Equation)19882004Daily200377220634 IMPROVE Aerosol, RHR (New Equation), with substituted data19882010Daily2115911613476 IMPROVE Natural Conditions Estimates II20002005N/A1791616944 Measurement of Haze and Visual Effects (MOHAVE)1992 Daily44 106484 Pacific Northwest Regional Visibility Experiment Using Natural Tracers (PREVENT)1990 Daily312758547 Regional Visibility Experimental Assessment in the Lower Fraser Valley (REVEAL)19941995Daily2429618 Southeastern Aerosol and Visibility Study (SEAVS)1995 Daily1443564 Navaho Generating Station Special Study1992 Daily127701 NPS Stacked Filter Unit Network (SFU)19791993Daily8248850126 IMPROVE Fine Total Carbon Source Contribution Study20062008Daily162122082024 EPA PM2.5 Mass FRM (88101) - Daily19972009Daily158911609939 EPA PM2.5 Speciation - Daily20002011Daily3419510737305 EPA PM2.5 Mass (88502) - Hourly19982009Hourly463114307825 EPA PM2.5 Mass (88502) - Daily19932009Hourly5341329995 EPA PM10 Mass (81102) - Hourly19932009Hourly381119078569 EPA PM10 Mass (81102) - Daily19932009Daily254811702864 EPA Ozone - Hourly19932010Hourly19541131385422 EPA Nitrogen Dioxide (NO2) - Hourly19932010Hourly867158311184 EPA Carbon Monoxide (CO) - Hourly19932010Hourly952166946596 EPA Sulfur Dioxide (SO2) - Hourly19931996Hourly846123277658 Monitoring Data Inventory


Download ppt "3SAQS Technical Workshop May 29-30, 2013 Data Warehouse Update, Assessment, and Work Plan Review Zac Adelman (UNC-IE) Shawn McClure (CSU-CIRA) Tom Moore."

Similar presentations


Ads by Google