1. 3SAQS Data Warehouse Update October 10, 2014 CIRA - Fort Collins, CO

2. Outline Data Warehouse Team System Overview Phase 1 Operational State Website Overview Project & Request Workflow Future Work 2 3SAQS Steering Committee October 10, 2014

3. Data Warehouse Team Shawn McClure Tom Moore Dustin Schmidt Rodger Ames Cassie Archuleta (ARS) 3 3SAQS Steering Committee October 10, 2014

4. System Overview

5. 5 3SAQS Steering Committee October 10, 2014

6. Data Warehouse – Phase 1 Project Management System – Project/inventory tracking, modeling platform request form (Phase 1=NEPA), data manifest Hardware Upgrades – New 55tb RAID – USB3 transfer to external disks 6 3SAQS Steering Committee October 10, 2014

7. Data Warehouse – Phase 1 (cont.) Modeling Platforms – Base 2008b, Base 2011a CAMx (release pending approval) Data deliveries – Hiawatha (ENVIRON) – Converse County (AECOM) Website – Pages for studies, projects, documents, procedures and results, meetings & events, literature, glossary, about (updates ongoing) 7 3SAQS Steering Committee October 10, 2014

8. Data Warehouse – Phase 1 (cont.) Inventory Management – Data is placed within the warehouse – Warehouse file system is represented in database Facilitates change control – File system items are data Files Directories – Categories are groups of File System Items Files and Directories are grouped into Categories Meta data is attached to Category Categories may be hierarchically related Data may belong in multiple categories – Data Packages are groups of Categories Collection of categories for intended use (NEPA)

9. Website overview Studies – Modeling platforms (completed and forward looking) – Monitoring data overview (pending) Documents – Modeling platform protocols, MPEs, etc. Procedures and Results – Specific how-to pages for DW web based tools (pending) About – General information about 3SAQS and the DW (pending) Projects – User initiated AQ modeling using 3SAQS platforms 3SAQS Steering Committee October 10, 2014 9

10. Demo Website http://views.cira.colostate.edu/TSDW/Demo/ 10 3SAQS Steering Committee October 10, 2014

11. Data Warehouse Website – Phase 1 11 3SAQS Steering Committee October 10, 2014

12. 12

13. Studies 3SAQS foundational modeling platforms Phase 1 (done) – 2008b available – 2011a (release pending) Phase 2 (forward looking) – 2008_2020a – 2011_2020a (CAMx/CMAQ) – Preliminary 2014 (CAMX/CMAQ) – 2014_FutureCase (CAMX/CMAQ) 3SAQS Steering Committee October 10, 2014 13

14. 14 3SAQS Steering Committee October 10, 2014

15. Documents Memorialize work that is already done – Network Assessment Reference basis for modeling platforms that the DW is delivering – Modeling protocols – MPE reports – Emissions reconciliations Reports and comments – 2008, 2011 Modeling Protocols & response to comments Calls for comments on draft documents – Base 2008b MPE – 2011 WRF MPE Technical memos – WestJump to 3SAQS – 3SAQS and 2011 NEI O&G Emission Inventories reconciliation – 3SAQS Methane inventory & response to comments Modeling Guidance – NEPA/non-NEPA guidance – SMOKE Work plans Annual & Quarterly Reports 15 3SAQS Steering Committee October 10, 2014

16. 16 3SAQS Steering Committee October 10, 2014

17. Procedures and Results “How to” pages for: – Data download and upload procedures – Application of visualization tools – Understanding modeling platforms – Interpreting emissions inventories – Accomplishments and future work of the 3SAQS and DW 3SAQS Steering Committee October 10, 2014 17

18. About Informational Flyer – Goals of 3SAQS and role of DW – Studies and project management overview – Modeling toolbox highlights Geospatial data selection 3SAQS and cooperators – BLM – NPS – Forest Service – States of CO, WY, UT 3SAQS Steering Committee October 10, 2014 18

19. Projects User initiated AQ modeling projects NEPA Projects – Hiawatha (ENVIRON) – Converse County (AECOM) – Others pending Non-NEPA (future work) – NPS N deposition – NPS Vertical Profiles of simulated ammonia – EPA QA 2011 Base A – State of CO RAQC O3 SIP – State on NM O3 nonattainment – Others… 3SAQS Steering Committee October 10, 2014 19

20. Project Workflow - High Level Goals Manage Data Access Provide Project Managers an overview of data delivery progress Provide Users a concise view of available data Provide Data Requestors with a detailed manifest (receipt) Detailed data accounting (Inventory Management) – Meta data – Who got what and when – Change control Track usage of supplied data Capture communication threads (Future work)

21. Project Workflow - Overview 3SDW Administrators designate registered users as “Project Managers” – Cooperating Agency point of contact Project Manager creates new analysis project – Provides high level meta data – Designates project team members Contractors, Subordinates, Etc Project team member initiates a Data Request – Data Selection – Provide detailed meta-data 3SDW Team fulfills data request Project team member signs-off request as completed 3SAQS Steering Committee October 10, 2014 21

22. Project Workflow – User Roles

23. Project Workflow - User Roles Registered User – View projects (Read-only) – View Data Requests (Read-only)

24. Project Workflow - User Roles Project Manager – A Registered user who is also a member of a 3SDW cooperating agency (BLM, EPA, NPS, etc). – Create new analysis projects – Assign project team members – Monitor data transfer progress – Issue data requests

25. Project Workflow - User Roles Project Team Member – Assigned to team by Project Manager – Issue data requests for assigned projects

26. Project Workflow

27. Projects Overview Purpose – Present an overview of Data Request status – Entry point for Project process – Create a new project

28. Projects Overview

30. Project Configuration Purpose – Capture high level information about the project High level description (Details provided by data requestors) Location Timeframe – Managing Data Access Selected pool of Project Managers (3SDW Cooperators) Project Managers assign 3SDW registered users to project

31. Project Configuration

33. Data Request Allow users to browse available data Capture optional information about – Intended use of data – Results/Conclusions from data usage Supply detailed manifest of requested data

34. Data Request

38. Future Work Provide finer granularity in data selection Tune process for supplying supplemental data Web interface for Data Cataloging & QA Enhance performance of online data transfer Capture e-mail communication traffic for Project / Data Request Data Submission Process (Return model results to warehouse)

39. Data Warehouse Website – Phase 2 39 3SAQS Steering Committee October 10, 2014