1. Interfacing Applications Solutions
Cary McElhinney – EPA Co-Chair
Barrett Brown– State Co-Chair
July 11, 2018
U.S. Environmental Protection Agency

2. Outline IAWG status/membership Vision for interfacing apps
Turning requirements into solutions
LRDR/VES Overview
ReST API Overview
11/19/2018

3. IAWG Membership Leah McKenna (NH) Roger Svendsen (IN)
Barrett Brown (ND)– State Co-Chair
Troy Rademacher (ID)
Paul Williams (CA)
Freddie Grier (NJ)
Eric Chai (NC)
Christine Harrison (VA)
Chuck Michael (OR)
Jonathan Haynes (TX)
Justin Wright (EPA OGWDW)
Steven Wright (OK)
Richard Asbury (NM)
Brian Tarver (OH)
Johan Forsman (LA)
Cary McElhinney (EPA Region 5) – EPA Co-Chair
Mark McCasland (EPA Region 6)
Tsegaye Hailu (EPA Region 8)
Elinor Keith (EPA OW PMO)
Colt Smith (UT)
Patrick Southern (VT)
Remind we called out for new members last year and we’d like to thank those who’ve volunteered.
11/19/2018

4. Past/Current Work Completed requirements gathering last year
Hiatus from Dec-April
Ramping up design work past few months on software solutions
Flow – We’ve used info you all submitted and analyzed Subgroups are Data Exchange and Reports/Ad Hoc Queries.
11/19/2018

5. Priority Apps Ad Hoc Query and Reporting Tools/Interfaces
External Data System Access Method
Direct batch entry/editing of data via file standard
Electronic Sanitary Survey Application
Direct lab input to Prime via XML or direct keyboard data entry from lab (i.e. CMDP!)
11/19/2018

6. Priority Apps Continued
6. Monthly Operational Reports (i.e. CMDP!)
7. Inventory and Sample Schedule data feed/extract to PWSs and Labs
8. Operator Certification: Track OpCert Info
9. Enhanced Drinking Water Watch
10.Track Engineering/Design Project Info
11/19/2018

7. Local Replication Data Repository Bulk Upload Process
Solution Options
Local Replication Data Repository
Bulk Upload Process
ReST API Web Services
Prime UI Built In Extracts/Reports
11/19/2018

8. Extracts, Reports, etc. CMDP Prime UI Bulk Upload Application Tier
Web Services/ReST API
Interfacing Apps
Start with the database, then you have the application tier, this is basically the input/output manager, then CMDP and Prime UI are the two current web interfaces that allow you to “work with” the prime database. The next piece are the APIs, these are the pieces that let external items connect with the Prime database, but note, they also funnel through the application tier.
Prime DB
LRDR
ODBC
Interfacing Apps
VES
11/19/2018

9. Local Replication Data Repository
Replication, read-only database for local (i.e. ODBC) connections
Maintain synchronization process with Prime: Virtual Exchange Services (VES)
Justin will provide overview
The next piece to the puzzle is the LRDR (aka data mart). This will be populated/updated via a Virtual Exchange Service (or existing agency node if they have access to one). The LRDR will allow existing ODBC apps to continue to work without requiring a significant update. However, this will not be live data, there may be some delay due to the refresh schedule.
11/19/2018

10. Bulk Upload Process Replace XMLSampling, MigrateToState
Add/Edit/Delete records
Publish XML Schemas and Data Exchange Templates
Data mapping and preparation tools
The Bulk Upload is the process that will replace MTS/XMLSampling as a way to batch upload edits/additions/deletes to the Prime db.
11/19/2018

11. Bulk Upload User Stories
As a data manager, I want to add, edit and delete sampling results data received from laboratories and water systems that do not come through CMDP. This would include ability to handle sample summaries and simplified (I.e. minimal metadata) sample datasets.
11/19/2018

12. Bulk Upload User Stories
As a data manager, I need the ability to “test” bulk upload transactions before officially providing a bulk upload file for final processing. This would allow me to be able to check for any data quality/validation errors before committing to production database
11/19/2018

13. ReST API Interface to handle all non-UI incoming/outgoing data
Direct, dynamic connection to external apps
Foundation for applications and processes built by EPA, States, vendors, etc.
Elinor will provide overview
The Interfacing Apps is for applications that agencies have that are capable of consuming ReST APIs, this will be live data. Eventually agencies will want to have all of their apps using this method versus the LRDR.
11/19/2018

14. Prime UI Built In Extracts/Reports
Ability to search, sort and filter data to present or extract data for business purposes
Prioritized requirements based on Compliance Determination Subsystem
Interactive dashboards, tabular grids and report generation tools
Finally, agencies will be able to use the reports/extracts that are built as part of the SDWIS Prime UI, example, the search result tables that can be filtered and exported into Excel.
11/19/2018

15. Schedule Ahead Focus on LRDR (through Sept)
Building out API architecture (post Sept)
These two items help complete the framework for full cycle data management. Being able to migrate data/changes into Prime, or use the UI. Being able to get data out from Prime, via the UI or ReST APIs. The initial pilot efforts are on the LRDR (easy access to the data, i.e. data out) and batch sample upload since these are considered extremely high priorities by the entire user community.
11/19/2018

16. Contact IAWG Members bjbrown@nd.gov (701)328-5209
(701)
(312)
11/19/2018