Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 Presented by: Alison Kittle, U.S. EPA Bill Rensmith, Windsor Solutions, Inc. Mike Beaulac, Michigan DNRE Tony Jeng, enfoTech & Consulting Integrated.

Similar presentations


Presentation on theme: "1 Presented by: Alison Kittle, U.S. EPA Bill Rensmith, Windsor Solutions, Inc. Mike Beaulac, Michigan DNRE Tony Jeng, enfoTech & Consulting Integrated."— Presentation transcript:

1 1 Presented by: Alison Kittle, U.S. EPA Bill Rensmith, Windsor Solutions, Inc. Mike Beaulac, Michigan DNRE Tony Jeng, enfoTech & Consulting Integrated Compliance Information System (ICIS) and Beyond: Current and Future Plans and Technology Exchange Network National Meeting May 30, 2012

2 2 Agenda  ICIS Today  Future of ICIS  ICIS Electronic Submission Tools OpenNode2 Starter Kit for ICIS OpenNode2 Starter Kit for ICIS EN-Node2 Plug-In for ICIS EN-Node2 Plug-In for ICIS  Resources Available to States

3 3 Agenda  ICIS Today  Future of ICIS  ICIS Electronic Submission Tools OpenNode2 Starter Kit for ICIS OpenNode2 Starter Kit for ICIS EN-Node2 Plug-In for ICIS EN-Node2 Plug-In for ICIS  Resources Available to States

4 4 ICIS Today DMR Batch In production since May 2008 In production since May 2008 6 state agencies using it (AK, AR, IL, MI, MN, TN) 6 state agencies using it (AK, AR, IL, MI, MN, TN) 12 NetDMR states using it (AR, CO, CT, HI, IN, KY, LA, MD, SD, TN, UT, TX) 12 NetDMR states using it (AR, CO, CT, HI, IN, KY, LA, MD, SD, TN, UT, TX) Full Batch  Phase 1 Batching of permit related data Batching of permit related data 7 state agencies submitting this data (AL, DE, FL, KY, MO, OH, PA) 7 state agencies submitting this data (AL, DE, FL, KY, MO, OH, PA) In production since February 2011 In production since February 2011  Phase 2 Batching of inspection related data Batching of inspection related data 6 state agencies submitting this data (AL, DE, FL, KY, OH, PA) 6 state agencies submitting this data (AL, DE, FL, KY, OH, PA) In production since November 2011 In production since November 2011

5 5 ICIS Today Full Batch  Phase 3 Batching of enforcement action, violation and program report related data Batching of enforcement action, violation and program report related data 15 State agencies to be migrated out of PCS (AZ, IA, KS, ME, MS, NJ, NC, ND, OR, SC, VA, VT, WA, WV, WY) 15 State agencies to be migrated out of PCS (AZ, IA, KS, ME, MS, NJ, NC, ND, OR, SC, VA, VT, WA, WV, WY) Scheduled to be in production December 2012 Scheduled to be in production December 2012

6 6 Agenda  ICIS Today  Future of ICIS  ICIS Electronic Submission Tools OpenNode2 Starter Kit for ICIS OpenNode2 Starter Kit for ICIS EN-Node2 Plug-In for ICIS EN-Node2 Plug-In for ICIS  Resources Available to States

7 7 Future of ICIS  Full Batch Data Flow Enables ICIS For: Electronic exchange of information between EPA and states (e.g., NPDES Permitting, Enforcement and Compliance information). Electronic exchange of information between EPA and states (e.g., NPDES Permitting, Enforcement and Compliance information). Electronic reporting from the NPDES regulated universe to EPA Electronic reporting from the NPDES regulated universe to EPA Electronic reporting of compliance monitoring data from inspectors in the field Electronic reporting of compliance monitoring data from inspectors in the field Electronic submission of data from other EPA systems Electronic submission of data from other EPA systems

8 8 Future of ICIS  Electronic reporting of compliance data from inspectors in the field: Region 4 inspectors to send their compliance monitoring data and RCRA inspection reports directly to ICIS from the field via CDX Region 4 inspectors to send their compliance monitoring data and RCRA inspection reports directly to ICIS from the field via CDX EPA is piloting tablet software for the PCB and NPDES Construction Storm Water compliance monitoring programs EPA is piloting tablet software for the PCB and NPDES Construction Storm Water compliance monitoring programs

9 9 Agenda  ICIS Today  Future of ICIS  ICIS Electronic Submission Tools OpenNode2 Starter Kit for ICIS OpenNode2 Starter Kit for ICIS EN-Node2 Plug-In for ICIS EN-Node2 Plug-In for ICIS  Making the Future of ICIS and Electronic Reporting a Reality

10 1010  Free.NET and Java software posted on the Exchange Network used for submitting all data families to ICIS  Stores data extracted from state NPDES system into staging tables structured like ICIS  Generates XML submission files and submits them to ICIS through CDX  Returns results of ICIS processing  States must extract their NPDES data into the staging tables with ICIS reference codes ICIS Electronic Submission Tools

11 OpenNode2 ICIS-NPDES Full Batch Plugin Submitting Data to ICIS the Easy Way Bill Rensmith, Windsor Solutions, Inc. 11

12 OpenNode2  Project Background About OpenNode2, flows, and plugins About OpenNode2, flows, and plugins About this Project About this Project Project Timeline Project Timeline  How it Works Staging Tables Staging Tables Submission Lifecycle Submission Lifecycle  Live Demonstration Implementer Responsibilities Implementer Responsibilities Options for non-OpenNode2 States Options for non-OpenNode2 States  Q & A 12

13 About OpenNode2  Open source Exchange Network node software  OpenNode2 can: send data to other Network partners send data to other Network partners make data available for others to query make data available for others to query  Most widely used node software on the Network  Available at http://code.google.com/p/opennode2 13

14 About Flows and Plugins  Each type of data on the network is a “flow” There is a flow for each regulatory area (air, waste, etc…) There is a flow for each regulatory area (air, waste, etc…) ICIS-NPDES is one of many available flows ICIS-NPDES is one of many available flows EPA defined the rules for sending data via the ICIS- NPDES flow EPA defined the rules for sending data via the ICIS- NPDES flow  Each flow is implemented as a Plugin in OpenNode2 Plugins are the software that contain the functionality needed to support a specific flow Plugins are the software that contain the functionality needed to support a specific flow The OpenNode2 Google code site has plugins for most major regulatory flows to EPA The OpenNode2 Google code site has plugins for most major regulatory flows to EPA 14

15 About this Project  The ICIS-NPDES Full Batch flow is complex 46 different data families 46 different data families 149 tables (complex data types) 149 tables (complex data types) 1195 fields (simple elements) 1195 fields (simple elements) 963 business rules 963 business rules  To reduce implementation challenge, EPA and ECOS wanted to make available tools to simplify flow implementation for states. 15

16 About this Project (cont’d)  In September 2011, EPA and ECOS engaged Windsor to develop full batch data flow plugin for OpenNode2 Ubiquity of OpenNode2 made it a good choice to reach the widest potential audience of states Ubiquity of OpenNode2 made it a good choice to reach the widest potential audience of states To reduce cost, only developing for the.NET version of OpenNode2 (most commonly used version) To reduce cost, only developing for the.NET version of OpenNode2 (most commonly used version)  Pilot with Washington Dept. of Ecology Summer 2012 Summer 2012 16

17 Project Timeline  1/5/2012 – Plugin design completed  2/8/2012 – Staging tables released to Google Code  3/13/2012 – Beta Plugin released to Google Code  4-8/2012 – Test/Implement in WA  8/23/2012 – Final Plugin release to Google Code  12/2012 – Release of ICIS v4 Plugin Adds support for compliance and enforcement modules Adds support for compliance and enforcement modules 17

18 Overall Submission Workflow 18

19 Workflow Lifecycle 1. Data Preparation Stage a. State-specific Extract, Transform and Load (ETL) b. Change Detection Process 2. Submission Stage 3. Result Processing Stage a. Retrieve Accept/Reject Report and Parse/Store Results b. Store Accepted Records  Full lifecycle must complete before repeating  Checks in place to prevent out-of-sequence execution 19

20 ICIS-NPDES Staging Tables  Two sets of staging tables: ICS_FLOW_LOCAL – Agency’s NPDES data to send to ICIS ICS_FLOW_LOCAL – Agency’s NPDES data to send to ICIS ICS_FLOW_ICIS – Copy of all data successfully sent to ICIS ICS_FLOW_ICIS – Copy of all data successfully sent to ICIS 20

21 Stage 1: Data Preparation  ETL Step Refresh “local” tables with latest data from agency NPDES database Refresh “local” tables with latest data from agency NPDES database 21

22 Stage 1: Data Preparation (cont’d)  Detect Changes Step Database routine compares “Local” data with “ICIS” data to determine what needs to get sent. Database routine compares “Local” data with “ICIS” data to determine what needs to get sent. Sets Transaction Codes (N, C, R). Leave Transaction Code blank if data is already in sync with ICIS. Sets Transaction Codes (N, C, R). Leave Transaction Code blank if data is already in sync with ICIS. Inserts records into “Local” for Deletes (D, X). Inserts records into “Local” for Deletes (D, X). 22

23 Stage 2: Submission  Plugin builds payload for all modules/records that have a Transaction Code set. 23

24 Stage 3: Result Processing  Download, Parse and Store Results Step: When processing is complete, Node downloads and parses Accepted and Rejected Transactions into a Result Tracking Table. When processing is complete, Node downloads and parses Accepted and Rejected Transactions into a Result Tracking Table. 24

25 Stage 3: Result Processing (cont’d)  Store Accepted Transactions Step: Accepted Records are copied from “Local” to “ICIS”. Accepted Records are copied from “Local” to “ICIS”. Performed by a stored procedure executed by the plugin. Performed by a stored procedure executed by the plugin. 25

26 Stage 3: Result Processing (cont’d)  How do I audit successes/failures? All feedback from ICIS is stored in result tracking table (ICS_SUBM_RESULTS) All feedback from ICIS is stored in result tracking table (ICS_SUBM_RESULTS) Only stores the accepted transactions from the most recent submission Only stores the accepted transactions from the most recent submission Stores all errors received for a given business key’ Stores all errors received for a given business key’ 26

27 Live Demonstration 27

28 What Can I Download?  http://code.google.com/p/opennode2/ 28

29 What Can I Download? (cont’d)  Plugin Plugin.zip – this is what you upload to OpenNode2 Plugin.zip – this is what you upload to OpenNode2 Database scripts – for SQL Server and Oracle Database scripts – for SQL Server and Oracle Creates needed tables, procedures, views…Creates needed tables, procedures, views…  Documentation Plugin Implementation Guide PDF Plugin Implementation Guide PDF Just the facts. Describes how to install and configure the plugin and database components.Just the facts. Describes how to install and configure the plugin and database components. Plugin Design Specification PDF Plugin Design Specification PDF All the nitty-gritty details of the plugin design. Very useful to understand the details of how the plugin components work.All the nitty-gritty details of the plugin design. Very useful to understand the details of how the plugin components work. 29

30 Implementer Responsibilities 1. Set up staging tables in state environment 2. Map source systems to staging tables Mapping to ICIS-NPDES lookup values 3. Develop data extraction and transformation routines to copy data from state database to staging tables 4. Set up node and plugin 5. Flow data to CDX Test environment 6. Monitor for errors. Fix by: 1. Fixing data in source system 2. refining ETL logic 7. Migrate to production 30

31 Questions and Answers http://code.google.com/p/opennode2 Webinar Video: http://youtu.be/7qP2d6CUypsb http://youtu.be/7qP2d6CUypsb 31

32 3232  Michigan eDMR Demonstration by Mike Beaulac, Michigan DEQ by Mike Beaulac, Michigan DEQ Electronic Submission Plug-Ins

33 3333 NMS: NPDES Management System NMS: NPDES Management System E2: Online DMR Reporting System E2: Online DMR Reporting System EN Node: ICIS-DMR batch loading to CDX/ICIS EN Node: ICIS-DMR batch loading to CDX/ICIS Electronic Submission Plug-Ins

34 3434  Permittee requests an account Authorized representative submits a TPA to DEQ to request an account (preparer, viewer, certifier) Authorized representative submits a TPA to DEQ to request an account (preparer, viewer, certifier) DEQ approves the request, establishes accounts, sends security credentials to the requestor DEQ approves the request, establishes accounts, sends security credentials to the requestor  DMR Reporting Forms NMS pushes monitoring/reporting requirements to E2 (supports monthly, quarterly, semi-annual, annual DMRs) NMS pushes monitoring/reporting requirements to E2 (supports monthly, quarterly, semi-annual, annual DMRs)  DMR Reporting & Management Permittee: Online data entry, Excel copy-and-paste, XML upload, compliance checks, comment results, data validations, make revisions (745 participating facilities, 76% out of 976) Permittee: Online data entry, Excel copy-and-paste, XML upload, compliance checks, comment results, data validations, make revisions (745 participating facilities, 76% out of 976) DEQ: late/no submission report, email reporting alerts, etc. DEQ: late/no submission report, email reporting alerts, etc. Procedures in meeting CROMERR requirements Procedures in meeting CROMERR requirements Electronic Submission Plug-Ins

35 35  Parameter requirement by Monitoring Point and Stage  Seasonal requirements  Effective dates could be staged Electronic Submission Plug-Ins

36 36 Violation Alert! Incomplete! Commenting Result. Electronic Submission Plug-Ins

37 37 Report results for parameters not listed on the DMR form… Commenting Result. Electronic Submission Plug-Ins

38 3838  EN-Node2 ICIS Plug-In Demonstration by Tony Jeng, enfoTech & Consulting, Inc. by Tony Jeng, enfoTech & Consulting, Inc. ICIS Electronic Submission Tools

39 39 ICIS-Batch Data Family Structure

40 40 EN-Node Plugins for ICIS-NPDES Optional Payloads for General PMT Biosolids CAFO CSO POTW Pretreatment Storm Water MS4 … Optional Payloads for General PMT Biosolids CAFO CSO POTW Pretreatment Storm Water MS4 … Optional Payloads for Master General PMT Biosolids CAFO CSO POTW Pretreatment Storm Water MS4 … Optional Payloads for Master General PMT Biosolids CAFO CSO POTW Pretreatment Storm Water MS4 … General Permit Plug-in Master General Permit Plug-in Optional Payloads for Basic PMT Biosolids CAFO CSO POTW Pretreatment Storm Water MS4 … Optional Payloads for Basic PMT Biosolids CAFO CSO POTW Pretreatment Storm Water MS4 … Optional Payloads: SSO Annual Report SSO Monthly Report Storm Water Event Storm Water Program Report … Optional Payloads: SSO Annual Report SSO Monthly Report Storm Water Event Storm Water Program Report … DMR Plug-in Optional Payloads Single event Schedule Violation Optional Payloads Single event Schedule Violation Compliance Determination Plug-in Optional Payloads Enforcement Actions Optional Payloads Enforcement Actions Enforcement Plug-in Unpermitted Facility Plug-In Basic Permit Plug-in Report Plug-in Optional Payloads: CAFO Inspection SSO Inspection CSO Inspection Storm water Inspection … Optional Payloads: CAFO Inspection SSO Inspection CSO Inspection Storm water Inspection … Inspection Plug-in

41 EN-Node ICIS-Batch Implementation Data Push Options: Triggers, Stored Procedures, Schedule Jobs, … Generic data validation: State-to-ICIS code translation Data type & length Schema validation State-specific validation… Reports: Search/View State Data Search/View Submit data Search/View Transactions & status View ICIS processing reports Submissions: Types: X, N, R, C Delete Permit: To delete a Permit, all child records must be deleted first (limits, DMR, violations, inspection, etc.) Reload DMR: For period of over-lapping permits, DMRs need to be reloaded 41

42 EN-Node ICIS Submission Options 42

43 EN-Node Flow Wizard - Process Configuration 43

44 44 EN-Node ICIS Plugins  Availability Status  Download EN-Node & Plug-ins: https://code.google.com/p/en-node2/downloads/list https://code.google.com/p/en-node2/downloads/list

45 45 Agenda  ICIS Today  Future of ICIS  ICIS Electronic Submission Tools OpenNode2 Starter Kit for ICIS OpenNode2 Starter Kit for ICIS EN-Node2 Plug-In for ICIS EN-Node2 Plug-In for ICIS  Resources Available to States

46 46 Resources Available to States OEI Exchange Network Grants  Funding to states, territories and federally recognized Indian tribes to support development of Environmental Information Exchange Network related activities  Announcement of the availability of funds and soliciting of proposals and partial applications from applicants occurs through the Exchange Network Grant web page at www.epa.gov/networkg

47 47 For More Information Contacts  ICIS-NPDES Electronic Submissions Alison Kittle kittle.alison@epa.gov Alison Kittle kittle.alison@epa.govkittle.alison@epa.gov  Michigan eDMR Mike Beaulac BealacM@Michigan.gov Mike Beaulac BealacM@Michigan.govBealacM@Michigan.gov  EN-Node Tony Jeng Tony_Jeng@enfotech.com Tony Jeng Tony_Jeng@enfotech.comTony_Jeng@enfotech.com  OpenNode2 Bill Rensmith bill_rensmith@windsorsolutions.com Bill Rensmith bill_rensmith@windsorsolutions.combill_rensmith@windsorsolutions.com

48 48 Questions ???


Download ppt "1 Presented by: Alison Kittle, U.S. EPA Bill Rensmith, Windsor Solutions, Inc. Mike Beaulac, Michigan DNRE Tony Jeng, enfoTech & Consulting Integrated."

Similar presentations


Ads by Google