EVM Practitioners’ Forum 2017 Workshop: Empower – Program Performance Assessment and Data-Driven Audits on a NASA Program Presenters: Gary Troop – Encore.

EVM Practitioners’ Forum 2017 Workshop: Empower – Program Performance Assessment and Data-Driven Audits on a NASA Program Presenters: Gary Troop – Encore Analytics, LLC Bob Harbaugh – SwRI, PP&C/EVM Mgr. Ron Black – SwRI PM

EVM Practioner’s Forum 2017
Outline Project Control Data Validation Notification Data Quality Corrective Actions – Other Data Analysis VAR Narratives - Level 2 (CAMs) and 1 (Project) VAR Corrective Actions VAR Status, Tracking, Review & Approval Formal Reporting (IPMR) Conclusion 8/24/2017 EVM Practioner’s Forum 2017

Project Control Validation
Project Control administrates the P6 IMS and EVMax performance data gathering and integration immediately following the closure of the reporting period. Upon integration, performance data undergoes a quick-look by Deputy Project Manager (DPM) and Project Control (PC) To perform data alignment spot-check To identify obvious data anomalies To conduct a litmus test of indicated current period and cumulative variances. 8/24/2017 EVM Practioner’s Forum 2017

If issues identified, return to data source and PC/CAM resolve P6 IMS Labor charges Re-import performance data with corrections and perform another quick-look If no further issues identified, PC imports reporting period performance and forecast data into Empower PC conducts post-import quick-look of data alignment and comparison spot-checks with source data 8/24/2017 EVM Practioner’s Forum 2017

DPM and PC review and drill down to understand the VARs indicated VARs DQI Flags Current Period S, P, & A Current Period Trends 8/24/2017 EVM Practioner’s Forum 2017

Notification Once post-import quick-look successfully completed, DPM/PC initiates an Notification within Empower to be sent out to all CAMs (Narrative Submitters) having required VARs (cCsSV). 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Upon receipt of the Notification, CAM is to conduct their own assessment of the data quality PC conducting similar data quality analysis in parallel with CAMs CAM/PC must “buy-in” on what the performance data is indicating in order to proceed with their data analysis 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Empower offers the user a number of data quality checks that point to: data items anomalies data misalignment standard metrics non-compliance issues These issues may need to be addressed immediately, or assessed for near-term “corrective action” by the CAM and PC to resolve certain data quality issue specifics Data quality issues can be deemed as non-compliance issues depending on severity and/or a recurring problem not being addressed that could detract from the PMB data accuracy, alignment, and integrity. 8/24/2017 EVM Practioner’s Forum 2017

Data Quality A number of data quality elements (Views & Reports) should be visited each month by the CAM and PC. A handful of these are: DQI Flags – Data Quality Indicator Flags provide insight into the four (4) unique types of data quality issues Earned value, Forecast, Schedule, and Integration EVM DQI View - Supports a listing of Earned Value specific data issues and drill-down to WP level data to support further analysis to resolve pertinent issues IMS DQI View - Supports a listing of Schedule specific data issues and drill-down to WP level data to support further analysis to resolve pertinent issues Schedule Assessment Report – Highlights the current state for 12 of 14 DCMA Schedule Assessment items Six-Period DQI Report – Provides a history of the DQ problems over the last six reporting periods (Needs to trend downward on reflect resolution of most items) EVMS/IMS Integration Report – Provides comparison of values for baseline start and finish dates in the schedule system (IMS) and the equivalent dates in the cost system (EVMS). EVMS data (BCWS and ACWP/ETC) is tagged to a period, not a specific day. AI Narrative - Converts the project performance metrics to a sentence-based analysis. This report can be useful to the CAM et al to gain a perspective of what the current performance data and forecast data are reflecting. If this analysis indicates data to be in error, further steps are then taken to ensure the data is accurate and verifiable. 8/24/2017 EVM Practioner’s Forum 2017

Data Quality DQI Flags 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Drilling down into data quality issues using EVM DQI View and Data Quality Indicators Report DQI Issue 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Drilling down into data quality issues using IMS DQI View and Empower Gantt (G) View 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Using Schedule Assessment Report and Empower Gantt (G) View 11 of 14 DCMA metrics checked, not incl: 10 Resources 12 CP Test 13 CP Length Index 1 2 3 4 5 6 7 8 9 11 14 New 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Using Six Period DQI Trends Report 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Comparing EVMS dates with IMS dates using the EVMS / IMS Integration Report 8/24/2017 EVM Practioner’s Forum 2017

Data Quality AI Narrative used to analyze the WBS level 8/24/2017 EVM Practioner’s Forum 2017

Data Quality Multiple windows can be enabled at any time by the user to display a multitude of data elements and assist with their data analysis … this includes a selection of various Views, Charts and Reports. 8/24/2017 EVM Practioner’s Forum 2017

Corrective Actions DQI items identified by CAM/PC for near-term action to resolve are entered within Empower 8/24/2017 EVM Practioner’s Forum 2017

Corrective Actions Corrective Actions (VAR or Other) are monitored and tracked until closure. 8/24/2017 EVM Practioner’s Forum 2017

Corrective Actions A typical Corrective Action might move through the Action Item System workflow as follows: Submitter “Creates” and saves an action item Submitter edits the action item and saves it Submitter “Submits” the action item Reviewer “Rejects” the action item for noted reason Submitter edits the action item, saves, and “Submits” it again Reviewer “Approves” the action item Finally, the approver “Approves” it. Similar to VAR Narrative, a Corrective Action will generate notifications commensurate with the established roles assigned each Submitter Reviewer Approver 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis CAMs use Empower to conduct thorough analysis on how their responsible CA effort has been performing and the forecasted EAC Initial focus should be to begin at the CA level and drill down to the lowest WP levels and breakdown the variances … 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis JUICE-UVS Example – CA Mechanical Earnings (P) much lower than planned (S) and actuals (A) Sort CA Filter 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis Current period and cumulative variances at the WP level are where the analysis must be performed to identify SV schedule drivers and root causes for CV 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis Cost Variances (cC) require further definition by drilling down into the contributing WPs to determine root cause. For CV on Labor we use the RateVar and EffVar data fields to disseminate root cause … In this highlighted example the RateVar can be attributable to using average rates for budget vs. actual rates being charged. The EffVar (volume) paints a vivid picture of more hours charged than planned. 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis CV driven by labor EOC continues to trend downward over time … 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis By drilling down to the WP levels we can identify quickly the primary contributors to the cost variance 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis CAM must also review the IMS to grasp the schedule performance with its activity accomplishments and slips, logic, EVTs, critical and driving paths 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis SPI Analysis … 8/24/2017 EVM Practioner’s Forum 2017

Data Analysis CAMs review of forecast data 8/24/2017 EVM Practioner’s Forum 2017

VAR Narratives – Level 2 (CAMs)
Once the CAM has performed the data analysis, the VAR narrative writing effort is initiated for Control Account level 2 to facilitate the generation of the IPMR Format 5 Required VARs 8/24/2017 EVM Practioner’s Forum 2017

Once the CAMs have been sent notification and granted access to the current reporting period data, the CAMs are: Obliged to move forward in an expeditious manner Develop their required VAR narratives Initiate any associated corrective actions Submit their VAR narratives to the PM for review and approval 8/24/2017 EVM Practioner’s Forum 2017

CAM can elect to Copy Forward the previous period VAR narrative in which to change/augment as needed for current reporting Data Variables use current period values Can be invoked by any user (CAM or PM) for their respective CA or Project level VAR. Required VARs 8/24/2017 EVM Practioner’s Forum 2017

At the CA level 2, the VAR Narrative Editor “Section” selections are in accordance with the DID (DI-MGMT-81861) Applies the required Subject elements commensurate with the selected CA variances. This CA example reflects all of the applicable Subject items requiring a VAR (SC) … 8/24/2017 EVM Practioner’s Forum 2017

VAR Corrective Actions are identified initially in a summary manner within a given Cause and or Impact narrative statement These VAR corrective Actions should also be captured within the Empower Action Item system for recordation, and tracking by all pertinent stakeholders (CAM, PM/DPM, PC) until closure is attained 8/24/2017 EVM Practioner’s Forum 2017

VAR corrective Actions are also embedded within the IPMR Format 5 VAR reporting to the Client/ Customer until closure is attained. VAR Corrective Action 8/24/2017 EVM Practioner’s Forum 2017

VAR Narratives – Level 1 (Project)
At the Project level 1, the VAR Narrative Editor “Section” selections are in accordance with the DID (DI-MGMT-81861) PM or DPM will write the VAR narratives for each of the Project level Sections shown here Final closeout these narratives will follow approval of the CAM narratives 8/24/2017 EVM Practioner’s Forum 2017

VAR Status & Tracking Current state of each of the required VAR narratives can be monitored to afford users visibility into this time-constrained process and manage progress accordingly 8/24/2017 EVM Practioner’s Forum 2017

VAR Review & Approval Roles are establish at Project setup to assign each User roles which will dictate their subsequent access and responsibilities within Empower’s VAR Narrative approval workflow CAMs are assign Narrative and Action Roles as “Submitter” PM/DPM and PC are assigned “Approver” Roles notifications are initiated and sent to recipients 8/24/2017 EVM Practioner’s Forum 2017

Formal Reporting (IPMR)
Following the review and approval of all required VARs (level 2 & 1), the IPMR (Formats is ready to be finalized EACs (Best/Worst/Most Likely) are be updated for Format 1 (Box 6(1)a-c) All contract required Formats are reviewed one final time by PM/DPM Reports F1-4 and Narratives (F5) are then exported at level 2 (CA reporting level), signed, scanned (PDF), and submitted w/XML file to Client/Customer. 8/24/2017 EVM Practioner’s Forum 2017

8/24/2017 EVM Practioner’s Forum 2017

Questions … 8/24/2017 EVM Practioner’s Forum 2017

EVM Practitioners’ Forum 2017 Workshop: Empower – Program Performance Assessment and Data-Driven Audits on a NASA Program Presenters: Gary Troop – Encore.

Similar presentations

Presentation on theme: "EVM Practitioners’ Forum 2017 Workshop: Empower – Program Performance Assessment and Data-Driven Audits on a NASA Program Presenters: Gary Troop – Encore."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

EVM Practitioners’ Forum 2017 Workshop: Empower – Program Performance Assessment and Data-Driven Audits on a NASA Program Presenters: Gary Troop – Encore.

Similar presentations

Presentation on theme: "EVM Practitioners’ Forum 2017 Workshop: Empower – Program Performance Assessment and Data-Driven Audits on a NASA Program Presenters: Gary Troop – Encore."— Presentation transcript:

Similar presentations

About project

Feedback