1. Schedule Analysis: 14 Point Assessment

2. Schedule Analysis Metrics
The 14 Point Assessment is recommended for performing an objective and thorough analysis of the IMS
Provides a consistent, agency-wide approach to schedule analysis
Provides a catalyst for constructive discussions between the contractor and DCMA
Provides a baseline for tracking IMS improvement over time
Utilizes proven metrics that have been successfully implemented on several different programs
Includes two major OSD Tripwire metrics 14 2

3. The 14 Point Assessment 14 TRIP WIRE METRICS
The 14 Point Assessment Metrics:
Logic
Leads
Lags
Relationship Types
Hard Constraints
High Float
Negative Float
High Duration
Invalid Dates
Resources
Missed Tasks
Critical Path Test
Critical Path Length Index (CPLI)
Baseline Execution Index (BEI) 14
TRIP WIRE METRICS 3

4. Useful to track maintenance in a growing/evolving schedule
Schedule Statistics
Prior to performing the 14 point assessment, some basic schedule statistics must be calculated
The statistics include:
Total Tasks
Complete Tasks
Incomplete Tasks
Baseline Count
The statistics do not indicate anything about the technical structure of the IMS or the supplier’s ability to plan the work and work the plan
Useful to track maintenance in a growing/evolving schedule 4

5. “Total Tasks” are the lowest level discrete tasks
How do I identify them?
Tasks that are not any of the following:
Summary Task or Subproject task
An Earned Value Type of Level of Effort
Zero duration tasks or Milestones (Start / Finish)
Primavera
Summary tasks are often called “Level of Effort” in Activity Type by definition
Designation of LOE in Earned Value Type could be “LE” or “Level of Effort EV”
The column for duration is called At Completion Duration
MS Project
There is a column for Summary with a Yes or No
There is a column for Duration
Talk with scheduler to determine the EV Methd column in IMS
Open Plan
Summary tasks are called “Subproject” in Activity Type
A task can be considered a milestone and have a duration more than 0 or 1 days
The column for duration is called Original Duration
Make sure the student understands that if their contractor’s IMS does not have a specific column that specifies the Earned Value Technique be used for each of the tasks, then the default is to leave all of those tasks in the schedule (minus the Summary and zero duration tasks, of course)
Note for Primavera: “Level of Effort” or “subproject” in Activity Type – depending on which version of Primavera. Additionally, there may be a field called “hammock” depending on which version of Primavera is being used. Should filter on “hammock = no”.
Also, caution the student that a contractor’s IMS may designate tasks that are greater than 0 days duration as “Milestones”….in other words, if the Milestone field is inserted into the IMS – it may have a “Yes” in the Milestone field even though a task is greater than 0 days duration
Also, make sure the student understands that the EV Method (LOE, Discreet, etc) in MS Project is typically defined in a “text” column (i.e. “Text 6” in the ACME schedule)
“Total Tasks” are the lowest level discrete tasks 5

6. How many tasks have been completed?
Complete Tasks
How do I identify them?
Out of the “Total Tasks” count, all the tasks that are 100% complete
Has an Actual Finish date entered in the IMS that is prior to or on the IMS status date
Be sure that the Actual Finish date is not entered in the future
Primavera
There is a column for Actual Finish
MS Project
Open Plan
How many tasks have been completed? 6

7. How many tasks are not done yet?
Incomplete Tasks
How do I identify them?
Out of the “Total Tasks” count, all the tasks that are not 100% complete
Does not have an Actual Finish date entered in the IMS
Primavera
Actual Finish date is empty
MS Project
Open Plan
How many tasks are not done yet? 7

8. How many tasks were planned to be done by now?
Baseline Count
How do I identify them?
Out of the “Total Tasks” count, all the tasks that are baselined to finish on or before the IMS status date
Primavera
BL Project Finish date is on or before the IMS status date
MS Project
Baseline Finish date is on or before the IMS status date
Open Plan
Represents the number of tasks that should have been completed to date according to the original (baseline) plan
Used to calculate the Baseline Execution Index (BEI), Metric #14
How many tasks were planned to be done by now? 8

9. All Incomplete Tasks should be linked
Metric #1: Logic
How do I identify tasks that are missing logic?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And is missing a predecessor, a successor, or both
What are the benefits of this metric?
Helps identify how well or poorly the schedule is linked together
Even if links exist, the logic still needs to be verified by the technical leads to ensure that the links make sense 1
Primavera
Both the predecessor and successor fields should be filled, otherwise a task is missing logic
MS Project
Both the Unique ID Predecessors and Unique ID Successors fields should be filled, otherwise a task is missing logic
Open Plan
Both the Predecessors and Successors fields should be filled, otherwise a task is missing logic
1) The metrics will be performed on a real MS Project IMS that has been sanitized. The program name has been removed and replaced with the “ACME Artillery System” name. The same IMS will be used for each metric for the sake of consistency. There are plenty of problems in this real-world IMS.
How do I calculate the percentage of tasks that are missing logic?
[(# of Tasks missing Logic) / (# of Incomplete Tasks)] x 100 = %
The number tasks without predecessors and/or successors should not exceed 5%
All Incomplete Tasks should be linked 9

10. Leads may distort the critical path
Metric #2: Leads
How do I identify tasks that have leads (negative lags)?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And has a lead in its predecessor
What are the benefits of this metric?
The critical path and any subsequent analysis can be adversely affected by using leads. The use of leads distorts the total float in the schedule and may cause resource conflicts. Per the IMS DID, negative time is not demonstrable and should not be encouraged 2
Primavera
Visible only in individual task view – not as a column. Ask the program scheduler to extract this information for you
MS Project
The Unique ID Predecessors field, if filled, should not contain a lead (-23d, for example)
Open Plan
The Predecessors field, if filled, should not contain a lead (-23d, for example)
Note to the students that the method for counting the number of leads in the DEMO works for MS Project ONLY. Open Plan has the leads and lags in a separate column. Similarly, in Primavera, there are not =/- ‘s in the Pred Succ fields as shown in the embed. They only show up in each task’s relationship itself. It should be mentioned that it IS there, and we do have a way of getting it out of the tool, its just not easy, and requires a separate offline instruction for anyone who wishes to go down that path.
Primavera Note:
How do I document the findings of this metric?
Using MS Excel, count the number of “Leads” that are found
Leads should not be used; therefore, the goal for this metric is 0
Leads may distort the critical path 10

11. The size and frequency of lags should be minimized
Metric #3: Lags
How do I identify tasks that have lags?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And has a lag in its predecessor
What are the benefits of this metric?
The critical path and any subsequent analysis can be adversely affected by using lags. Per the IMS DID, lag should not be used to manipulate float/slack or to constrain the schedule 3
Primavera
Visible only in individual task view – not as a column. Ask the program scheduler to extract this information for you
MS Project
The Unique ID Predecessors field, if filled, should contain a minimal frequency of lags and the size of the lags should be minimal (< 5d)
Open Plan
The Predecessors field, if filled, should contain a minimal frequency of lags and the size of the lags should be minimal (< 5d)
How do I document the findings of this metric?
Using MS Excel, count the number of “Lags” that are found
The number relationships with lags should not exceed 5%
The size and frequency of lags should be minimized 11

12. Metric #4: Relationship Types
How do I identify the relationship types?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And has a predecessor
What are the benefits of this metric?
The Finish-to-Start (FS) relationship type (“once the predecessor is finished, the successor can start”) provides a logical path through the program and should account for at least 90% of the relationship types being used. The Start-to-Finish (SF) relationship type is counter-intuitive (“the successor can’t finish until the predecessor starts” – huh?) and should only be used very rarely and with detailed justification 4
Primavera
Visible only in individual task view – not as a column. Ask the program scheduler to extract this information for you
MS Project
The Unique ID Predecessors field, if filled, should display the relationship type (FS, SS, FF, SF)
Open Plan
The Predecessors field, if filled, should display the relationship type (FS, SS, FF, SF – or it may be spelled out completely)
How do I document the findings of this metric?
By counting the number of Start-to-Start (SS), Finish-to-Finish (FF), and Start-to-Finish (SF) relationship types, the % of Finish-to-Start (FS) relationship types can be calculated
The FS relationship provides a logical path through the program 12

13. Metric #5: Hard Constraints
How do I identify the constraint types?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And has any type of constraint applied
What are the benefits of this metric?
Using hard constraints [Must-Finish-On (MFO), Must-Start-On (MSO), Start-No-Later-Than (SNLT), & Finish-No-Later-Than (FNLT)] will prevent tasks from being moved by their dependencies and, therefore, prevent the schedule from being logic-driven
Soft constraints such as As-Soon-As-Possible (ASAP), Start-No-Earlier-Than (SNET), and Finish-No-Earlier-Than (FNET) enable the schedule to be logic-driven 5
Primavera
Be sure to check both the primary and secondary constraint for dates
MS Project
Check the Constraint Type field
Open Plan
Check the Target Start Type and Target Finish Type fields
How do I document the findings of this metric?
Divide the total number of “Hard Constraints” by the number of “Incomplete Tasks”
The number tasks with hard constraints should not exceed 5%
Hard constraints prevent tasks from being logic-driven 13

14. High Float may indicate an unstable network
Metric #6: High Float
How do I identify tasks with high float?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And total float is greater than 44 working days (2 months)
What are the benefits of this metric?
A task with total float over 44 working days may be a result of missing predecessors and/or successors.
If the percentage of tasks with excessive total float exceeds 5%, the network may be unstable and may not be logic-driven 6
Primavera
Total Float should be less than 44 working days
MS Project
Total Slack should be less than 44 working days
Open Plan
How do I document the findings of this metric?
[(# of Tasks w/ High Float) / (# of Incomplete Tasks)] x 100 = %
The number tasks with high float should not exceed 5%
High Float may indicate an unstable network 14

15. Metric #7: Negative Float
How do I identify tasks with negative float?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And total float is less than 0 working days
What are the benefits of this metric?
Helps identify tasks that are delaying completion of one or more milestones
Tasks with negative float should have an explanation and a corrective action plan to mitigate the negative float. 7
Primavera
Total Float should be greater than 0 working days
MS Project
Total Slack should be greater than 0 working days
Open Plan
How do I document the findings of this metric?
Divide the total number of tasks with “Negative Float” by the number of “Incomplete Tasks”
Ideally, there should not be any negative float in the schedule
Tasks with negative float should have a corrective action plan 15

16. Metric #8: High Duration
How do I identify tasks with high duration?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
And has a duration greater than 44 working days (2 months)
And has a baseline start within the detail planning period or rolling wave
What are the benefits of this metric?
Helps to determine whether or not a task can be broken into two or more discrete tasks rather than one
Helps to make tasks more manageable which provides better insight into cost and schedule 8
Primavera
At Completion Duration should be less than 44 working days
MS Project
Duration should be less than 44 working days
Open Plan
Original Duration should be less than 44 working days
Care should be taken to prevent the contractor from breaking larger tasks into smaller tasks simply to meet a threshold.
The default rolling wave boundary is 6 months for many suppliers
How do I document the findings of this metric?
Divide the total number of tasks with “High Duration” by the number of “Incomplete Tasks”
The number tasks with high duration should not exceed 5%
Tasks with high duration may be broken into two or more discrete tasks 16

17. Metric #9: Invalid Dates
How do I identify tasks with invalid forecast or actual dates?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And has a forecast start/finish date prior to the IMS status date
Or has an actual start/finish date beyond the IMS status date
What are the benefits of this metric?
A task should have forecast start and forecast finish dates that are in the future relative to the status date of the IMS (i.e. if the IMS status date is 8/1/07, the forecast date should be on or after 8/1/07)
A task should NOT have actual start or actual finish dates that are in the future relative to the status date of the IMS (i.e. if the IMS status date is 8/1/07, the actual start or finish date should be on or before 8/1/07…not AFTER 8/1/07!) 9
Primavera
Does not allow Early Start or Early Finish to remain in the past
MS Project
Early Start a/o Early Finish field dates should be in the future relative to the status date of the IMS
Open Plan
Note about Primavera: Early Start and Early Finish will not be in the future after statusing Primavera, but the supplier often creates user-defined code fields to update “Control Account Manager’s” best guess. If the columns are not labeled “Anticipated” or “Planned”, know your supplier and make sure you have determined what the proper field name is.
How do I document the findings of this metric?
There should not be any invalid dates in the schedule
Accurate dates are important for good program management 17

18. There should not be any resource issues in the IMS
Metric #10: Resources
How do I identify tasks with resources (hours/dollars assigned)?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is considered an “Incomplete Task”
What are the benefits of this metric?
Provides verification that all tasks with durations of at least one day have dollars or hours assigned
Note: some contractors may not load their resources into the IMS 10
Primavera
BL Project Total Cost field should not be empty for tasks with duration of at least one day
MS Project
The Baseline Work and Cost fields should not both be empty for tasks with duration of at least one day
Open Plan
Budget_At_Completion field should not be empty for tasks with duration of at least one day
Explain to the student that the Cost field can contain Material $$
Note about Primavera: many people create their own user-defined fields…so you need to know where the supplier houses their “work”
Note about Open Plan: the “Budget_At_Completion” field should total a combination of BAC labor, BAC material, BAC Other direct cost, and BAC subcontractor…however, you need to verify that this is how your supplier is using those fields or has he/she created customized user-defined fields to house that information?
How do I document the findings of this metric?
Divide the number of tasks without dollars/hours assigned by the number of “Incomplete Tasks”
There should not be any resource issues in the IMS 18

19. Measures performance compared to the baseline plan
Metric #11: Missed Tasks
How do I identify a missed task?
Any task that meets all of the following criteria:
Is considered a “Total Task”
And is supposed to be completed already (baseline finish date on or before the status date)
And if the actual finish date or forecast finish date (early finish date) is after the baseline finish date Or
Finish Variance is greater than zero
What are the benefits of this metric?
Helps identify how well or poorly the schedule is meeting the baseline plan 11
Primavera
BL Project Finish Variance field should not be greater than 0 days
MS Project
The Finish Variance field should not be greater than 0 days
Open Plan
Baseline Finish Variance % field should not be greater than 0%
1) Note about Open Plan: Positive finish variance % means they’ve missed the baseline…but if you want the number of days, you’ll need to create a customized user-defined field for “actual finish-baseline finish” as a calculated field (if it’s positive, then it’s a missed task)
How do I document the findings of this metric?
Divide the number of missed tasks by the “Baseline Count”
The number of “Missed Tasks” should not exceed 5%
Measures performance compared to the baseline plan 19

20. Metric #12: Critical Path Test
What is the objective of this test?
To assess the integrity of the overall network logic and, in particular,
the critical path
What are the benefits of this metric?
If the project completion date (or other milestone) is not delayed in direct proportion to the amount of intentional slip (600 days ~ 3 years) that is introduced into the schedule as part of this test, then there is broken logic somewhere in the network
Broken logic is the result of missing predecessors and/or successors on tasks where they are needed 12
Primavera
Enter “600 d” into the Remaining Early Finish field for an incomplete, critical task
MS Project
Enter “600 d” into the Remaining Duration field for an incomplete, critical task
Open Plan
Enter “600 d” into the Computed Remaining Duration field for an incomplete, critical task
1) The assumption here is that the final task in the critical path has ZERO float or less already. Even if the final task in the critical path has some positive float, changes to the float value of the final task and its Early Finish date will be clearly evident (due to the large 600d slip that is being applied).
How do I document the findings of this metric?
The IMS passes the Critical Path Test if the project completion date (or other task/milestone) shows a very large negative total float number or a revised Early Finish date that is in direct proportion to the amount of intentional slip (600 days in this case) that was applied
The final task in the critical path should slip one-for-one 20

21. Metric #13: Critical Path Length Index (CPLI)
What is the objective of the CPLI?
Measures critical path “realism” relative to the forecasted
finish date
What are the criteria of this metric?
Must first verify that the critical path makes sense and that enough of the schedule metrics have indicated that the critical path is “believable”
Critical path is always calculated from time now
Default forecast finish is “end of program”
Must be able to calculate total float
CPLI = Critical Path Length + Total Float
Critical Path Length 13
1) Explain to the student that the CPLI for the AAS program is 1.0 since there is no negative float and there is no positive float either even though the critical path length is inaccurate
How do I document the findings of this metric?
Target is "1.00“ with a threshold of “0.95”
Greater than 1.00 = favorable; Less than 1.00 = unfavorable
CPLI gauges the realism of completing the contract on time 21

22. Metric #14: Baseline Execution Index (BEI)
What is the objective of the BEI?
Measures the number of tasks that were completed as a ratio to those
tasks that should have been completed to date according to the original
(baseline) plan
What are the criteria of this metric?
Any task that meets the following:
Is considered a “Total Task”
Numerator of the ratio: Any task with an actual finish on or before the status date
Denominator of the ratio: Any task that has a baseline finish date on or before the status date
BEI = “Complete Tasks”
“Baseline Count”
Caution: In all scheduling tools, it is possible to enter an Actual Finish date AFTER the status date. However, it must be realigned for proper sequencing regarding statusing
Analogous to EV dollarized Schedule Performance Index (SPI) 14
How do I document the findings of this metric?
Target efficiency ratio is "1.00“ with a threshold of “0.95”
Greater than 1.00 = favorable; Less than 1.00 = unfavorable
BEI gauges the efficiency of contractor performance to plan 22