1. Coverage of exercise tasking and quality of solution (30 Points)
Practicum 1-3 Presentation Grading Rubric - 50 Points Possible
Coverage of exercise tasking and quality of solution (30 Points)
25-30
18-24
up to 17
o All charts readable, clear and concise; transitions between subjects smooth and well managed o All areas addressed to the depth required by exercise tasking and included unique, accurate insight into the impact of the issue relationships beyond those described in the student material. o No significant errors of fact of any type o All information on charts/ deliverables is consistent with information given in the scenario and marching orders.
o Most charts readable, clear and concise; transitions between subjects smooth and well managed o All information on charts/deliverables is consistent with information given in the scenario and marching orders. o One area in exercise tasking not addressed to the depth required by the exercise tasking and/or; o Up to two errors of fact that only minimally affected results, recommendations, conclusions or supporting rationale.
o Several charts unreadable, not clear or too wordy; some awkward transitions o More than two exercise areas omitted or not addressed to the depth required by the exercise tasking o One or more errors of fact that are inconsistent with information given in the scenario and materially affects results, recommendations, conclusions or supporting rationale
Presenter Knowledge of Subject Matter (20 Points)
15-20
10-14
up to 9
o Briefer demonstrates exemplary knowledge of subject matter (as described in the module TLOs and ELOs), demonstrating solid command of student materials. o Briefer adds additional insight other than what is just on the slides and o Answers questions intelligibly and consistent with information provided in the scenario
o Briefer demonstrates competent knowledge of subject matter, with one or two areas of inadequate familiarity with student materials and prerequisite knowledge. o Briefer adds no additional knowledge to what is on the slides. o Has difficulty answering questions with no more than one answer that is contradictory to information provided in the scenario
o Briefer demonstrates unsatisfactory knowledge of most subject matter and inadequate familiarity with student materials and prerequisite knowledge. o Briefer shows 1 or more slides without briefing them. o Unable to answer two or more questions or answers given are contradictory to information provided in the scenario.

2. PRACTICUM 1 SCORE SHEET
Coverage of exercise tasking and quality of solution (30 Points) - See Overall Rubric (Tab 1) & P1 Answer Template
Section 1
Score
Section 2
Section 3
Section 4
Section 5
Name
1. Accurately describes JRATS
1. Correctly describes the ADM and what the MDA approved
1. Correctly answers the questions concerning the JROCM analysis
1. Correctly depicts the JTAMS organizational structure
1. Identifies the Acquisition approach for JTAMS by increment
2. Accurately identifies current status
2. Correctly describes the AoA and what the MDA directed
2. Accurately identifies the KPP's and KSA's
2. Accurately identifies the JTAMS IPT structure and recomends changes/additions
2. Accurately summarizes the 6 Acq models and identifies which are suitable for JTAMS
3. Accurately describes JTAMS
3. Correctly identifies the LRATS SW Architecture
3. Describes the areas where the IT box can and cannot be used
3. Correctly identifies the major risks for the four JTAMS sub-systems
3. Correctly identifies and describes the model appropriate for JTAMS
4. Describes the purpose and provides an overview of the ASR
4. Identifies what the AoA recommended
4. Correctly identifies the data required for the IT Box
5. Describes the JART ICD
6. Provides an overview of JTAMS required capabilities including the OV-1
Total
Average
Presenter Knowledge of Subject Matter (20 Points) - See Overall Rubric (Tab 1)
Comments
Total Student Score
Section 6
Section 7
Section 8
Section 9
Section 10
1. Introduces the 2d half of the practicum
1. Correctly identifies the 11 CCA compliance actions and the status of JTAMS CCA documentation
1. Identifies and explains information needs, categories, and measurable concepts
1. Identifies the purpose of the TEMP and identifies the capabilities and interfaces to be tested in the JTAMS system
1. Describes the various aspects of the LCSP
2. Accurately identifies the cost estimate and POM submission data to include mgmt reserve - for all JTAMS sub-systems
2. Identifies the requirement for the PPP
2. Provides an overview of the ICM table
2. Identify the requirement for the SEP
2. Identifies the appropriate LCSS and provides appropriate rationale for the selection
3. Correctly summarizes the JRATS PPP guidance and the PM JTAMS responsibilities
3. Identifies the information needs and rationale for the JTAMS system
3. Identifies the JTAMS SW Architecture
3. Describes the identified aspects of the IT BCA
4. Identifies the requirement for the Cyber annex
4. Identifies the JTAMS WBS and the appropriate reference
4. Provides an appropriate summary of JTAMS readiness for Milestone A

3. PRACTICUM 2 SCORE SHEET
Coverage of exercise tasking and quality of solution (30 Points) - See Overall Rubric (Tab 1) & P2 Answer Template
Section 1
Score
Section 2
Section 3
Section 4
Section 5
Name
1. Accurately describes the purpose and entrance/exit criteria for PDR
1. Identifies the purpose of the JTAMS/MRES RDP
1. Correctly describe the purpose of Title 40/CCA at Milestone B
1. Identify PAMS Risk, impact and mitigation plan
1. Reviews and presents the information needs identified in Practicum 1
2. Accurately identifies purpose and other aspects of SSR
2. Describes the JTAMS RDP required capabilities
2. Identifies if Is JTAMS is subject to Time Certain Development?
2. Identify OBD Risk, impact and mitigation plan
2. Identifies additional information needs for the TMRR Phase
3. Accurately describes SSR entrance criteria
3. Correctly describes the MRES SW architecture
3. Describe the status of each of the critical IT items on the Title 40/CCA. (11)
3. Identify Juggernaut Risk, impact and mitigation plan
3. Identifies a measurable concept, the base measure, and the measurement methods
4. Describes SSR exit criteria
4. Identifies the details of the NR KPP and the the availability and maintainability KPP's
4. Summarize how the FAR reinforces the CCA requirement to “Maximize 1) Modular Contracting
4. Identifies how the measurement indicator would be presented to decision makers
5. Identifies and provides recommendation for the JTAMS SSR approach
5. Describes the impacts of the KPP's on MRES development
5. Identifies how the JTAMS AS supports the modular requirement
6. Provides valid rationale for recommendation
Total
Average
Presenter Knowledge of Subject Matter (20 Points) - See Overall Rubric (Tab 1)
Comments
Total Student Score
Coverage of exercise tasking and quality of solution (30 Points) - See Overall Rubric (Tab 1) & P1 Answer Template
Section 6
Section 7
Section 8
Section 9
Section 10
1. Identifies when the CDD-VD occurs and briefly describes its purpose and importance
1. Identifies when the Development RFP Release Decision Point occurs and briefly describe its purpose and importance
1. Computes the EMD costs for MRES and updates the total JTAMS cost
1. Describes the contents of the Information Support Plan (ISP), how the ISP can be used.
1. Identifies the purpose of the JTAMS PPP and the key JTAMS players
2. Identifies the JTAMS Status Reporting requirements that have changed (to include impacts)
2. Identifies the JTAMS Open Architecture requirements that have changed (to include impacts)
2. Provides the updated JTAMS-MRES Cost Estimates for V-Robotics and Robots-R-Us
2. JTAMS Communities of Interest (COI) and ISP approval authority
2. Identifies the appropriate program CPI and any Critical Functionality issues and provides the final assessment regarding CPI and CF?
3. Identifies the JTAMS Video Replay requirements that have changed (to include impacts)
3. Identifies the JTAMS Security requirements that have changed (to include impacts)
3. Makes an appropriate recommendation on vendor selection
3. Identifies the Joint Functional Areas JRATS addresses and the risks and issues?
3. Describes control AC-6 and the role of the related controls identified with AC-6
4. Identifies the JTAMS Secure Transmission capabilities and requirements that have changed (to include impacts)
4. Identifies the JTAMS Life-Cycle Logistics Support Data requirements that have changed
4. Identify the responsibilities of the Program Manager and the fundamental question with respect to Open Systems
4. Explains how implementing AC-6 and the related controls could be important to the overall security architecture of JTAMS.
5. Identifies the 5 Fundamental Principles of OSA
5. Describe one of the controls as it might apply to Need-lines 5 and 6
6. Provide a readiness assessment for SFR, SSR, PDR and Milestone B?

4. PRACTICUM 3 SCORE SHEET
Coverage of exercise tasking and quality of solution (30 Points) - See Overall Rubric (Tab 1) & P3 Answer Template
Section 1
Score
Section 2
Section 3
Section 4
Section 5
Name
1. Accurately describes the purpose of the Critical Design Review (CDR)
1. Describes the requirement to develop an IP Strategy, what goes into the strategy, and when it is updated.
1. Reviews the set of measures and completes Worksheet #1.
1. Identifies the Government Software Quality Performance Statement (Goals of Program)
1. Identifies Interface Management Risk, impact and mitigation plan
2. Accurately identifies CDR Timing/Entry Criteria
2. Recommends the contract version that best addresses the data rights area and explain the recommendation.
2. Completes the integrated analysis. Perform a causal analysis to identify root causes and underlying problems
2. Determine the Award Fee Area for Section H.6.2, H.6.3, and H.6.4 based on the criteria listed
2. Identifies Programming Languages Risk, impact and mitigation plan
3. Accurately describes PM JTAMS SITUATION with respect to CDR
3. Identifies the government needs for Government Purpose Rights (GPR) for the real-time engine and explains what risks the Government would incur
3. Provides a summary for the two or three major issues, describing the problems, impacts, risks, potential outcomes
3. for Section H.6.5, identifies Award Fee Area based on the Government Software Quality Goals
3. Identifies CMMI Certification risks, impact and mitigation plan
4. Describes what the completion of the systems-level CDR provides
4. Explains the Government’s rights under “Restricted Rights”, Government Purpose Rights , and Unlimited Rights
4. Provides feasible alternatives given the analysis
4. Fills in the Award fee table weights for Contract Performance Period 1 and Contract Performance Period 2 and explains the rationale
4. Provides the Government assessment of readiness for CDR
5. Identifies three key general questions appropriate for the CDR
5. Questions the assertion of Restricted Rights, and list the documents to request from Juggernaut to substantiate the assertion
6. Identifies three key requirements management questions appropriate for the CDR
6. Recommends options for the PM and identify the one you select as the best option
Total
Average
Presenter Knowledge of Subject Matter (20 Points) - See Overall Rubric (Tab 1)
Comments
Total Student Score
Coverage of exercise tasking and quality of solution (30 Points) - See Overall Rubric (Tab 1) & P1 Answer Template
Section 6
Section 7
Section 8
Section 9
Section 10
1. Introduces the 2d half of the practicum
1. Present and explains the program Work Breakdown Structure (WBS)
1. Provides an overview of AMRU’s approach to software development and explains AMRU’s expected benefits or rationale for using this approach
1. Describes V-Robotics position regarding the development of the Real-Time Engine and Provides Juggernaut’s assessment of their ability to develop the engine internally
2. Identifies the purpose and who produces the Software Development Plan
2. identifies and describes Software Item(s) needed to satisfy MRES functionality
2. Shows the updated JTAMS schedule including the STM schedule and discusses the implications of the STIM schedule with respect to CDR
2. Develop an approach for how JUGGERNAUT plans to achieve the Risk Management proposed award fee criteria.
2. Explains Juggernaut’s assessment of Option 4 in the contract (Part 1 Section B)
3. Identifies Software Development Plan table of contacts
3. identifies and describes Software Item(s) needed to satisfy PAMS functionality
3. Answer the questions concerning AMRU’s approach to development
3. Develop an approach for how JUGGERNAUT plans to achieve the Configuration Management award fee criteria.
3. Recommends alternatives for the Juggernaut and Government PMs and provides an assessment of Risk to Juggernaut and to JTAMS in terms of cost, schedule, performance of the MRES. Identifies their preferred option
4. Describes four approaches for Software Development and identify which approach(es) are being used in the JTAMS program
4. identifies and describes Software Item(s) needed to satisfy OBD functionality
4. Assess the risks AMRU has identified. Using the risk management cube methodology, identifies 2 additional risks to JTAMS as a result of AMRU's software development approach
4. Develop an approach for how JUGGERNAUT plans to achieve the Interface Controls award fee criteria.
4. Provides the Juggernaut's assessment of readiness for CDR
5. Provides an overview of the MRES Software development architecture
5. identifies and describes Software Item(s) needed to satisfy THS functionality
5. Using the cumulative flow diagram contained in AMRU's release report, identify the work completed, work in progress and the work remaining on 8/1/02
5. Develop an approach for how JUGGERNAUT plans to achieve the Formal Inspections award fee criteria and the H.6.5 criteria.

5. PRACTICUM 4 SCORE SHEET
Coverage of exercise tasking and quality of solution (40 Points) - See Overall Rubric (Tab 1) & P4 Answer Template
Exercise 1
Score
Exercise 2
Exercise 3
Exercise 4
Exercise 5
Team
1.Present an overview of the schedule and identify any updates to the overall JRATS/JTAMS scenario
1. Provides a measurement assessment given the key indicators. Include Earned Valus, SW Staffing, Code progress, defect density, problem reports, requirement volatility, interface status, and open action items
1. Describe the purpose of the Production Readiness Review (PRR); identify the focus areas from the Overall Scenario for Exercise 3
1. Provide a brief overview of the scenario
1. Provides an overview (Executive Summary) of the overall scenario and the exercise requirements to include the presentation overview.
2.Discuss how the AMRU contractor addressed post-CDR challenges such as requirement changes, interfaces, availability of resources (hardware, COTS, other modules)
2. Provide recommendations in each of the areas (Earned Valus, SW Staffing, Code progress, defect density, problem reports, requirement volatility, interface status, and open action items
2. Assesses AMRU’s current Agile development approach and determines which aspects are in keeping with a lean approach. Recommend areas where AMRU might benefit from investigating additional Lean concepts.
2. Provides an overview of the assigned “IT” areas to include a brief description of the intent of each area.
2. Provides an overview of the program Cloud transition requirements to include an explanation of the requirements, key terminology, and any derived requirements you anticipate.
3.Assess AMRU’s risks. Did the risks you identified in Practicum 4 change?
3. Present and explain the key appropriate indicator slides that justify your assessments
3. Analyzes the wave soldering defect data, suggest the root cause(s) of the problem(s) and recommend solutions; Identifies the increased cost if the full-production run (up to FOC) is carried out at the 2 sigma level versus the 6 sigma level.
3. Provides specific OSA questions to be added to the BCA checklist to support the PEO/PM’s BCA effort
3. Compare/contrasts the capabilities of the two cloud service providers and include an assessment of the capabilities of the providers to satisfy JTAMS requirements. Explains and/or justifies the assessment and provides an overall recommendation based on this comparison.
4.Using the Cumulative Flow Diagram, explain what happened in April and May FY03.
4. Summarize the analysis to include problems, impacts, and outcomes
4. Answers the questions and assesses the SW development environment (integrated information) and procedures and provides justification and suggested resolution
4. Provides Software Engineering and Software Development Environment questions to be added to the BCA checklist to support the PEO/PM’s BCA effort
4. Identifies 3 risks to the program (based on the requirements and capabilities provided). Presents risk statements for the three risks and present the risks using a risk cube.
5.Explain the defect closure measurement. Does it correlate with the other measurements? Why or why not?
5. List the alternative courses of action for the program and justify the recommendations
5. Answers the questions and assesses the SW development environment (team performance) and procedures and provides justification and suggested resolution
5. Identifies/recommends specific Software Security Architecture and Software Assurance questions/items to be added to the BCA checklist to support the PEO/PM’s BCA effort to include the rationale
5. Provides an overall exercise summary/conclusion/recommendation
6.Does the summary present an accurate description of the program? Why or why not? Is anything missing from the summary?
6. Provides the PRR status roll-up and offers appropriate recommendations.
7. Compares/contrasts the AMRU approach with the Lean/Agile article; recommends areas where AMRU and/or Juggernaut might benefit from investigating additional Lean concepts
Total
Average and Team Score

6. DISCUSSION PANEL SCORE SHEET
Coverage of Subject Matter and Team Knowledge of Subject Matter (40 Points) - See Overall Rubric (Tab 1)
Cyber
Score
Cloud
SW Dev / Quality
SW / SYS ENG
Emerging Tech
SW Support
Team Members
KNOWLEDGE
ELO: Identify the basic concepts, threats, and best practices associated with cybersecurity in the DoD. Exceeds information in the course material for the ELO (36-40) Primarily covers course material for the ELO with little elaboration (25-35) Does not even cover the content commensurate to what was presented in the course pertaining to the ELO and/or basic concepts. (10-24)
INSIGHT
Adds significant insight and answers questions intelligibly (36-40)or moderate additional insight and /or minor difficulty with questions (25-35) or No additional insight and has major difficulty answering questions (10-24)
PRESENTATION
presents the material in a professional and innovative way, leverages technology, and is "fun" (36-40) or Professional, stimulates discussion, leverages technology, and is informative (25-35) or Standard presentation that does not stimulate discussion (10-24)
Total
Average and Team Score

7. Class Exercise Participation Exercise Presentation Opportunities
Coverage of exercise and quality of solution (10 Points) 10
6-9
0-5
All areas addressed to the depth required by exercise tasking and included unique, accurate insight into the impact of the issue relationships beyond those described in the student material.
All information on charts/deliverables is consistent with information given in the exercise information and one area in exercise tasking not addressed to the depth required or only error of fact that only minimally affected results
More than two exercise areas omitted or not addressed to the depth required by the exercise tasking or one or more errors of fact that are inconsistent with information given and materially affects results,
Presenter Knowledge of Subject Matter (10 Points)
Briefer demonstrates exemplary knowledge of subject matter (as described in the module TLOs and ELOs), demonstrating solid command of student materials.
Briefer demonstrates competent knowledge of subject matter, with no adequate familiarity with student materials and prerequisite knowledge.
Briefer demonstrates unsatisfactory knowledge of most subject matter and inadequate familiarity with student materials and prerequisite knowledge.
This allows you one method of grading the students level of participation. Students are not required to present during an exercise presentation. However, by volunteering to present one of the exercises, the student can demonstrate that they are an active team and class participant. This can also be used to augment the overall Contribution approach to assessing student participation.
Exercise Presentation Opportunities
Week 1
Week 2
3 - Cost Estimating
12 – Design Considerations
5- Measurement
21 - Cloud Computing
8 - Cybersecurity
15a - SW Quality
10 - Risk Management
19 – Software Support

8. 0-11 Points 12-19 Points 20 Points
This method of assessing student participation provides the instructors with some guidelines for evaluating the individual participation of students across the two weeks of the course. Student contribution can vary by topic, etc and not all students will contribute consistently across the 2 weeks. This method can be used in conjunction with the Exercise participation method to provide an overall assessment.
0-11 Points
12-19 Points
20 Points

9. FRONT 4 1 5 2
Note: During introductions I write in the names of the students where they are seated. I then use this chart for tracking whether or not the student has presented both a practicum (P1, P2, etc) and an Exercise (E) by putting a letter by their name. 3
For student seating and keeping track of Practicum and Exercise presentations