A Tailorable Software Process Mini-Assessment Method SEPG ‘99 Conference Diane L. McDonald Carol A. Pilch GTE Government Systems Government Systems

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 2 Agenda Background Mini-Assessment Approach Comparison (formal assessment vs. mini-assessment) Results and Lessons Learned Conclusion

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 3 Background Achieve goals of GTE’s Corporate Quality Initiative Provide an efficient appraisal technique Reduce cost and resource impact De-emphasize ratings Focus on needed improvements

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 4 Approach Utilize key elements of SEI’s CMM SM Based Appraisal for Internal Process Improvement (CBA IPI) method Select experienced assessment team members Tailor based on the organization –Experience/status in process improvement –Sponsor’s objectives Evaluate and mitigate tailoring risks Utilize reusable assessment assets Refine Mini-Assessment process using lessons learned

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 5 CBA IPI vs Mini-Assessment Comparison Resources –team members ( hours vs hours) –participants (2-4 hours vs. 1-2 hours) Pre-onsite schedule (2-3 months vs. 3-4 weeks) Onsite schedule (7-10 days vs. 3-5 days) Team training (3 days vs. 3-4 hours) Formality (formal vs. informal plans & briefings) Outputs (strengths, weaknesses, & ratings vs. primarily weaknesses, no ratings)

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 6 CBAIPI & Mini-Assessment Comparison Pre-Onsite Activities Identify Scope/ Develop Plan Brief Asmt. Participants Conduct Initial Doc. Review Complete/Exam. MQs Assemble Site Packet Complete/Exam. MQs Conduct Initial Doc. Review GTE Mini-Assessment CBA IPI Prepare & Train Team Develop EQs Identify Scope/ Develop Plan Develop EQs EQs=Exploratory Questions MQs=Maturity Questionnaires Conduct Exec Briefing

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 7 Tailoring Options & Risks Pre-onsite Activities PLs=Project Leads FARs=Functional Area Reps

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 8 CBAIPI & Mini-Assessment Comparison Onsite Activities Conduct Opening Mtg. Prep. Draft Findings Consolidate Info Pres. Draft Findings Consolidate Info Interview MMs GTE Mini-Assessment CBA IPI Interview PLs Interview FARs Consolidate Info Consol/Rate/Prep Final Findings Conduct Exec Mtg./Wrapup Pres. Final Findings Prep. Draft Findings Consolidate Info Interview MMs Interview PLs Interview FARs Pres. Final Findings Prepare & Train Team Conduct Opening Mtg. Conduct Exec Mtg./Wrapup MMs=Middle Mgrs.

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 9 Tailoring Options & Risks Onsite Activities

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 10 Tailoring Options & Risks Onsite Activities (cont.)

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 11 Reusable Assessment Assets Mini-Assessment schedule Mini-Assessment planning/preparation checklist Consolidation tools (KPA worksheets) Document indexes Briefing templates Sample EQs (various interview groups) Sample findings * * * * * Refer to handouts

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 12 Results & Lessons Learned Well-defined process based on CBA IPI activities Flexibility to address specific sponsor and organization objectives Accurate results with strong organization buy-in Focus on weaknesses relative to CMM key practices Small teams (4-6) Balance site knowledge and CBA IPI method experience

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 13 Conclusion Using this scaled-down assessment approach based on the CBA IPI, GTE has accelerated software process improvement –stronger buy-in due to frequency and visibility –credibility/demand due to accurate results and efficiency –insight into common pitfalls/trends –consistency and sharing of best practices –pilots to improve CBA IPI efficiency Accurate results provide input to plans that keep organizations on track

SEPG 1999 Conference D. McDonald & C. Pilch Government Systems 14 Contact Information Diane McDonald GTE Government Systems 100 Ferguson Drive Mountain View, CA Carol Pilch GTE Government Systems 77 A Street Needham, MA