1. Thomas L. Gilchrist tomg@tomgtomg.com Testing Basics Set 6: Use Cases, Audits, and Meetings By Thomas L. Gilchrist, CSQE, CSQA 2009

2. Thomas L. Gilchrist tomg@tomgtomg.com Tonight... Homework Review Audits Meetings and Brainstorming Terms and Definitions Text Book Final Exam Questions

3. Thomas L. Gilchrist tomg@tomgtomg.com Software Quality Assurance Check software products and processes to verify that they comply with the applicable procedures and standards. (Audits) Review and measure the quality of software products and processes throughout development. (Peer Reviews & SW Testing) Provide software project management (and other appropriate parties) with the results of reviews and process checks. (Monthly Metrics) Work with the software project during early stages to establish plans, schedules, standards, and procedures to keep errors from occurring in the first place. (Audit, Testing & Peer Review Schedules)

4. Thomas L. Gilchrist tomg@tomgtomg.com Audit Process Software Quality Assurance is to provide management with appropriate visibility into the process being used by the software developers and of the products being built. Determine: Compliance to requirements Conformance to policies, procedures, and standards Adequacy of policies, procedures, and standards Effectiveness and efficiency of policies, procedures, and standards Assess personnel familiarity to requirements and documentation Assure availability, use and adherence to software standards

5. Thomas L. Gilchrist tomg@tomgtomg.com Types of Audits First PartyFirst Party subject of this class –These are PC performed internally by the organization (subject of this class) Second PartySecond Party –These are PCs performed by an interested party -Company auditing suppliers -Customers auditing company Third PartyThird Party –These are PCs performed by a disinterested party -Regulatory Agencies -Consultants

6. Thomas L. Gilchrist tomg@tomgtomg.com Audit Process Un- satisfactory Report? OK NO YES Produce Product Corrective Actions Audit Kickoff Meeting Develop Audit Checklist Conduct Audit DevelopersAuditor & Project Manager Write-up Report & Findings Auditor Identify Requirements Follow-up Audit Re-Work Close Audit & File END Start Review with Manager

7. Thomas L. Gilchrist tomg@tomgtomg.com Functional vs. Quality Requirements Functional: Ascertainably True or False by any one skilled person. –The number of CRs created from 1/2/04 to 2/10/04 –Number of floors in a building –What was the date of the approval of CR #12118 by the change board? –Was the 490.3 deliverable approved before production? Quality: A range of acceptable values. Depends on context or perspective of the assessor. No one person is likely to give the same results. –Was PR #12118 of high quality? –Was the 490.3 correct?

8. Thomas L. Gilchrist tomg@tomgtomg.com Fire Extinguishers 7-101 7-102 7-103 What is the question? How do you collect evidence? How do you come to a determination? Policy 1.1: There will be a fire extinguisher on every floor of all buildings.

9. Thomas L. Gilchrist tomg@tomgtomg.com Audit Checklist AuthorityChecklist ItemDetailsObservationPass/Fail Test Plan ver 3.1 Page 7 Were PRs marked for regression tested before moving code into the next environment?

10. Thomas L. Gilchrist tomg@tomgtomg.com Meetings

11. Thomas L. Gilchrist tomg@tomgtomg.com Meetings Why are meetings bad? Why are meetings good?

12. Thomas L. Gilchrist tomg@tomgtomg.com Brain Storming

13. Thomas L. Gilchrist tomg@tomgtomg.com Brainstorming Everyone talks about it, few organizations actually do it.

14. Thomas L. Gilchrist tomg@tomgtomg.com Brainstorming Rules Record ALL ideas on a flipchart Encourage everyone to freewheel- don’t hold back any ideas No discussion, no judgement, and no criticism is allowed during idea generation. Record ideas in the language used by participants- do not edit Encourage everyone’s participation

15. Thomas L. Gilchrist tomg@tomgtomg.com Brainstorming Steps Define the subject to be brainstormed in a complete sentence. Review brainstorming rules Select a scribe Give everyone a minute or two to think about the question Invite everyone to call out ideas- or go around in turn After time is up, clarify and evaluate