1. New Model for Testing @paul_gerrard Paul Gerrard paul@gerrardconsulting.com gerrardconsulting.com Programme Chair 2014

2. Agenda A New Model for Testing What does the Model imply with regards to skills? Where next?

3. Overview In this session, Paul will present a refined list of both technical and impersonal skills and map these to the capabilities that testers in the new world must have The goal of the session is to discuss and refine this list of skills and mappings to capabilities to create perhaps a new 'Tester Skills Manifesto'.

4. The old ways won't work in the future We need a New Model of Testing (free from logistics)

5. Forget Logistics (for the time being) Document or not? Automated or manual? Agile v waterfall? Planned v exploratory? This technology v that technology?

6. ALL Testing is Exploratory We explore sources of knowledge...... to build test models...... that inform our testing.

7. All Testing is Based on Models

8. Examples of models

9. Models are innate, essential, human

10. Judgement, exploring and testing Testing (the system) Our model(s) are adequate Our model(s) are not adequate Exploring (sources) Judgement Creates test models Uses test models We explore sources of knowledge to build test models that inform our testing BTW – Do Developers explore the same way? I think so.

11. Exploration process Exploration Definitions specs/stories People (& you) Sources Require- ments Test Models Enquiring Challenging Sources: People, documents, experience, system under test Modelling Test Models: Can be documented or mental models Predicting System under test

12. Testing process Testing System Under Test Refining Informing Applying Interpreting Test Models Revise the System Logging Revising More exploring Reporting

13. New Model Testing Paper: http://dev.sp.qa/download/newModelhttp://dev.sp.qa/download/newModel

14. Consequences of the model ALL technologies, methods and logistics Aligns with/supports (tentatively): – Waterfall, Agile, Continuous Delivry, TDD/BDD etc. – The Context-Driven View – Functional, (Possibly all) Non-Functional types A different perspective on: – "Testing v Checking" – Developer Testing, Embedded Testers, Shift Left – Test automation – Skills, capabilities and Certification

15. Capabilities Enquiring, Modelling, Predicting, Challenging Informing, Applying, Interpreting, Refining Reporting and Logging

16. Some Possible 'Structures' for Capabilities and Skills

17. New Model and Skills The 'New Model suggests that the core skills of testers are somewhat different – Somewhat different to those promoted by 'thought leaders' – Very different to those promoted by the certification schemes Of course interpersonal skills are, perhaps, the most critical.

18. Analysis, enquiry and elicitation Modelling Creation of custom models, using heuristics, guesses, brainstorming, ideation, creative thinking Custom test design techniques Comparison of models, value, advantages, disadvantages, compromises Identification, validation and use of oracles Predicate logic and proof Hypothesis and inference Socratic method Rapid Review and Inspection techniques Test case design Test models and the meaning of coverage Testing as controlled experiment Observation, Note taking, recording A very different skillset Basic data analysis and statistics Decision-making with incomplete data Computer forensics Fault tree analysis Failure diagnosis Bug advocacy, triage processes and negotiation Meaningful software and test metrics Visual presentation of data Reporting and presentation skills Understanding stakeholders Test analytics Risk management, risk-based testing and decision-making Critical Thinking Interpersonal skills Dealing with uncertainty/fallibility

19. Testing Career Development (speculative) Foundations Technical Management Strategic Test StrategyProject Intelligence Test Assurance ExplorationForensicsInterpretation Scripting/ Programming Test AutomationTechnical (Excel, SQL, OS utils etc) Stakeholder management Analytics & visualisation Managing uncertainty Critical Thinking ISTQB etc... Supplier Management Test Process Management Methodology

20. People Skills for Better Business Susan Windsor's interpersonal skills perspective (susan@wmhl.co.uk)susan@wmhl.co.uk Foundations Specialist Management Strategic Critical Thinking Supplier Selection and Management Stakeholder Identification Creating Shared Goals Collaborative Team Working Managing Cultural Differences Managing Challenging Conversations Enhance Your Communication Style Managing Self Assessment Define Team Qualities and Competencies Implementing Assurance

21. Karen Johnson (US) EuroSTAR Tutorial Thinking Skills - Bridging Skills from Theory to Practical Use, © 2014, Karen Johnson

22. What could we do now? Abandon. Nooooo! Create a "Skills Framework", "Tester Development Scheme", whatever... Use TMF as a vehicle to develop and promote a Skills Framework and "open source" it – Put pressure on Certification Schemes – (Training providers) Build courses to align Create a competitive Certification Scheme??? Other ideas?