1. Alan Page Microsoft

2. Microsoft Products Nearly 300 Products Released in last 12 Months

3. Some Numbers

4. More than 90,000 Employees World Wide

5. More than 38,000 Engineers

6. Nearly 10,000 Testers

7. Testing at Microsoft First tester hired in 1979 (high school intern) First full-time tester hired in 1983 First “wave” of tester hiring in 1985

8. In the beginning… “You will design, execute and document tests of application software” Requirements: background in math, computers, programming

9. SDETs at Microsoft Emphasis on Technical Skills Code to understand and solve problems

10. SDETs at Microsoft Equal Career Paths Test / Development / Management

11. Development Test Team Makeup: Feature Team Triad Program Management

12. Team Makeup: The Quartet for Software as a Service Operations Development Test Program Management

13. VP or General Manager Product Unit Manager DevTestPM Product Unit Manger DevTestPM Organizational Structures (1) "The PUMdom"

14. President or Senior Vice President GM or VP of Dev Dev Managers ArchitectsGM or VP of Test Test Managers Test Architects GM or VP of Program Mgmt PM Managers Etc. Organizational Structures (2) "The Triad"

15. Director of Test Test Manager Test Leads (2-8) IC Testers (2-8) Test Manager Test Leads (2-8) IC Testers (2-8) Test Manager Test Leads (2-8) IC Testers (2-8) Senior IC / Tech Lead Test Architect Typical Test Team Organization

16. Software Development Workflow and Test Execution

17. Abort Checkin Test CITs Distributed Test CITs Distributed Submit to Source Depot Dev or Test? Dev Test Test CITs Distributed Test CITs Distributed No Yes Pri0 Bug Exists? Abort Checkin Passed Failed Submit Build product / test* Dev CITs Distributed Dev CITs Distributed Create Pri0 Bug Email Test Owner Create Pri0 Bug Email Test Owner No Yes Pri0 Bug Exists?

20. The Future

21. or – variations on the same old stuff

22. Over-testing, under-testing and millions and millions of tests

23. Data, data, data

24. Concurrency Scale Screens and the Cloud

25. The test / development relationship and organizational agility

26. Community and collaboration - If only we knew what we knew

27. Productivity Games Recapturing discretionary time http://productivitygames.blogspot.com/ http://seriousgames.org/

28. Ribbon Hero

29. Localization Testing Hard, Large-Scale Problem Windows 7 ships in 100 languages Thousands of Strings and Screens per Release

30. link

32. Amplify Skill with Volume Individual dialects, nuances, hard to detect with a single vendor – crowd does a better job

33. Reduce cost with Discovery & Instrumentation No need to install Telemetry to direct effort

34. Results Significant Quality Improvements for Windows 7 Positive Impact on Ship Schedule Team Morale and Subsidiary Engagement Total Screens Reviewed:Over 500,000 Total Number of Reviewers:Over 4,500 Screens per Reviewer:Average 119

35. http://angryweasel.com/blog http://twitter.com/alanpage

36. Photo Credits Microsoft street sign - Some rights reserved by TechFlash ToddSome rights reserved TechFlash Todd Microsoft photo - Some rights reserved by Robert ScobleSome rights reserved Robert Scoble The Future - Some rights reserved by PVBroadz Some rights reservedPVBroadz