Testing at Microsoft First tester hired in 1979 (high school intern) First full-time tester hired in 1983 First “wave” of tester hiring in 1985
In the beginning… “You will design, execute and document tests of application software” Requirements: background in math, computers, programming
SDETs at Microsoft Emphasis on Technical Skills Code to understand and solve problems
SDETs at Microsoft Equal Career Paths Test / Development / Management
Development Test Team Makeup: Feature Team Triad Program Management
Team Makeup: The Quartet for Software as a Service Operations Development Test Program Management
VP or General Manager Product Unit Manager DevTestPM Product Unit Manger DevTestPM Organizational Structures (1) "The PUMdom"
President or Senior Vice President GM or VP of Dev Dev Managers ArchitectsGM or VP of Test Test Managers Test Architects GM or VP of Program Mgmt PM Managers Etc. Organizational Structures (2) "The Triad"
Director of Test Test Manager Test Leads (2-8) IC Testers (2-8) Test Manager Test Leads (2-8) IC Testers (2-8) Test Manager Test Leads (2-8) IC Testers (2-8) Senior IC / Tech Lead Test Architect Typical Test Team Organization
Software Development Workflow and Test Execution
Abort Checkin Test CITs Distributed Test CITs Distributed Submit to Source Depot Dev or Test? Dev Test Test CITs Distributed Test CITs Distributed No Yes Pri0 Bug Exists? Abort Checkin Passed Failed Submit Build product / test* Dev CITs Distributed Dev CITs Distributed Create Pri0 Bug Email Test Owner Create Pri0 Bug Email Test Owner No Yes Pri0 Bug Exists?
Amplify Skill with Volume Individual dialects, nuances, hard to detect with a single vendor – crowd does a better job
Reduce cost with Discovery & Instrumentation No need to install Telemetry to direct effort
Results Significant Quality Improvements for Windows 7 Positive Impact on Ship Schedule Team Morale and Subsidiary Engagement Total Screens Reviewed:Over 500,000 Total Number of Reviewers:Over 4,500 Screens per Reviewer:Average 119
Photo Credits Microsoft street sign - Some rights reserved by TechFlash ToddSome rights reserved TechFlash Todd Microsoft photo - Some rights reserved by Robert ScobleSome rights reserved Robert Scoble The Future - Some rights reserved by PVBroadz Some rights reservedPVBroadz