Software Testing with Microsoft Test Manager 2012 and Lab Management 4/19/2017 2:33 PM DEV337 Software Testing with Microsoft Test Manager 2012 and Lab Management Brian Keller Sr. Technical Evangelist Microsoft Corporation © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

I work here…

…on this…

…and this. http://bit.ly/ThisWeekC9

I blog here: http://blogs.msdn.com/briankel

http://tinyurl.com/ALM2010Book http://tinyurl.com/TFSBook

Agenda Manual Testing Lab Management Tracking Quality Formal Test Case Management Exploratory Testing Lab Management Standard Environments Build-Deploy-Test Workflows Tracking Quality

USS Yorktown, SmartShip crew member entered 0 in a data entry field, caused a “divide by 0” error that shut down propulsion dead in the water for 2hrs 45mins

Ariane 5 Flight 501 re-used code from Ariane 4, but took a different flight path because of different booster design conversation from 64bit float to 16bit signed int caused overflow (exception handler was disabled for perf reasons) cost: > $370 million @ 1996 prices

Vasa sank after sailing less than 1 nautical mile out of Stockholm specifications were faulty, failing to take into account enough ballast to keep the ship upright test teams revealed that it was unstable, but launch was rushed, and QA was ignored

Climbing Cost of Failure Conditioning Training Training Phase

Release Cost of Bugs Test Development Software Phase

Tester Segmentation Generalist Specialist 70% of testing happens here Manual Testing Some scripting Creates scripts to set up lab, create data Strong scripting skills Some coding skills Strong coding Develops automated testing procedures Expert coding skills 70% of testing happens here majority of test tools target here Black Box Testing White Box Testing API Testing

What usually happens when a tester finds a bug? Graphic by Jeff Atwood (CodingHorror.com)

Visual Studio

Microsoft Test Manager 2012 4/19/2017 2:33 PM demo Microsoft Test Manager 2012 © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Manual Testing Improvements Exploratory Testing Rich text test steps HTML5 automation Metro style application testing Pass / Fail tests from Test Activity

3rd Party Virtualization Environments SCVMM Environment Standard Environment Build-Deploy-Test Snapshot / Restore Share Bug Snapshots Network Fencing 3rd Party Virtualization Physical Machines

demo Lab Management 4/19/2017 2:33 PM © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Lord Kelvin, 1824-1907 “…you cannot manage what you cannot measure.”

Go get started! Download the RC: www.microsoft.com/VisualStudio/11 TechEd 2012 4/19/2017 2:33 PM Go get started! Download the RC: www.microsoft.com/VisualStudio/11 Download the ALM VM: http://aka.ms/VS11ALMVM Ask the Experts, TLC area © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

tfspreview.com

Related Content Breakout Sessions DEV214 Introducing the New Visual Studio 2012 Unit Testing Experience DEV344 Developer Collaboration with Team Foundation Server 2012 AAP309 Making Agile Estimation Work DEV337 Software testing with Microsoft Test Manager 2012 and Lab Management DEV317 Going Beyond F11: Debug Better and Faster with Visual Studio 2012 DEV340 Taking ALM to the Cloud with the Team Foundation Service AAP313 Scrum Under a Waterfall DEV362 From Development to Production: Optimizing for Continuous Delivery DEV363 Dev-Ops Best Practices on the Microsoft Stack DEV212 Implementing Scrum Using Team Foundation Server 2012

Related Content Breakout Sessions DEV346 All Aboard the Team Foundation Server Express DEV217 Deep Dive into the Team Foundation Server 2012 Agile Planning Tools DEV365 Advanced IntelliTrace in Production with Visual Studio 2012 DEV316 Application Lifecycle Management Tools for C++ in Visual Studio 2012 DEV343 Implementing Team Foundation Server in the Enterprise DEV321 Continuous Feedback in Agile Teams DEV243 Demystifying Team Foundation Server Builds DEV411 Testing Un-testable Code with Fakes in Visual Studio 2012 DEV410 Deep Dive into Team Foundation Server 2012 Reporting DEV412 Identify and Fix Performance Problems with Visual Studio 2012 Ultimate DEV345 The Accidental Team Foundation Server Admin

Related Content Breakout Sessions DEV318 Working on an Agile team with Visual Studio 2012 and Team Foundation Server 2012 DEV339 Metrics That Matter: Improving Lean and Agile, Kanban and Scrum AAP204 Introduction to Kanban Hands-on Labs (session codes and titles) DEV11-HOL Agile Project Management in Team Foundation Server 2012 DEV12-HOL Build the Right Software and Collaborate Effectively Using Storyboarding and Feedback Tools in Visual Studio 2012 DEV13-HOL Using IntelliTrace with Production Systems to Quickly Diagnose and Fix Issues DEV16-HOL Learn How Microsoft Test Manager 2012 Will Embrace an Exploratory Testing Approach DEV17-HOL Explore the New Unit Testing and Code Clone Capabilities of Visual Studio 2012 DEV19-HOL Discover How the New Features of Team Foundation Server 2012 Can Improve Collaboration in Your Development Team

Resources Learning TechNet http://europe.msteched.com Connect. Share. Discuss. http://europe.msteched.com Microsoft Certification & Training Resources www.microsoft.com/learning TechNet Resources for IT Professionals http://microsoft.com/technet Resources for Developers http://microsoft.com/msdn

Submit your evals online 4/19/2017 2:33 PM Evaluations Submit your evals online http://europe.msteched.com/sessions © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4/19/2017 2:33 PM © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4/19/2017 2:33 PM © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.