2. WEBINAR In The Digital Age, Agile Testing With The Right Data Matters
Diego Lo Giudice, Vice President, Principal Analyst
@dlogiudice
Noel Yuhanna, Principal Analyst
@nyuhanna
July 19, Call in at 10:55 a.m. Eastern time

4. Agenda
Agile empowers digital businesses, and more quality has to come with speed.
Test data management (TDM) challenges and needs
The “accelerated” TDM life cycle
The TDM landscape: home grown, services, and tools

5. Agenda
Agile empowers digital businesses, and more quality has to come with speed.
Test data management (TDM) challenges and needs
The “accelerated” TDM life cycle
The TDM landscape: home grown, services, and tools

6. The age of the customer
Delta exploits digital technology to transform the flying experience of customers..
Delta Air Lines exploits digital technology to transform the flying experience of customers.

7. The digital revolution hits “things” as well

8. No industry is immune to digital disruption . . .

9. But what makes a business digital?
It’s software, applications, and modern applications!
A must for any business to become obsessed with achieving excellence in developing, testing, and delivering great software!

10. Quality at speed

11. Agenda
Agile empowers digital businesses, and more quality has to come with speed.
Test data management (TDM) challenges and needs
The “accelerated” TDM life cycle
The TDM landscape: home grown, services, and tools

12. 50% 20% Test data impediments Testers Developers Waiting Looking
Manipulating
Creating

13. TDM challenges have grown over the years
Data explosion that’s impacting testing
Need for continuous, faster cycles of testing
Need for integrated data across various sources
More data sources are needed by applications.
Increasing demand for collaboration
Growing pressure of regulatory compliance
Tighter integration with support for all kinds of data formats, types, and standards

14. WIM: Weak TDM strategy impacts Agile development
More bugs in production causing app issues
Higher testing and development costs
Duplication of effort — resources, people
Impact on performance and scale
New app development slows down.
Impact on business growth and potential revenue

15. Retailers, banks, and public organizations tell us that poor TDM leads to:
Higher project cost avoidance.
Overall poorer productivity.
TD testers’ loss of productivity.

16. Agenda
Agile empowers digital businesses, and more quality has to come with speed.
Test data management (TDM) challenges and needs
The “accelerated” TDM life cycle
The TDM landscape: home grown, services, and tools

17. Test data management is a continuous life cycle
Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

18. Agile teams look for leaner TDM governance, although production “cloning” and “sub-setting” lead
“How frequently do you use the following testing practices? (Please select one)”
Automation enjoys growing adoption for both functional regression and nonregression tests.
Service virtualization, TDD, and BDD are still far from where they need to be.
Base: 160 professionals with knowledge of their firms’ Agile practices; Source: Forrester’s Q Global Agile Software Application Development Online Survey

19. Source: “Five Must-Do’s For Testing Quality At Speed” Forrester report

20. This is not an obvious shift . . .
How it is
How it should be
Copy test data from production
Agile governance to have test data created “on demand”
Test data created manually by testers
Test data needs to be aligned across Agile teams.
Test data not available to testers and developers
Test data provisioned continuously from sprint throughout remaining sprints!
Large, costly databases of data not easy to maintain
All databases are compacted for testing, purposed to speed testing.
You can’t be Agile if you don’t have Agile test data!

21. CD leaders make test data management a first-class citizen: progressive, iterative, and fully integrated in sprints
Sprint 1
Sprint 2
Sprint 3
. . . Sprint N
S p r i n t 0
Test
data
Test
data
Test
data
Test
data
Test
data
End-to- end
Test data
Integrati on
Testing
Source: “Consistent Performance In Agile Teams Must Include Testing” Forrester report

22. Production environment
TDM has to feed a multispeed continuous delivery capability, which, over time, will become one speed: fast!
Automated continuous delivery pipeline
Automated gate checks
Release automation
Automated
unit
testing
Automated
functional
testing
Automated
process
testing
Automated
performance
testing
Release candidates
Test
Data
Test
Data
Test
Data
Source: Forrester adaptation of SVT for dummies
Development
Build
Test environment
Stage environment
Production environment
Retrovert
Retrovert
Deploy

23. Agenda
Agile empowers digital businesses, and more quality has to come with speed.
Test data management (TDM) challenges and needs
The “accelerated” TDM life cycle
The TDM landscape: home grown, services, and tools

24. TDM technology is on the moderate success trajectory of our continuous software delivery technology radar ̶ but growing!
Large, bloated solutions have dominated the market!
Modern tools tie requirements to test cases to test data with
automation!
Source: “TechRadar™: Continuous Software Delivery, Q2 2015” Forrester report

25. TDM has many necessary components to support end-to-end testing ̶ which aligns with vendor solutions.
Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

26. Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

27. Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

28. Source: “Agile Test Data Management: The New Must-Have” Forrester report

29. Source “Agile Test Data Management: The New Must-Have” Forrester report

30. Systems integrators also provide TDM-as-a-service
Capgemini, Cigniti, Cognizant, Dell Services, Hexaware, HPE Services, IBM GBS, Infosys, Syntel, Tata Consultancy Services (TCS), Tech Mahindra . . .

31. Recommendations Prepare test data at the enterprise level.
Make data provisioning more repeatable.
Build a unified test data repository across apps.
Look at automating all TDM functions.
Leverage the cloud TDM platform.
Consider vendors that provide end-to-end solutions.
Look at TDM services.

32. Key research used for this presentation
“The 2015 State Of Agile Development” Forrester report
“The 2015 State Of Agile Development: Learn From Agile Expert Firms” Forrester report
“Agile Experts Focus On Downstream Delivery” Forrester report
“Agile Test Data Management: The New Must-Have” Forrester report
“Five Must-Do’s For Testing Quality At Speed” Forrester report
“Vendor Landscape: Enterprise Test Data Management” Forrester report

33. Diego Lo Giudice
Noel Yuhanna