1. Lecture 6: Testing/Quality Assurance Damien Markey

2. Lecture 6: Testing/Quality Assurance What is Quality Assurance (QA)? QA as a constant process (not just at the end) Testing categories Testing plan

3. What is Quality Assurance (QA)? Quality Assurance is not testing (although QA does contain testing) Quality Assurance has many definitions but generally it is agreed that it is the application of a process (or processes) to assist in creating a quality product It has been adapted from manufacturing where it has been applied for several decades See www.philosophe.com and www.asq.org www.philosophe.comwww.asq.orgwww.philosophe.comwww.asq.org

4. What is Quality Assurance (QA)-2? The QA lead should be involved from the outset of the project so that: –They can develop the testing plan (see later) –They develop an understanding of the client and user requirements –They understand the technical requirements of the technical and hosting teams and the end users.

5. Common Issues With QA Commonly QA is either –Overlooked and the site is not thoroughly checked –not planned properly, causing budget/scope/timeline changes –The time and budget for QA shrinks as “earlier” tasks slip near delivery date Would you watch a TV show that has not been rehearsed? Without proper QA you will not deliver a quality site

6. QA As a Constant Process QA is not testing at the end of the project QA has to be a part of every stage of the process e.g –HTML coders validate their code before passing it to the testing team –Designers test their graphics on PC’s and Macs before handing them to the integrators

7. QA as a Constant Process –2 This is called “White Box” testing –The programmer knows what to (and what not to) input into the system and what output should be created If the programmers, designers, coders, integrators and everyone else perform their white box testing then the QA team can do their “Black box” testing

8. Black Box Testing The QA lead will produce a test plan based on the initial specification They can then take the key user paths and key tasks that have been documented and test that those functions perform as designed The testers do not need to know how the code works as they act as “preliminary users” Do you need to know how Amazon.com works or do you want to order a book?

9. Testing Categories There are various types of testing that should be preformed, depending on the site, to ensure a quality product These fall into several categories: –Unit tests –Alpha testing –Content check –Beta testing

10. Testing Categories (cont.) Load testing Stress tests Functional testing User Acceptance Testing Regression testing Security testing Boundary testing

11. Unit testing Testing of individual components such as: –Flash movies, –JavaScript rollovers and –functions on a page Usually performed by the developers as part of their own internal testing Performed before the passing of pages to the integration team

12. Alpha Testing Testing performed, based on the original specification, before the site goes live Usually performed on the development site Usually performed by the internal development team

13. Content Check Checks the content (images and text) for the following: –Accuracy –Placement within site and page –Copy text readability –Syntax –Images

14. Beta Testing Post integration (and initial deployment) testing on the liver server –The site is not “live” at this point but is on the live server in the live server set-up Final testing of the site against the original specification

15. Load Testing What would happen if your site suddenly becomes very popular? E.g. –Friendsreunited.co.uk went from 5,000 page impressions a month to 50,000 a month in about three months Does the site say “server down” or does it handle the increased load gracefully by placing a “Call back later” sign up Or do files become corrupted and data lost?

16. Load Testing Tools There are software tools for load testing These simulate the effect of a large number of users on a site They can also simulate a lot of people performing certain tasks Tools such as webload and Mercury Interactive perform such testing Needs to be carried out for large load site e.g. Big Brother and comic relief sites

17. Stress Tests These are similar to load test but on the browser end of the chain They work by seeing the response of the site on a low spec, low bandwidth connection with older browsers –I.e. how does your site work on a Pentium 200Mhz with 8MB of RAM using IE 3?

18. Functional Testing These are tests that do not involve looking at code but concentrate on the specified functionality of the site Testers act as users and try to perform representative tasks As all tasks and permutations cannot be carried out, representative tasks group several tasks together e.g. –User selects an item, places it in the baskets and then goes back to the shop. They then return to the shop later to checkout

19. User Acceptance Testing Tests are based on the client specification Usually test the –Platforms –Browsers –Operating System –Functionality of site Once passed the client can “sign off” the site

20. Regression Testing States what will be tested on the second, third and any further iterations of testing I.e. –Core functionality is tested on the first, second and final pass –Flash content is checked in first and secondary testing (if bugs fixed by second test) This is to prevent the possibility of fixes in bugs for one section causing new bugs in previously fixed code This is essential as most modern sites have shared code between sections

21. Security Testing This testing check that data sent along secure links is safe from unauthorised access Involves attempting to access the secure data in transit and stored on the servers and databases Essential for financial transaction sites

22. Boundary Testing Tests forms and input methods for data that is not specified in the original specification e.g. –Entering dates into an amount field –Entering numbers into a name field –Entering “guess” page names into the URL of the site You do not want a site that takes money to not throw back a response if a name is entered in the credit card field!

23. Testing Plan All of the categories and types of test are put into the project test plan This details the following –Scope of testing Which type of test will be used, what platforms will be tested and what environment will be used –Bug categories Scales (e.g. 1 to 3 with 1 being severe) and types (e.g graphical, functional, usability etc)

24. Testing Plan - 2 Sections cont –Configuration Management The file naming and versions to be used –Risks and Assumptions Risks such as what can happen if major errors are found What resources and pre-requisites are needed for testing –Schedule and no of iterations

25. Testing Plan - 3 Test resources –What internal testing resources will be needed Testing cases –The cases to be used (usually key paths) –Any extra Representative cases Final deliverables –Bug report – a list of bugs, severity, type and description

26. QA summary A summary of bugs found at end of development Any outstanding issues Any recommendations form the testing team