Rockitude test team X Usability testing plan for Rockitude School of Business and Information Management Oulu University of Applied Sciences

Team members Muhammad Faheem Khan Janne Hietanen Nelli Kihniä Daniel Keeble Hung Nguyen Sami Pohjolainen Gulshan Kumar

Case description We were testing an iPhone application called Rockitude The testing was done for Tuonela Productions

Focus Our questionnaire was quite general because we wanted to focus on all the features of the game We were mainly focusing on usability and people’s enjoyment We were also looking for possible bugs during the testing process

Test persons We had 12 test subjects ◦Ages between 15 and 32 ◦8 males ◦4 females ◦4 people who have played iPhone games before

Test protocol Each test process took about minutes Each tester tested the game for about 5 minutes (1 song) Afterwards they filled out a questionnaire, which took about about 3-5 minutes.

Test protocol 2 We asked a few general questions before testing, like age and sex etc. We handed the game to the tester with brief instructions and asked them to play it for a duration of 1 to 2 songs After the test we asked them to fill in the questionnaire During the testings, we observed the tester and wrote a few comments about their behaviour

Team members’ roles One person talked to the testers and instructed them about the test and the game when required Another person wrote down observations about the testing Third person helped with questionnaire and collected them

Time and location Tuesday In the school lobby, in a quiet area (9 people) In a football practise locker room (3 people)

Did the players find the game interesting? We asked if the user found the game very interesting or not at all on the scale of 1-5 ◦The average result was 2,4 out of 5 ◦17% were not interested at all ◦58% gave average score ◦Our observers noted that half of them seemed to be enjoying the game

Would you recommend this game? 33% said they would recommend this game

Was the game easy to learn? Scale of 1-5, from not easy to very easy ◦The average was 4,08 ◦42% thought the game was very easy to learn ◦Nobody thought it was harder that average

How easy was the game to play? The scale was from 1 to 5, from not easy to very easy ◦The average was 3,75, so people found it fairly easy ◦42% thought the game was very easy to play ◦Nobody thought it was difficult to play

Would you pay for this game? Unfortunately it seems none of our testers would pay to play this game

How did the game make you feel? The measure in a scale of 1-5, from awkward to party mood ◦The average was 2,42 out of 5 ◦33% answered that the game made them feel awkward ◦Our observers noted that when testers played in a group, it made them seem less awkward

How would you rate the audio? Scale of 1-5, from awful to brilliant ◦The average was 3,08 ◦67% found the sound quality to be between 3 and 4 ◦17% disliked the audio

How would you rate the graphics? Scale of 1-5, from awful to brilliant ◦The average was 3,33 ◦50% found the graphics above average

How would you rate the game as a whole? Scale of 1-5, from rubbish to brilliant ◦The average was 2,58 ◦50% found the game average ◦Only one male really disliked the game

What would be the appropriate length for one play session? 25% thought they could play for 5 minutes Quite a few thought the test session was already too long The rest of the answers varied from 10 seconds to 15 minutes

Other questions asked What did you find wrong with this game? Other comments (Continued in the feedback section)

Observations Were they enjoying the game? ◦50% seemed to enjoy the game Did they appear to be learning the game easily? ◦83% seemed to learn the game easily Many players asked what the purpose of this game is

Tester feedback(1) It’s hard to see the screen while playing Sometimes the small icon never turned into a big icon If you pause the game, the sound disappears Sometimes there are no icons for a while and then suddenly a big icon appears You have to touch the screen occasionally so the game doesn’t go off The required movements are sometimes unclear

Tester feedback (2) Sometimes the application closes accidentally and the player is unable to continue Sound distorts if you play really hard Selection of songs could be wider

Conclusion (1) What was good in the game ◦The game was easy to learn and play ◦The graphics and sound quality were rated just above average, but sound still had some problems ◦A group of friends created a friendly competitive situation What was not so good ◦People felt awkward playing the game ◦Many were afraid they will drop the phone ◦The screen was not always easy to observe ◦The purpose of the game was unclear

Conclusion (2) What aspects would need more testing ◦Selection of songs ◦Pausing the game caused the sound to disappear ◦Game crashing/not being able to continue playing after accidentally exiting the application ◦Sound blurring due to hard movement of the phone ◦Making sure the right icons always appear ◦Sometimes no movement was needed to acquire a score

Recommendations The social aspect of the game could be developed further ◦Multiplayer (following other people’s scores) ◦Keeping score online (e.g.Facebook) ◦Online competitions, for e.g. free songs ◦Bluetooth link between two phones