Quest Atlantis Homepage Tutorial Project Min-joung Kim Ming Ma Pil-Won On

Project Description

Target Audience Language Language English English Age Age 9 to 12 year-old 9 to 12 year-old Gender Gender Boys : Girls = 5: 1 Boys : Girls = 5: 1 Pre-requisite knowledge Pre-requisite knowledge Minimum pre-experience of using the 3-D interface (logging in the QA) Minimum pre-experience of using the 3-D interface (logging in the QA) Starting a computer and a program, using a mouse and a keyboard Starting a computer and a program, using a mouse and a keyboard

Context Mainly in a local Boys and Girls Club with fast internet connection. Mainly in a local Boys and Girls Club with fast internet connection. Users should be registered in QA. Users should be registered in QA.

Banner o Name of Quester o Emoticon o Link to pop-up page o Message for any new mail Navigation Links Links to other side-bar pages Side-bar Contents Title and summary information Pop-Up Link Opens content in pop-up window with complete details for reviewing or editing Objectives

Objectives After going through the QA Home Page tutorial, learners will be able to: Identify each feature on the side-bar page Identify each feature on the side-bar page Banner Banner Identify the owner of home page. Identify the owner of home page. Identify what the emoticon is. Identify what the emoticon is. Identify the label of . Identify the label of . Identify the number of new . Identify the number of new . Navigation links Navigation links Identify what “ home ” is for. Identify what “ home ” is for. Identify what “ friends ” is for. Identify what “ friends ” is for. Identify what “ quests ” is for. Identify what “ quests ” is for. Pop-up link Pop-up link Identify the link to a pop-up. Identify the link to a pop-up. Utilize the function of “ home ” page editing. Utilize the function of “ home ” page editing. in 80% of successful completion without any help from mentors.

Merrill’s 5 Stars Instructional Design Problem: Utilize the function of the side-bar (ex) Problem: Utilize the function of the side-bar (ex)ex Activation: Use analogy of a “ House ” (ex1, ex2) Activation: Use analogy of a “ House ” (ex1, ex2)ex1ex2ex1ex2 Demonstration: Show as a movie, guided practice Demonstration: Show as a movie, guided practice (ex1, ex2) ex1ex2ex1ex2 Application: Practice part - skateboarding game Application: Practice part - skateboarding game (ex1) ex1 Integration: The learners actually apply their learning for the real side-bar. Integration: The learners actually apply their learning for the real side-bar.

QA training team’s 6 th star Motivation Motivation Talking head Talking head Familiar environment Familiar environment Skateboarding game Skateboarding game Use one of the avatars in QA Use one of the avatars in QA Visual reinforcement Visual reinforcement Award: 4 points for completion Award: 4 points for completion Animation: flash movies Animation: flash movies

Expert review of paper prototype Conducted expert review with Lauryl and Dr. Frick Conducted expert review with Lauryl and Dr. Frick After the review, added different words for feedback. For example, “ good job ”, “ great ”, “ excellent ”, etc. After the review, added different words for feedback. For example, “ good job ”, “ great ”, “ excellent ”, etc. Changed “ friends, quests, and home ” in the questions with other words to avoid giving hints to learners. Changed “ friends, quests, and home ” in the questions with other words to avoid giving hints to learners.

Paper Prototype usability test Leaner 1Learner 2Learner 3Learner 4 Age 1299 Gender Male Nationality American Pre-experience with QA 1 year A few months 3 times Information of the subjects Information of the subjects

Scale of reactionnare 5. I will tell my friends to play with this tutorial.

Paper Prototype usability test Instructional Effectiveness (n=4) LearnerPre-assessment Score Post-assessment Score # 1 8 out of 99 out of 9 # 2 8 out of 99 out of 9 # 3 6 out of 97 out of 9 # 4 4 out of 97 out of 9 Novice learners (#3 and #4) MeanSDMeanSD 5 (56%) (78%) 0 OverallMeanSDMeanSD 6.5 (72%) (89%) 1.15 Satisfaction with Instruction (n=4) Reactionnaire Mean Score (3 point scale) MeanSD 2.6 (87%) 0.3 MeanSD 2.7 (90%) 0.2

Paper Prototype usability test Comparison of pre-test and post-test results Comparison of pre-test and post-test results

Paper Prototype usability test Comparison of pre-test and post-test results: individual performance Comparison of pre-test and post-test results: individual performance

Paper Prototype usability test ProblemImprovement Learners failed the question about “home” page Explain more effectively and in detail what “home” is about Learners failed the question about navigating to different pages Explain the navigation function of the buttons more effectively, with simulated animation Learners failed the question about editing the “home” page Teach how to edit “home” procedure more effectively: review the sequence one more time after a movie, and let learners practice one more time Revisions on improving instructional effectives

Paper Prototype usability test ProblemImprovement Learners were easily distracted when there was only audio (read by the testers) but no visual character in the tutorial Use a talking head satisfaction Revision on improving learner satisfaction

Paper Prototype usability test ProblemImprovement Learners did not know where they were expected to go between scenes Use consistent “ Go ” button to lead learners Learners found reading difficultReduce the amount of text – use more audio Learners were confused by some wording in the tutorial Change misleading wording Revisions on improving usability

Computer prototype usability test Leaner 1Learner 2Learner 3 Age Gender Male Female Nationality American Pre-experience with QA 2 monthsLess than a month Information of the subjects Information of the subjects

Computer prototype usability test Instructional Effectiveness (n=3)Satisfaction with Instruction (n=3) LearnerPre- assessment Score Post- assessment Score Reactionnaire Mean Score # 1 0 out of 87 out of 83 # 2 0 out of 86 out of 83 # 3 1 out of 88 out of 83 OverallMeanSDMeanSDMeanSD 0.3 (4.2%) 0.67 (88%) 13 (100%) 0 Results Results

Computer prototype usability test Comparison of pre and post test results Comparison of pre and post test results

Computer prototype usability test Comparison of pre and post test results: individual performance Comparison of pre and post test results: individual performance

Computer prototype usability test ProblemImprovement Hesitation on the action of clicking the small objects which is linked to. Make the objects more prominent in such ways: Making the object bigger, providing an instant effect. Confusion between links and non- links Get rid of unnecessary links which make the appearance of a mouse cursor a pointing finger Frustration with limited choices on practice part. Provide more options of choices. Revision Revision

Questions or Comments?