Presentation on theme: "Imran Hussain University of Management and Technology (UMT)"— Presentation transcript:
1Imran Hussain University of Management and Technology (UMT) Virtual University Human-Computer InteractionLecture 30 Evaluation – Part IIImran HussainUniversity of Management and Technology (UMT)1
2In Last Lecture … Introduction to evaluation What Evaluation is? Significance and importance of evaluationDifferent paradigmsDifferent techniques which constitute this paradigm
3EvaluationThe process of systematically collecting data that informs us about what it is like for a particular group of users to use a product for a particular task in a certain type of environment
4In Today’s Lecture … Framework to guide evaluation process Usability testing
5Framework to guide evaluation DECIDE framework6 unique phasesDetermine the overall goals that the evaluation addresses.Explore the specific questions to be answered.Choose the evaluation paradigm and techniques to answer the questionsIdentify the practical issues that must be addressed, such as selecting participantsDecide how to deal with the ethical issues.Evaluate, interpret, and present the data.
6Determine the goals What are the high-level goals of the evaluation? Who wants it and why?
7Explore the questionsIn order to make goals operational, questions must be answered to satisfy them.For exampleWhat are customers’ attitude to these new tickets?Do customers have adequate access to computers to make bookings?Are they concerned about security?Does this electronic system have a bad reputation?
9Identify the practical issues that must be addressed Users and the participantsFacilities and equipmentSchedule and budget constraintsTime and budget constraints are also important considerations to keep in mind.ExpertiseDoes the evaluation team have the expertise to do the evaluation.
11Evaluate, interpret, and present the data ReliabilityThe reliability or consistency of a technique is how well it produces the same results on separate occasions under the same circumstances.ValidityValidity is concerned with whether the evaluation technique measures what it is supposed to measure.BiasesBiases occur when the results are distorted.Ecological validityEcological validity is concerned how the environment in which an evaluation is conducted influence or even distorts the results.
12Usability testing Plan and Prepare for the test Planning the usability testDefining goals and concernsDeciding participantsRecruiting participantsSelecting and organizing tasks to testDeciding how the measure usabilityPreparing test materialPreparing test environmentPreparing test teamConducting a pilot test
13Usability testingDefining goals and concerns and then decide who should be the participants in the usability test
14Selecting task and creating task scenarios and preparing test materials