Exploring the difference between exploratory and task based remote asynchronous usability testing
Author
Eklund, Stine
Term
4. term
Education
Publication year
2016
Pages
31
Abstract
This thesis examines whether task-based and exploratory walkthrough approaches differ in remote, asynchronous usability testing. In a comparative study, participants either followed predefined tasks or explored freely, with screen and think-aloud recordings; post-test questionnaires (including the System Usability Scale) captured subjective impressions. The analysis compares user opinions and detected errors. Findings show no significant difference in overall subjective attitudes toward the website (p=0.46) and no significant difference in the number of errors identified (p=0.786). However, the two methods surface different unique issues at different stages of an e-commerce flow: the exploratory approach finds its unique problems during browsing and product selection, while the task-based approach identifies most unique problems in buying and checkout. This is assumed to reflect that task-based tests guide users through checkout, whereas many exploratory testers did not; ways to address this are discussed. The study also explores individual differences in applying the exploratory method and the potential for categorization, but the excerpt does not report clear outcomes on these points.
Dette speciale undersøger, om der er forskel på opgavebaserede og eksplorative walkthrough-metoder i fjern, asynkron usability-test. I en komparativ analyse gennemførte testpersoner enten foruddefinerede opgaver eller udforskede frit, mens deres skærm og tænke-højt-udsagn blev optaget; efterfølgende besvarede de spørgeskemaer (bl.a. System Usability Scale). Undersøgelsen sammenligner både subjektive vurderinger og registrerede fejl. Resultaterne viser ingen signifikant forskel i den overordnede brugeropfattelse af websitet (p=0,46) og ingen signifikant forskel i antallet af fundne fejl (p=0,786). Til gengæld lokaliserer metoderne forskellige unikke problemer på forskellige trin i købsforløbet: den eksplorative metode identificerer sine unikke fejl under browsing og produktvalg, mens den opgavebaserede metode primært finder unikke fejl ved køb og checkout. Dette antages at hænge sammen med, at opgavebaserede tests tvinger brugerne gennem checkout, mens flere eksplorative testere ikke når dertil; mulige forbedringer diskuteres. Specialet undersøger også variationer i testpersoners evne til at bruge den eksplorative metode og muligheden for kategorisering, men uddraget rapporterer ingen klare konklusioner herpå.
[This apstract has been generated with the help of AI directly from the project full text]