Comparison of Evaluation Methods in User Experience Research: Walkthroughs, Interviews, Qu, Slides of Human Resource Management

An overview of various evaluation methods used in user experience research, including post-task walkthroughs, interviews, questionnaires, and physiological methods such as eye tracking and physiological measurements. Each method is discussed in terms of its advantages, disadvantages, and appropriate use cases. The document also includes information on choosing the right evaluation method based on design vs. Implementation, laboratory vs. Field settings, subjectivity vs. Objectivity, and other factors.

Typology: Slides

2012/2013

Uploaded on 07/26/2013

dilhara
dilhara 🇮🇳

3.9

(8)

78 documents

1 / 10

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
automated analysis EVA
Workplace project
Post task walkthrough
user reacts on action after the event
used to fill in intention
Advantages
analyst has time to focus on relevant incidents
avoid excessive interruption of task
Disadvantages
lack of freshness
may be post-hoc interpretation of events
Docsity.com
pf3
pf4
pf5
pf8
pf9
pfa

Partial preview of the text

Download Comparison of Evaluation Methods in User Experience Research: Walkthroughs, Interviews, Qu and more Slides Human Resource Management in PDF only on Docsity!

automated analysis – EVA

  • Workplace project
  • Post task walkthrough
    • user reacts on action after the event
    • used to fill in intention
  • Advantages
    • analyst has time to focus on relevant incidents
    • avoid excessive interruption of task
  • Disadvantages
    • lack of freshness
    • may be post-hoc interpretation of events

post-task walkthroughs

• transcript played back to participant for

comment

  • immediately → fresh in mind
  • delayed → evaluator has time to identify questions

• useful to identify reasons for actions

and alternatives considered

• necessary in cases where think aloud is

not possible

Interviews

  • analyst questions user on one-to -one basis usually based on prepared questions
  • informal, subjective and relatively cheap
  • Advantages
    • can be varied to suit context
    • issues can be explored more fully
    • can elicit user views and identify unanticipated problems
  • Disadvantages
    • very subjective
    • time consuming

Questionnaires

  • Set of fixed questions given to users
  • Advantages
    • quick and reaches large user group
    • can be analyzed more rigorously
  • Disadvantages
    • less flexible
    • less probing

Physiological methods

Eye tracking

Physiological measurement

eye tracking

  • head or desk mounted equipment tracks the position of the eye
  • eye movement reflects the amount of cognitive processing a display requires
  • measurements include
    • fixations: eye maintains stable position. Number and duration indicate level of difficulty with display
    • saccades: rapid eye movement from one point of interest to another
    • scan paths: moving straight to a target with a short fixation at the target is optimal

Choosing an Evaluation Method

when in process: design vs. implementation

style of evaluation: laboratory vs. field

how objective: subjective vs. objective

type of measures: qualitative vs. quantitative

level of information: high level vs. low level

level of interference: obtrusive vs. unobtrusive

resources available: time, subjects, equipment, expertise