Evaluation Objectives

My List (from first week)

  1. Utility (provides needed functions)
  2. Learnability (can figure out what to do to complete task)
  3. Efficiency (task completion time)
  4. Reliability (minimizes errors, some may call this effectiveness)
  5. Satisfaction
  6. Accessibility

Examples from Hartson and Pyla (section 10.5, 22.5 in second edition)

  • Objective UX measures (directly measurable by evaluators)
    • Initial performance
    • Long-term performance (longitudinal, experienced, steady state)
    • Learnability
    • Retainability
    • Advanced feature usage
  • Subjective UX measures (based on user opinions)
    • First impression (initial opinion, initial satisfaction)
    • Long-term (longitudinal) user satisfaction

Discussion Questions

  • How might H&P "performance" be defined?
  • How might H&P "feature usage" be defined?
  • How do you choose and refine evaluation objectives for the evaluation of your design?