checklist: Planning a User Study

What should the study answer? Exploratory or hypothesis-testing?

e.g. UX measure X leads to shorter processing time

e.g. success rate, efficiency, satisfaction

Design choice based on the objectives

Clear, measurable, without suggestion

Welcome, instruction, tasks, follow-up questioning

e.g. remote setup or laboratory environment

Declaration of consent, information, data minimization

e.g. experience, context of use, demographic characteristics

e.g. 5-8 persons for qualitative tests

e.g. customer list, online panel, internal mailing list

e.g. voucher, expense allowance, internal letter of thanks

Welcome, instructions, observation notes

e.g. System Usability Scale (SUS), UEQ

Test run with colleague or pilot person

e.g. for later analysis or stakeholder review