Evidence rating
Effect score (E): 4/5 Evidence for the underlying principle or measurement method.
Transfer score (T): 4/5 Evidence for reliable results in digital product practice.
Evidence level: High
[Supported by practice tests] Use validated scales with their wording and scoring documented; do not present custom items as validated scales.
Scale and rating rules
Effect score: 5 established · 4 robust · 3 context-dependent · 2 weak · 1 preliminary.
Transfer score: 5 practice-proven · 4 field-supported · 3 partially supported · 2 plausible · 1 hypothesis.
Without a robust scientific or normative source, E is capped at 3. Blog and agency opinions support at most T=2. If evidence conflicts, the more conservative score applies until justified otherwise.
Evidence level: High = E ≥ 4 and T ≥ 3; Moderate = E ≥ 3; Preliminary = E ≤ 2 or T ≤ 1.
Surveys & Questionnaires in UX Research
Surveys and standardized questionnaires are instruments of quantitative UX research. They record self-reported assessments such as satisfaction, comprehensibility, or perceived efficiency. With an appropriate scale, translation, and administration, responses can be analyzed consistently; they do not measure objective performance or replace behavioral observation.
For example, a product team wants to explore whether users perceive navigation as clearer after a redesign. A higher score on an appropriate standardized scale is initially a descriptive difference. A robust conclusion also requires comparable conditions, an adequate sample, and an assessment of uncertainty. SUS measures perceived usability, not navigation comprehensibility in isolation.
When are Questionnaires Used?
Questionnaires are particularly helpful after a usability test has been carried out (“post-test survey”) or as part of benchmarking studies. They are also a valuable addition to behavioral data analysis in remote tests where direct observation is not possible. In mixed-method designs, they are often combined with interviews, screen recordings or task data in order to bring together subjective and objective perspectives.
A typical scenario: In a usability test, almost all users succeed in solving a certain task. However, only a subsequent questionnaire reveals that many found the process tedious, unclear or frustrating - indications that could not be deduced from behavior alone.
AI Known UX Questionnaires in Practice
One of the most widely used standardized questionnaires is the System Usability Scale (SUS). It consists of ten statements that are rated on a five-point scale from “strongly disagree” to “strongly agree” - for example: “I found the system easy to use.” The SUS can be administered in short studies and produces a score from 0 to 100. A score around or above 70 is used as a rough guide in some benchmark contexts, but it is not a universal cutoff for acceptable usability. Comparisons must suit the scale, target group, language, and administration.
If the focus is not just on functionality, but on the overall user experience, the AttrakDiff questionnaire offers a finer differentiation. It works with semantic pairs of opposites such as “technical - human” or “simple - complex” and assigns these to different UX dimensions, such as hedonic or pragmatic quality. In a project to redesign an online banking app, for example, it was shown that although a new, graphically reduced version was more efficient to use, it was perceived as less appealing.
The User Experience Questionnaire (UEQ) is a particularly comprehensive questionnaire. It contains 26 items with polarity pairs such as “innovative - conservative” or “confusing - clear” and covers six UX dimensions - including attractiveness, clarity and stimulation. In practice, the UEQ is often used when detailed feedback on various UX aspects is required, for example when evaluating complex web applications or comparing different prototypes.
Selection: Which Questionnaire for Which Purpose?
The choice of a suitable instrument depends on the objective of the test. If the focus is primarily on usability, the SUS is a good choice - it is compact, well validated and easy to evaluate. If, on the other hand, the focus is on the user experience in a broader sense - for example with emotionally charged applications, learning environments or lifestyle products - AttrakDiff or UEQ are more suitable.
The context also plays a role: in agile sprints with limited time, a short questionnaire is more suitable, while in larger studies, differentiated instruments allow more knowledge to be gained.
Insights from the Field
There are a few pitfalls to be aware of when using standardized UX questionnaires. It is important to formulate the instructions clearly - users should know what their assessment refers to. Terms and anchors should be translated in a context-sensitive manner and adapted if necessary to avoid misunderstandings. Integration into the test procedure is also crucial: If a questionnaire is presented immediately after a usability test, it should be ensured that the experience is still present, but that the test subject is not overwhelmed.
Experienced UX researchers also rely on triangulation - combining questionnaire data with other methods such as observations, interview quotes or metrics such as time-on-task. This creates a valid, multidimensional picture of the UX.
Conclusion
Standardized questionnaires are an indispensable component of evidence-based UX research. They make subjective perceptions measurable, enable benchmarking and help to substantiate design decisions. In practice, they are convincing due to their simplicity, comparability and analytical depth - provided they are used in a targeted, careful and user-centered manner.
Frequently asked questions (FAQ)
Why are surveys important in UX research?
When do you use questionnaires?
What are the well-known UX questionnaires?
How do you choose the right questionnaire?
What are the advantages of standardized questionnaires?
What challenges are there?
Research on UX questionnaires and methodological standards
These studies systematically analyze the use, validity and methodological challenges of UX questionnaires as well as qualitative and quantitative UX survey methods.
Measurement Practices in User Experience (UX) Research: A Systematic Quantitative Literature Review
This study analyzes the use of UX questionnaires (e.g. SUS, UEQ, NASA-TLX) and criticizes the lack of quality assurance in the selection and application of these scales.
Perrig, S., Aeschbach, L. F., Scharowski, N., Von Felten, N., Opwis, K., & Brühlmann, F. (2024). Measurement practices in user experience (UX) research: A systematic quantitative literature review. Frontiers in Computer Science. https://doi.org/10.3389/fcomp.2024.1368860
Applicability of User Experience and Usability Questionnaires
Evaluates 13 UX/Usability questionnaires in terms of their coverage of relevant factors. Shows that no single questionnaire fully reflects all user needs.
Hinderks, A., Winter, D., Schrepp, M., & Thomaschewski, J. (2019). Applicability of user experience and usability questionnaires. Journal of Universal Computer Science, 25(13), 1717-1736. https://doi.org/10.3217/JUCS-025-13-1717
Online Survey Methodology for User Experience Research
Provides a methodological guide for planning and conducting high-quality online surveys in UX studies.
Callegaro, M., Villar, A., & Sedley, A. (2020). Online survey methodology for user experience research: A framework for utility and quality. In CHI 2020. https://doi.org/10.1145/3334480.3375048
Implicit Bias in UX Research Methods
Addresses how surveys and interviews in UX research can introduce implicit biases, especially for marginalized user groups.
Pereira, N. (2022). Implicit bias in UX research methods. In AHFE International. https://doi.org/10.54941/ahfe1002544
Exploring the Role of Children as Co-Designers
Demonstrates how participatory methods can be used to develop child-friendly UX questionnaires.
Wöbbekind, L., Mandl, T., & Womser-Hacker, C. (2020). Exploring the role of children as co-designers - Using a participatory design study for the construction of a user experience questionnaire. In Advances in Computer-Human Interaction.
Science corner: evidence data
- Setting
- Standardized questionnaires after or during real or controlled use
- Replication status
- Replicated / repeatedly studied
- Evidence level
- High (E=4, T=4)
- Key sources (APA)
-
- Brooke, J. (1996). SUS: A ‘quick and dirty’ usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & I. L. McClelland (Eds.), Usability evaluation in industry (pp. 207–212). Taylor & Francis. https://doi.org/10.1201/9781498710411-35
- Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
- Lewis, J. R. (2018). The System Usability Scale: Past, present, and future. International Journal of Human–Computer Interaction, 34(7), 577–590. https://doi.org/10.1080/10447318.2018.1455307
- Hassenzahl, M., Burmester, M., & Koller, F. (2003). AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In Mensch & Computer 2003 (Berichte des German Chapter of the ACM, S. 187–196). Teubner. https://doi.org/10.1007/978-3-322-80058-9_19
- Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. In A. Holzinger (Ed.), HCI and usability for education and work (Lecture Notes in Computer Science, Vol. 5298, pp. 63–76). Springer. https://doi.org/10.1007/978-3-540-89350-9_6
- Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5(3), 213–236. https://doi.org/10.1002/acp.2350050305
- Review date / version
- 2026-11-01 · 1.1
- Next review
- 2027-11-01 (Review cycle: 12 months)
Last modified: 1 November 2026