Surveys & Questionnaires in UX Research

Surveys and standardized questionnaires are central instruments of quantitative UX research. They make it possible to systematically record and quantify subjective assessments of users - for example with regard to satisfaction, comprehensibility, attractiveness or perceived efficiency. Unlike qualitative interviews, they allow for a standardized, comparable and statistically evaluable assessment of user experience and usability.

Let’s imagine this: After the launch of a new app version, a product team wants to know whether the navigation is perceived to be easier to understand than before. A short online questionnaire with standardized scales is sent to test subjects - the results are available within a few hours. The new version achieves a significantly higher SUS score than the old one. This not only documents a subjective impression, but also a quantifiable improvement.

When are Questionnaires Used?

Questionnaires are particularly helpful after a usability test has been carried out (“post-test survey”) or as part of benchmarking studies. They are also a valuable addition to behavioral data analysis in remote tests where direct observation is not possible. In mixed-method designs, they are often combined with interviews, screen recordings or task data in order to bring together subjective and objective perspectives.

A typical scenario: In a usability test, almost all users succeed in solving a certain task. However, only a subsequent questionnaire reveals that many found the process tedious, unclear or frustrating - indications that could not be deduced from behavior alone.

Known UX Questionnaires in Practice

One of the most widely used standardized questionnaires is the System Usability Scale (SUS). It consists of ten statements that are rated on a five-point scale from “strongly disagree” to “strongly agree” - for example: “I found the system easy to use.” The SUS can be used quickly, even in very tight study settings, and provides a score between 0 and 100. A score above 70 is considered an indicator of acceptable usability - although the context and target group should always be taken into account.

If the focus is not just on functionality, but on the overall user experience, the AttrakDiff questionnaire offers a finer differentiation. It works with semantic pairs of opposites such as “technical - human” or “simple - complex” and assigns these to different UX dimensions, such as hedonic or pragmatic quality. In a project to redesign an online banking app, for example, it was shown that although a new, graphically reduced version was more efficient to use, it was perceived as less appealing.

The User Experience Questionnaire (UEQ) is a particularly comprehensive questionnaire. It contains 26 items with polarity pairs such as “innovative - conservative” or “confusing - clear” and covers six UX dimensions - including attractiveness, clarity and stimulation. In practice, the UEQ is often used when detailed feedback on various UX aspects is required, for example when evaluating complex web applications or comparing different prototypes.

Selection: Which Questionnaire for Which Purpose?

The choice of a suitable instrument depends on the objective of the test. If the focus is primarily on usability, the SUS is a good choice - it is compact, well validated and easy to evaluate. If, on the other hand, the focus is on the user experience in a broader sense - for example with emotionally charged applications, learning environments or lifestyle products - AttrakDiff or UEQ are more suitable.

The context also plays a role: in agile sprints with limited time, a short questionnaire is more suitable, while in larger studies, differentiated instruments allow more knowledge to be gained.

Insights from the Field

There are a few pitfalls to be aware of when using standardized UX questionnaires. It is important to formulate the instructions clearly - users should know what their assessment refers to. Terms and anchors should be translated in a context-sensitive manner and adapted if necessary to avoid misunderstandings. Integration into the test procedure is also crucial: If a questionnaire is presented immediately after a usability test, it should be ensured that the experience is still present, but that the test subject is not overwhelmed.

Experienced UX researchers also rely on triangulation - combining questionnaire data with other methods such as observations, interview quotes or metrics such as time-on-task. This creates a valid, multidimensional picture of the UX.

Conclusion

Standardized questionnaires are an indispensable component of evidence-based UX research. They make subjective perceptions measurable, enable benchmarking and help to substantiate design decisions. In practice, they are convincing due to their simplicity, comparability and analytical depth - provided they are used in a targeted, careful and user-centered manner.

Last modified: 17 June 2025