Logo UX & Usability Toolkit
DE | EN

Evidence rating

Effect score (E): 4/5 Evidence for the underlying principle or measurement method.

Transfer score (T): 4/5 Evidence for reliable results in digital product practice.

Evidence level: High

[Supported by practice tests] Predefine the task, success criteria, and timing boundaries; report success and time together with the sample size.

Scale and rating rules

Effect score: 5 established · 4 robust · 3 context-dependent · 2 weak · 1 preliminary.

Transfer score: 5 practice-proven · 4 field-supported · 3 partially supported · 2 plausible · 1 hypothesis.

Without a robust scientific or normative source, E is capped at 3. Blog and agency opinions support at most T=2. If evidence conflicts, the more conservative score applies until justified otherwise.

Evidence level: High = E ≥ 4 and T ≥ 3; Moderate = E ≥ 3; Preliminary = E ≤ 2 or T ≤ 1.

Task Success Rate & Time-on-Task

Task success rate is the share of valid task attempts users complete successfully according to criteria defined in advance. Time-on-task is the time between a defined start event and end event. Together, these UX metrics show whether a task succeeds and how long it takes—provided the task, success criteria and timing boundaries are clear.


How Successful are Users? - The Task Success Rate

The so-called task resolution rate indicates how many people were able to complete a certain task completely and correctly. It is given as a percentage and is particularly suitable for measuring the effectiveness of a system.

Formula: Task success rate = (valid attempts meeting the complete-success criteria ÷ all valid attempts) × 100. An attempt counts as successful only if the predefined user goal is achieved without a critical error. Also define whether an abandonment is a valid failed attempt; technical failures unrelated to the product may be excluded under a rule set in advance.

Practical example

In a usability test, users were asked to open an account in a banking app. Out of ten test subjects, seven successfully get to the last step. Three aborted beforehand - partly because the “Next” button was difficult to see and partly because the input fields were unclear.

Calculation: 7 ÷ 10 × 100 = 70% task success rate. A clear indication of optimization potential in the onboarding process.

Banking App AI
Usability test with banking app: Unclear input fields and hard-to-recognize buttons lead to aborts in the onboarding process.
AI-generated image

Variants of the Survey

The success rate can describe and compare versions or time points when tasks, success criteria, and measurement conditions are comparable. An observed difference alone does not establish a cause; causal claims require an appropriate study design, such as a randomized experiment. With small samples, consider estimation uncertainty and chance variation. Trends over time can also reflect changes outside the product.


How Efficient is the Use? - Time-on-task

While the success rate describes the achievement of a goal, the Time-on-Task records the effort required to achieve it - usually in the form of the time needed.

Practical example: In an e-commerce test, a successful checkout takes a median of 3:20 minutes on the old version and 1:50 on the redesigned version. The difference is 90 seconds, or 45% less time relative to 200 seconds. This comparison is meaningful only if the task, sample and measurement rules are comparable and the success rate has not fallen.

But: Less time is not automatically better. An extremely short time-on-task can also indicate superficial processing or lack of interest. Therefore, this metric should always be interpreted in the context of the task and user goals.

How is it Measured?

Example: Eight successful attempts take 12 minutes in total. The arithmetic mean is 12 × 60 ÷ 8 = 90 seconds. With small samples, report individual values or at least the sample size and spread; for right-skewed times, the median and interquartile range are often more informative than the mean alone. Times from successful attempts alone can look deceptively good when many people abandon the task: report abandonments and time to abandonment separately rather than silently omitting them from the success or timing picture.

Interpreting outliers and abandonments

Check unusually short or long times against the recording first: was there a timing error, an external interruption or a genuine interface detour? Keep valid observations in the analysis; they may reveal barriers. Exclude values only under a transparent, predefined rule and document the impact. Avoid arbitrary time limits that turn slow but valid attempts into apparent successes.


Strong Together: Effectiveness & Efficiency

The two metrics only become fully meaningful when combined. A task can be completed quickly - but still fail frequently. Or it is usually completed successfully, but takes a remarkably long time.

UX Metrics
Effectiveness and efficiency in interaction - task success rate and time-on-task as key UX metrics.
MetricsStatement about
Task success rateEffectiveness
Time-on-taskEfficiency

Example combination: In an intranet test, 90% of users manage to find a specific piece of information - but it takes them over 4 minutes on average. The interpretation: The system works, but not efficiently. A better navigation or search function could help here.

ResultPossible interpretationWhat to investigate next
High success rate, short timeMost people complete the task quicklyCheck that users also proceed accurately and confidently
High success rate, long timeThe goal is reached, but with effortInvestigate detours, comprehension issues and unnecessary steps
Low success rate, short timeUsers may be abandoning or failing quicklyCheck abandonment, error patterns and success criteria
Low success rate, long timeThe task may be unclear or blockedAnalyze observations and individual process steps

Best Practices from the Field

How to measure both metrics consistently

  1. Define the task, target users and the expected successful outcome.
  2. Set the exact start and end event before collecting data.
  3. Record completion as complete, partial or failed and capture the time for every participant.
  4. Report the sample size, distribution and relevant outliers instead of only an average.
  5. Compare versions only when task wording, context and participant criteria remain comparable.

Conclusion

Task Success Rate and Time-on-Task are proven tools for making user performance measurable. As quantitative metrics, they provide clear, comparable and meaningful data about the usability of a system - provided they are used context-sensitively and methodically clean. In practice, they are indispensable for benchmarking, redesign evaluations and continuous UX optimization.

Quantitative usability measurement: task times, success rates and key figures

This literature selection highlights metrics of UX research such as task time, error frequency, success rates and composite indices. The focus is on statistical analysis and interpretation of quantitative usability data.

Quantifying User Research

Basic text on quantitative UX measurement with a focus on task times, success rates and error frequencies. Emphasizes statistical evaluability even with small samples.

Sauro, J., & Lewis, J. R. (2012). Quantifying user research. In Quantifying the User Experience. https://doi.org/10.1016/B978-0-12-384968-7.00002-3

DOI

Average Task Times in Usability Tests: What to Report?

Analyzes different methods for displaying task times. Recommends geometric mean over median or arithmetic mean for skewed data.

Sauro, J., & Lewis, J. R. (2010). Average task times in usability tests: what to report? In CHI Proceedings. https://doi.org/10.1145/1753326.1753679

DOI

Combined and Comparative Metrics

Introduction to the Single Usability Metric (SUM), which combines task success, time-on-task, errors and satisfaction into a comparative index.

Tullis, T. S., & Albert, B. (2013). Combined and comparative metrics. In Measuring the User Experience. https://doi.org/10.1016/B978-0-12-415781-1.00008-X

DOI

Variation in Importance of Time-on-Task with Familiarity

Shows that the perception of usability correlates more strongly with time-on-task the more familiar users are with a product.

Suzuki, S., Bellotti, V., Yee, N., et al. (2011). Variation in importance of time-on-task with familiarity. In CHI. https://doi.org/10.1145/1978942.1979314

DOI

Usability Testing Through Devices in Bangladesh

Comparison of task success rate and task times on mobile vs. desktop devices for a university website. Provides real benchmarks and application scenarios.

Yesmin, S., & Atikuzzaman, M. (2023). Usability testing of a website through different devices: a task-based approach. Information Discovery and Delivery. https://doi.org/10.1108/IDD-01-2023-0007

DOI

Frequently asked questions (FAQ)

What is the task success rate?
The task success rate indicates how many users were able to complete a task completely and correctly. It measures the effectiveness of a system and is usually given as a percentage.
What does time-on-task mean?
Time-on-task describes the time users need to complete a task. It is an indicator of the efficiency of use and is measured in seconds or minutes.
How are these metrics collected?
Task success rate: by observation or log data (success yes/no). Time-on-task: by stopwatch in moderated tests or automatically via analytics and session recording.
Why are these key figures important?
With consistent tasks, success criteria, and measurement rules, they provide comparable data on selected usability aspects. Together, they describe goal achievement and time, but do not provide a complete picture of usability.
What are the best practices?
Write realistic tasks, define success criteria and timing boundaries in advance, investigate outliers and report valid abandonments transparently. Qualitative observations help explain the why behind the numbers.
When should you combine both metrics?
When both goal achievement and time matter. A high success rate with a long task time may indicate efficiency problems; interpret both metrics in the task and usage context.
How should partial success count in task success rate?
For a binary task success rate, only the predefined complete outcome counts as success. Report partial completion separately. A weighted score is possible, but report it as a separate metric with its weights clearly defined.
How should I handle outliers in time-on-task?
First check whether a timing error or interruption occurred. Do not simply remove valid unusually long times: for skewed distributions, report the median and interquartile range alongside the mean, and explain any exclusions.

Science corner: evidence data

Setting
Standardized tasks in moderated tests or instrumented products
Replication status
Replicated / repeatedly studied
Evidence level
High (E=4, T=4)
Key sources (APA)
  • International Organization for Standardization. (2018). Ergonomics of human-system interaction—Part 11: Usability: Definitions and concepts (ISO Standard No. 9241-11:2018). Open source
  • Frøkjær, E., Hertzum, M., & Hornbæk, K. (2000). Measuring usability: Are effectiveness, efficiency, and satisfaction really correlated? Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 345–352. https://doi.org/10.1145/332040.332455
  • Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies and research. International Journal of Human-Computer Studies, 64(2), 79–102. https://doi.org/10.1016/j.ijhcs.2005.06.002
  • Sauro, J., & Lewis, J. R. (2005). Estimating completion rates from small samples using binomial confidence intervals: Comparisons and recommendations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(24), 2100–2103. https://doi.org/10.1177/154193120504902407
Review date / version
2026-11-01 · 1.1
Next review
2027-11-01 (Review cycle: 12 months)

Last modified: 1 November 2026