Methods for Conducting Usability Tests

Introduction

Conducting usability tests effectively is essential to identifying and resolving usability issues in software. There are several methodologies available that can be tailored to the specific needs of a project.

Common Usability Testing Methods

1. Moderated Testing

A moderated testing session is conducted in person or remotely by a trained researcher who introduces the test to participants, answers their questions, and asks follow-up questions.

2. Unmoderated Testing

Users complete tasks in their own environments, with their interactions recorded by automated tools.

An unmoderated test is conducted without direct supervision: participants may be in a lab, but they are more likely to be in their own homes and/or using their own devices to navigate the website or app being tested.

3. Eye-tracking

In eye-tracking testing, researchers monitor users’ eye movements using a special device. This allows you to create heat maps that show where users focus when performing a task.

These studies help you understand how users interact with a page and test its layout and design. However, they are expensive, as they involve renting a lab with specialized equipment and having a trained technician operate the system.

4. Post-Test Interviews

After completing the tasks, users are interviewed to obtain detailed qualitative feedback on usability. Interviews can be conducted either in person or over the phone.

The most cost-effective way to carry out this method is over the phone, since it is possible to test people from different geographical areas.

5. Heuristic Evaluation

Heuristic Evaluation (originally proposed by Jakob Nielsen and Rolf Molich in 1990) is an inspection technique that helps identify usability problems in an interface. In other words, a heuristic evaluation can be defined as a review of your interface, taking into account aspects of the user experience.

In this inspection, usability experts examine and judge whether each element of the interface complies with usability principles (heuristics).

Methods that are not usability testing

Usability testing involves individuals testing and experimenting with the functionality of a website or application. The techniques listed below are sometimes labeled as usability testing — and while they are technically not, they can (and should) be used in conjunction with usability testing to generate more comprehensive results:

• A/B testing: Unlike usability testing, which investigates user behavior, A/B testing involves trying out multiple versions of a web page to see which one is most effective. It is an important tool for increasing conversions.

• Acceptance testing: This is usually the last phase of the software testing process, where users follow a specific set of steps to ensure that the software works correctly. This is a technical quality assurance test, not a way to assess whether the product is efficient and easy to use! Still, acceptance testing is an important step in creating a well-reviewed product.

• Focus group: When conducting a focus group, researchers gather a small number of people to discuss a specific topic. It’s a great way to find out participants’ opinions about a product or service (but it can also introduce bias when some participants are more vocal or persuasive than others).

• Surveys: As a proxy for user experience, surveys can be used in conjunction with usability testing as a follow-up or feedback collection method.

Conclusion

Choosing the right methodology for conducting usability testing depends on the goals and resources of the project, and there are a wide range of methods, tools, and technologies that can be useful when performing usability testing. Using a combination of these approaches can provide comprehensive insights for improving software usability.