Why field testing is critical for real-world app success

Profile picture for user ross
Ross

When developing a digital product, especially one that will be used in demanding environments, there’s no substitute for field testing. Simulated environments and test cases can only go so far – ultimately, the success of an app hinges on how it performs in actual working conditions. 

What is field testing in UX? 

Field testing is the process of taking a prototype or near-final product into the real world to see how it functions in the exact environment where it will be used. It goes beyond theoretical or lab-based testing by placing the product in the hands of actual users, in real-world conditions. The purpose is to identify unforeseen issues, gather feedback, and iterate on the product to ensure it’s as effective and user-friendly as possible.

The importance of field testing 

Real-world conditions: No matter how thorough internal testing is, it’s difficult to replicate real-world conditions in a controlled environment. Field testing exposes the product to the challenges and variables that users encounter daily.

User feedback: Getting direct feedback from users who are using the product in their natural environment is invaluable. It’s the only way to fully understand how the product performs and whether it meets their needs.

Usability and adaptability: Even the most carefully designed apps can fall short if users find them difficult to navigate or unintuitive in practice. Field testing helps identify usability issues.

Field testing in action: 40Seven’s iOS app project 

Recently, whilst developing an iOS app prototype for 40Seven, we didn’t just stop at internal testing. We went out into the streets of Sheffield with a surveyor to conduct testing of the prototype in a real-world environment.

This allowed us to see firsthand how the app performed under actual working conditions. The feedback we received was invaluable and highlighted areas where we could make further improvements, including adding a dark mode option when viewing asset shape files in varying light levels, increasing the legibility of text, and adding the ability to exit and return to surveys once started to allow surveyors to survey one side of the street before looping back later in the day. 

These enhancements were only possible because of the feedback we gathered during field testing.

Ensuring products work in the environments they’re made for 

Field testing is a crucial step in the development process. By taking prototypes into the environments they're meant for and gathering direct user feedback, businesses can refine their products to ensure they perform effectively.

In the case of 40Seven, field testing helped us ensure that their new app was not only functional but also made the surveyors daily tasks easier to do. Without this step, we might have missed those opportunities.
 

Case study

Service design

Evolving 40Seven’s asset survey process to support new clients and cut manual work

Implementing a software project roadmap to help facilitate business process changes