Test under real conditions
This technique gives a possible implementation for the CategoryBpTesting using cheap or expensive technology.
A lot of testing for mobile services can be (and is) done using emulators rather than actual devices. While this is a lot cheaper than buying a large collection of mobile devices and paying commercial mobile data rates for testing, it can fail to show some important problems. If the emulator is running in a quiet office environment, on a high-quality screen under optimised lighting conditions, using an unrealistic input system (computer keyboard instead of phone keypad, or ergonomic mouse instead of very small joystick) it will not give a true representation of user experience. For issues such as CategoryBpColorContrast or CategoryBpBackgroundImageReadability this could lead to being optimistic about what provides an acceptable user experience.
Pre-requisites:
- At least one web-enabled mobile device
- Web browser on the device
- Being able to go out on the street
Implementations Steps:
- Put your service online, where you can access it.
- Take your device(s) to places where real people will try to use the service -
- A train, during rush hour
- A crowded bar or pub
- A business meeting, or a class
- A sunny spot
- A library, or cinema queue
- ...
Test the service thoroughly, both from the perspective of a first-time user and an experienced user.
- Are there problems seeing the details in bright light?
- Or in low light?
- Does it rely on unrealistically clear sound transmission?
- Does it take you through too many steps?
- Does it assume knowledge about how the service is designed?
- Does it demand too much attention?