Another brilliant idea I wish I had thought of. Rainforestqa.com
Brilliantly simple. You describe the action that you want to test. Rainforest QA then have a ‘crowd’ of people – real humans rather than scripts, who do the action that you requested and tell you (or show you in terms of screen shots) what happened.
Within 5 minutes I got 5 results. 3 out of five got the result that I expected, but crucially 2 of them gave me a different result proving that the way we assumed our Users would act was different to how they actually acted.
You can pay for 100 ‘actions’ per month for £65 / $100. Why wouldn’t anyone include this in their development and testing strategy? Brilliant.