Pollfish supports multiple layers of quality checks. This is an ongoing process since we constantly try to improve the quality of the data collected by ensuring the best possible flow from the respondent's perspective.
1. Fraudo Checks
When answers are submitted to the server-side for validation, different quality checks take place by our proprietary anti-fraud system called Fraudo. Depending on the outcome of the Fraudo system the platform accepts or rejects a survey complete. Depending on the rejection reason from Fraudo (for example Gibberish or Hasty answers), the user may have to go and retake the survey or get screened out (for example if the user is under VPN).
2. Quality Questions
Pollfish injects Quality questions (for example trap, red herring, attention) within surveys in order to ensure that a user will answer trustfully.
Those Quality Questions are placed at different points within surveys depending on the type of each survey. If a user fails to answer successfully a Quality Question, the user enters into a loop where he/she is "educated" to read carefully and then wait to go to back and re-take the survey or answer a new Quality Question. The time needed for the user to wait until re-taking the survey increases if the user fails multiple times to pass a Quality Question.
3. Other Quality checks within the survey flow
Within the survey flow the platform also does different checks and validations aside from the usage of Quality questions to ensure that the user is reading carefully and provides quality responses.
Some of those checks include notifying the user if he/she is answering too fast, checks for straight lining, prevention of copy pasting in open ended questions and others.