The market research & insights industry is buzzing with excitement over newly emerging and horizon applications of artificial intelligence (AI), and rightfully so. Machine learning, when applied to open-end coding, data processing, survey programming/administration, participant sourcing, and even quantitative/qualitative interviewing is sure to have a lasting impact on helping us deliver faster, higher quality insights at lower costs. However, arguably the biggest impact that AI has had on the insights industry to-date is one that all research practitioners and end-users should be very afraid of, and one that we’re not talking nearly enough about…SURVEY BOTS.
The market research & insights industry is buzzing with excitement over newly emerging and horizon applications of artificial intelligence (AI), and rightfully so. Machine learning, when applied to open-end coding, data processing, survey programming/administration, participant sourcing, and even quantitative/qualitative interviewing is sure to have a lasting impact on helping us deliver faster, higher quality insights at lower costs. However, arguably the biggest impact that AI has had on the insights industry to-date is one that all research practitioners and end-users should be very afraid of, and one that we’re not talking nearly enough about…SURVEY BOTS.
It’s certainly a scary issue, but not an insurmountable one. Clients and suppliers need to remain vigilant and work together to minimize the impact of survey bots. A handful of effective and relatively painless techniques to do so include:
- reCAPTCHA – Those “I’m not a robot” widgets that we see on so many eCommerce and social media sites are quite easy to insert into most online surveys. If you’re using a survey platform that doesn’t allow them, it may be time to start shopping for a new provider.
- Quality control questions – A great method to help control bots (as well as to keep human participants on-task and engaged) is to pepper a handful of short quality control questions throughout your survey. Open-ended questions and multimedia (e.g., asking respondents to listen to an audio snippet and respond) tend to be more difficult for bots to overcome.
- Rely on sample providers who are equally obsessive about data quality – Any reputable online sample provider should be working on your behalf to prevent bots from making their way into your survey. Additionally, any that do slip through the cracks should be removed and replaced at no additional charge.
Unfortunately, there is no catch-all solution to the issue of survey bots, which is why it’s important to take quality assurance measures during all study phases, from sample procurement to survey development/programming to data analysis. As an industry, the best thing we can do is collectively admit that we have a problem and partner with one another to make sure we keep this issue at bay.
The quality control steps described above provide an example of Accelerant Research’s approach to service that we take on each project. We sweat the details. We invite you to request a cost estimate from us and experience the difference that we provide for yourself. Simply give us a call (704-206-8500) or send us an email ([email protected]).