AI Snake Oil

Michael Wagstaff • 10 March 2025

AI based consumer insight models more illusion than substance

Market research has always sought reliable ways to understand consumer behaviour. With the rise of artificial intelligence (AI), many agencies now promote AI-driven models as revolutionary solutions, promising deep consumer insights at unprecedented speed and scale. However, caution is required. Despite appealing marketing, many AI-based market research solutions today echo the practices of historical snake oil salesmen, offering more illusion than substance.


Synthetic solutions

The foundational challenge with AI-driven consumer insights lies in the quality and representativeness of the training data. AI models learn patterns from historical data sets, which themselves are often skewed, incomplete or biased. When consumer insights rely on such data, the resulting analysis inherits these limitations. Many datasets exclude certain demographics, neglect cultural nuances or reflect outdated behaviour patterns. Consequently, AI models frequently deliver insights that are accurate in theory but irrelevant or misleading in practice.


Another issue is the incorporation of synthetic data—artificially created data points intended to fill gaps or enhance datasets. While synthetic data can superficially improve model performance, it also introduces distortions. Models trained partly on synthetic data often produce outputs detached from real-world contexts. Rather than providing nuanced insights into genuine consumer behaviour, these models deliver broad generalisations or, worse, misleading predictions that businesses mistakenly trust.


Patterns not perspectives

AI-driven consumer insight often struggles to produce genuinely new or innovative perspectives. The nature of AI, being reliant on historical patterns, means these models largely recycle existing knowledge. Rather than uncovering groundbreaking consumer motivations or future trends, AI models typically reinforce established observations. While useful for affirming known insights, this rarely helps organisations anticipate truly novel consumer shifts or disruptions.


Perhaps the most fundamental limitation is the misguided belief that consumer behaviour can be fully quantified, modelled and predicted through algorithms alone. Human decisions and behaviours are influenced by complex emotions, spontaneous circumstances, cultural contexts and ever-changing social dynamics. Algorithms, however sophisticated, cannot fully replicate or predict this nuanced complexity. AI-driven insights can therefore offer partial views but should never be mistaken for complete or infallible consumer understanding.


Properly utilised AI can make a difference

This does not render AI irrelevant in market research. Properly utilised, AI can efficiently manage large datasets, identify broad trends and automate repetitive tasks, freeing researchers to explore deeper human contexts. However, agencies promising that their AI alone will deliver transformative consumer insights risk selling false assurance, reminiscent of historical snake oil salesmen.


Genuine understanding of consumer behaviour remains deeply human, requiring context, intuition and exploration beyond algorithmic reach.

by Michael Wagstaff 8 April 2025
The huge volume of data available through consumer comments, reviews and surveys can make cutting through the noise difficult. In this article we discuss how text analytics combined with human expertise can uncover the insight.
by Michael Wagstaff 3 March 2025
With the online survey already on the ropes due to poor quality, has data science finished it off?
by Michael Wagstaff 24 February 2025
Research agencies are pinning their futures on AI. Are they right to do so or are we missing trick by ditching the human?
by Michael Wagstaff 12 February 2025
Online surveys suffer from fake, ill considered and unrepresentative responses. What can be done to improve their reliability? Triangulation is the key.
by Michael Wagstaff 11 February 2025
With so many agency panels riddled with fake respondents resulting in poor quality data, are we witnessing the end of the online survey?
by Michael Wagstaff 6 February 2025
With the January transfer window closed, we run our predictive model to work out the probabilities of where each team will finish in the final Premier League table.
by Michael Wagstaff 5 February 2025
In this latest article in our series on the power of text analytics we look at how sentiment analysis can be used to really understand what customers think about product offerings.
by Michael Wagstaff 23 January 2025
The true value of review sites lies in going beyond the stars and analysing what reviewers are actually saying.
by Michael Wagstaff 17 January 2025
Start making sense of customer review and feedback data by using text analytics. In the first of a series of articles we discuss how it can help your business.
by Michael Wagstaff 9 January 2025
In this article look at the state of the market research industry in 2025 and highlight poor sample, over reliance on AI and the dumbing down of agency expertise as destabilising factors that urgently need addressing.
Show More