Skip to content

Companies risk passing off AI predictions as consumer opinion

Synthetic respondents offer a cheaper way to test consumer preferences. Publishing their answers as public opinion leaves companies defending claims that no customer actually made.

Companies risk passing off AI predictions as consumer opinion
Open brief

A survey can produce results without consulting consumers

Synthetic respondents allow companies to generate plausible answers to research questions without conducting equivalent human fieldwork. The reputational risk emerges when those modelled preferences enter a press release or commercial presentation as evidence of what customers actually think.

Research credibility

A calculated percentage can still make an unsupported claim

A model can generate responses from thousands of simulated profiles, and the resulting percentages can be mathematically accurate. Yet those figures describe the model's outputs. They do not establish that the corresponding proportion of real consumers holds the same view.

The distinction reaches the core of reputational data integrity. It also creates a procurement question as communications firms invest in proprietary prediction technology. Buyers need to understand which findings were observed, which were estimated and what independent evidence supports any claim intended for publication.

What's inside

Where generated answers can acquire false authority

The article follows synthetic research from the supplier's methodology to the final public claim, examining how demographic plausibility and favourable benchmarks can obscure the absence of direct human evidence.

Research design

Who answered?

A generated persona, an estimate based on a real participant's historical data and an observed response to the current question have different evidentiary meanings. The supplier must distinguish them.

Validation

What was tested?

Agreement with a human benchmark at the overall level may conceal errors within the audience segment most important to the decision. More generated responses do not resolve that uncertainty by themselves.

Publication

What can be claimed?

A modelled estimate may support a disclosed forecast. Reporting that consumers expressed a preference requires evidence from people who actually answered the relevant question.

Publication standard

Approval must follow the evidence behind the claim

The research owner should establish the provenance of the responses and approve the precise claim intended for external use. Where synthetic findings have been benchmarked against human data, the comparison needs documented limits and a clear separation between evidence used to develop the model and evidence reserved for testing. The same concern underlies the need for defensible AI measurement standards and independent checks of corporate claims.

Disclosures should identify whether the published finding is modelled, observed or derived from a combination of the two. The practice connects to documenting AI use in public-facing materials, where a description of methodology needs to reflect what actually occurred. A disclaimer placed far from the headline cannot reliably resolve the problem if the headline and its qualifications communicate conflicting impressions.

Publication controls also need to remain effective under campaign deadlines. As with organizations that bypass established AI governance, the existence of an approval policy provides limited protection when a commercially attractive result can reach journalists before its evidentiary basis has been checked. The defensible standard is to preserve the distinction between generated predictions and statements actually obtained from people, wherever the finding is reused.

This post is for paying subscribers only

Subscribe

Already have an account? Sign In

Latest

Reputation Insider

Independent reporting, analysis and practical guidance on reputation management, online reputation, AI search, crisis communications and reputation technology.