Skip to content
Isometric assistant node: a dark core with a lit accent panel and two wires to source documents

For founders

What makes users trust an AI feature

Stack Overflow's 2025 survey found 46% of developers distrust the accuracy of AI output, and the top frustration is answers that are almost right. Trust in AI features is designed, not earned by the model alone. Four decisions that build it, from research and from shipping one.

Prashant Kumar Singh · · 4 min read

In short

  • 46% of developers in Stack Overflow's 2025 survey distrust the accuracy of AI tools; 66% name "almost right" answers as the top frustration.
  • Citations raise trust even when they are wrong, which makes real, checkable sources a responsibility rather than a feature (AAAI 2025).
  • Design for the wrong answer first: sources, a fallback and a human check. Microsoft's HAX guidelines give "when wrong" its own phase.

The 2025 Stack Overflow developer survey has a number that should be on the wall of every team adding AI to a product: 46% of developers say they distrust the accuracy of AI output, up sharply from the year before. Asked about frustrations, 66% picked answers that are "almost right". Not wrong. Almost right, which is worse, because it has to be checked and cannot be dismissed.

Developers are the most AI-exposed users there are. Where they go, everyone else follows. So the design question for an AI feature is not "how good is the model" but "what does the user need in order to act on an answer they cannot fully trust". Four decisions, in order of how much they matter.

1. Show sources, and make them real

A study presented at AAAI 2025 tested how citations affect trust in AI answers. Citations raised trust even when they were random. When participants checked the citations and found them irrelevant, trust fell below where it started. The lesson cuts both ways: sources are the strongest trust signal you can add, and fake or loose sources are the fastest way to lose a user for good. Link to the exact passage, record or row the answer came from, and make it one click to verify.

2. Ground answers in the user's own data

A generic answer gets ignored, because the user knows it was not written for them. An answer that references their own records, calls, documents or numbers gets read, because it could only have come from their data. This is the single biggest difference between the AI features people use and the ones they switch off after a week.

3. Design for when it is wrong

Microsoft's Human-AI Experience guidelines give an entire phase to "when wrong": make it clear why the system did what it did, support efficient correction, and let the user dismiss or override. In practice this means three things on screen: the source (so the user can check), a fallback (so a bad answer does not block the task), and a human step before anything irreversible happens. A feature with all three survives its first wrong answer. A feature with none of them does not.

4. Build for the questions people actually ask

At Ringover I design AI features inside a call-intelligence platform used by sales teams. The questions reps ask of a call are simpler than product teams expect: what did they object to, what did I promise, what do I send next. Nobody asks for a sentiment trajectory. Designing for the real questions makes the feature right more often, which is the only lasting source of trust.

A checklist for your next AI feature

  1. 1.Every answer links to its source, and the link lands on the exact passage.
  2. 2.Answers use the user's own data by default, not general knowledge.
  3. 3.There is a visible fallback when confidence is low or the source is missing.
  4. 4.Nothing irreversible happens without a person approving it.
  5. 5.The feature is built for the three questions users ask most, found by asking them.

None of these require a better model. All of them require deciding, before the build, that the user's ability to check the answer is part of the product.

Questions people ask

How many developers trust AI output?
In Stack Overflow's 2025 developer survey, 46% said they distrust the accuracy of AI tools, and 66% named "almost right" answers as their top frustration.
Do citations make people trust AI answers more?
Yes, and that is the problem. An AAAI 2025 study found citations raised trust even when they were random, and trust fell when people checked and found them irrelevant. Sources must be real and verifiable.
How do you design an AI feature for wrong answers?
Show the source so the user can check, offer a fallback so a bad answer does not block the task, and keep a human approval step before anything irreversible. Microsoft's HAX guidelines cover this as a distinct design phase.

If you're a founder

If your AI feature produces answers, send it for the free teardown and I will check it against the five-item list above and tell you where trust leaks.

If you run an AI lab or data team

Graders have the same trust problem as users. A score with no trace is a verdict nobody can check. Rubrics that show which criterion failed and why get adopted; opaque ones get argued with.

Sources

  1. Stack Overflow 2025 Developer Survey, reported by TechRepublic
  2. Ding et al., Citations and Trust in LLM Generated Responses, AAAI 2025
  3. Microsoft HAX Toolkit, Guidelines for Human-AI Interaction

Free first step

Get a free one-page teardown.
No call needed, no commitment.

Send your product or idea. You get one page: what to fix, what to cut, what I'd build first.

Send your product for a teardown

Free · One page back · No commitment

Prefer email? prashantkumarsingh.work@gmail.com