Skip to content
BunnyDevs
AI8 min

Support Chatbots That Reduce Load Instead of Adding To It

Most support bots make things worse: they stand between the customer and a person, and everyone learns to type 'agent' immediately. The ones that work are built to a different brief.

BunnyDevs

Most support chatbots make the experience worse. They stand between a person with a problem and a person who could solve it, they answer confidently with things that are not true, and within a week customers have learned to type "agent" as their opening message.

The ones that work are built to a different brief. Not "replace support" but "answer the questions that have a documented answer, immediately, and get out of the way for everything else."

That distinction decides everything that follows.

Look at your tickets first

Before any technology decision, take the last few hundred support conversations and sort them into three piles:

Answered from documentation. Opening hours, how to reset a password, what a policy says, where to find a setting, whether you ship somewhere. The answer exists in writing and never varies.

Needs account context. Where is my order, why was I charged this, what plan am I on. Answerable automatically, but only with a lookup and proper authentication.

Needs judgement. Complaints, exceptions, anything where the answer is a decision. A bot should not touch these.

The first pile is what a support bot is genuinely for. It is often a larger share of volume than people expect, and it is the most tedious work your team does, which means removing it is popular internally as well as useful.

If the first pile is small, a chatbot is the wrong investment. Better search or a rewritten help centre will do more for less.

Answer only from your own content

A general-purpose model answering support questions from its own training will invent plausible policies you do not have, and it will do so in your brand voice, which makes it worse.

The pattern that works is retrieval: the bot searches your documentation, then answers using only what it found. If the search returns nothing relevant, the correct behaviour is to say so and offer a human — not to improvise.

This is the same architecture as any retrieval system, with the same failure modes; our post on RAG in production covers what breaks and how to detect it.

Cite the source on every answer. A link to the page the answer came from does three things: it lets the customer verify, it gives them somewhere to go for more, and it makes wrong answers immediately traceable to the document that caused them.

The rules that keep it honest

Show the escape hatch from the first message. A visible way to reach a person, always. Counter-intuitively this reduces the number of people who use it, because the anxiety of being trapped is what makes people demand an agent pre-emptively.

Hand over with the conversation attached. Nothing is more irritating than explaining the problem twice. The agent should open the ticket and see everything already said.

Escalate on repetition. If the customer rephrases the same question twice, the bot has failed. Stop trying and pass it on.

Escalate on frustration. Detecting anger is unreliable; detecting the words people use when angry is not. Route those conversations to a human immediately.

Never let it guess about money, cancellations or legal terms. These are the answers that produce complaints and refunds when they are wrong.

The unglamorous work that decides success

Your documentation is the product. A bot answering from a help centre that is out of date will confidently tell people things that stopped being true a year ago. Most of the effort in a successful deployment goes into fixing the source content, and that work improves your self-service search whether or not the bot ever ships.

Write for retrieval. One question per page, an answer near the top, plain headings. Long pages covering nine topics retrieve badly because the relevant paragraph is diluted.

Keep it current. Assign ownership. A quarterly review at minimum, and a rule that any policy change updates the document the same week.

Measure the right things

Resolution, not containment. A conversation that ended is not the same as a problem that was solved. Count the ones where the customer did not come back within a few days about the same issue.

Escalation rate, and whether it is falling. Rising escalation means the content is drifting from reality.

Answer accuracy, sampled by hand. Read fifty conversations a week for the first couple of months. Automated metrics will not show you a confidently wrong answer; a person reading will.

Customer satisfaction, split by path. Bot-only versus escalated. If satisfaction on the bot path is materially lower, you are trading cost for goodwill, which is a decision you should make deliberately rather than discover later.

How we would start

One channel, the top twenty documented questions, a visible human handover, source links on every answer, and a fortnight of reading transcripts before widening scope.

If accuracy holds, expand the content coverage. Only then consider account lookups, and only then, much later, actions.

When to say no

If your product changes weekly and the documentation cannot keep up, a bot will be wrong faster than you can fix it. If your support volume is low, the effort is better spent elsewhere. And if the reason for the project is that support is under-resourced, a bot is not the answer to that — it is a way of making the shortfall less visible while complaints rise.

We would tell you that rather than build it, and it has cost us work before.

If you want to know whether your ticket mix supports this — including the version where it does not — tell us what your support team actually gets asked.

Questions people ask

What deflection rate is realistic?

For a bot restricted to answering from your own documentation, resolving a meaningful minority of contacts is a good outcome, and the share is highest for repetitive factual questions. Anyone quoting a very high figure is either counting abandoned conversations as resolved or has a narrower problem than yours.

Will customers accept a bot?

They accept a fast, accurate answer. They resent a bot that blocks the route to a person. Make the handover to a human visible from the first message and satisfaction usually goes up, because the people who want the bot get it and the people who do not are not trapped.

What about languages?

Modern models handle several languages well, but your source documentation is probably in one. Answering in a language your content does not cover means translating on the fly, which is where accuracy slips. Decide which languages you support properly rather than appearing to support all of them.

Should the bot be able to take actions, like issuing refunds?

Start with answers only. Add actions one at a time, each with a confirmation step, starting with the ones that are cheap to get wrong. Anything touching money or account access should require a human until you have months of evidence.

Want this done rather than explained?

That is the job. Tell us what you are building and we will scope it properly.

Start a project