AI Chatbot for Business - How Much Does It Cost, How Does It Work, and When Does It Pay Off?
RETURN_TO_BLOG
Updated: AI & Automation 15 min

AI Chatbot for Business - How Much Does It Cost, How Does It Work, and When Does It Pay Off?

Paweł Wiszniewski
Paweł Wiszniewski
SEO & GEO Specialist · AI Engineer

An AI chatbot makes sense when you handle repetitive queries at scale - in practice from about 500 a month, or 20-30 a day. Below that threshold the build and running costs usually don't pay back, and manual handling is simpler. Above it, every month without a chatbot is a concrete payroll cost for answering the same questions repeatedly. The test: count repetitive queries per week and multiply by the hourly cost of whoever handles them.

A chatbot on your website isn't just a 'How can I help?' popup. A well-built AI chatbot answers like an expert, knows your products, qualifies leads and works 24/7 without holidays. A badly built one frustrates customers and damages your brand. I explain the difference, the costs, and when it actually makes sense.

Two weeks ago, the owner of a training company called me. "I want a chatbot on my website." I asked why. "To answer customer questions - they're flooding us with the same emails." I asked how many such emails per day. "Maybe fifteen." I told him not to build a chatbot.

A week later, the owner of a supplements shop called. "I want a chatbot on my website." I asked why. "We get 200-300 enquiries a day via chat, Messenger and email. Three people handle it in rotation, answering the same questions about ingredients, dosages and availability every day." I told her we should start tomorrow.

An AI chatbot isn't a gadget to slap on a website. It's a tool to solve a specific, costly problem. If you don't have that problem - you're in the first group. If you do - every month without a chatbot is money thrown away.

What an AI Chatbot Is - and What It Isn't

For years the word "chatbot" meant a decision tree in a popup: press 1 for orders, press 2 for returns. That bot still exists and still frustrates half of internet users.

An AI chatbot is different. It's a system based on a large language model (LLM) that:

  • Understands questions in natural language - no clicking through options.
  • Responds based on your knowledge base - products, procedures, pricing, FAQs.
  • Holds a conversation - remembers context from earlier messages in the session.
  • Qualifies leads - collects contact details, asks about budget and timeline.
  • Escalates to a human - when the question is too complex or the customer explicitly asks.

The key difference: a rule-based chatbot answers questions you anticipated. An AI chatbot answers questions you didn't anticipate - because it understands intent, not just keywords.

FeatureRule-based ChatbotAI Chatbot (RAG)Human
Understands natural languageNoYesYes
Handles off-script questionsNoYesYes
Knows your products/proceduresOnly programmed onesYes (from knowledge base)Yes
Availability24/724/7Working hours
Handles multiple conversationsYesYesNo
Monthly costLowLow-mediumHigh (salary)
Calibration and maintenanceLittleMediumNone
Error riskNo errors outside scriptLow (with RAG)Human errors

How an AI Chatbot Works - Architecture in Five Steps

A good AI chatbot isn't "ChatGPT glued to your website". It's a system with several layers that together ensure the bot responds based on your data, not the model's general knowledge.

Step 1 - Knowledge Base (RAG) All your documents - FAQs, product descriptions, pricing, return policies, user guides - go into a vector database. Each text fragment is converted into a semantic vector.

Step 2 - User Question A customer writes: "Can supplement X be combined with thyroid medication?" The system converts the question into a vector and searches for semantically matching fragments from the knowledge base.

Step 3 - Context + Model The found fragments are passed as context to the language model (e.g. Claude Sonnet 5.5, GPT-6.1 Sol, or cheaper Claude Haiku 4.5 or GPT-6 Luna for simple questions). The model doesn't answer from its training memory - it answers exclusively based on the provided context.

Step 4 - Response with Citation The bot generates a response. Optionally it cites the source: "According to product card X..." The risk of made-up answers drops sharply, but not to zero - which is why the bot is instructed to say "I don't know" when information is missing, and tests check this before launch.

Step 5 - Escalation If the question is outside the knowledge base, the bot says clearly: "I don't have that information, transferring you to a consultant" - and notifies your team via Slack or email.

/// ARCHITECTURE: AI CHATBOT WITH RAG — FROM DOCUMENT TO ANSWER

01
Documents
FAQ · Price lists · Terms
↓
02
Chunking
Split into fragments
↓
03
Embeddings
Semantic vectors
↓
04
Vector database
Semantic search
↓
05
LLM + Context
Zero hallucinations
↓
06
Chat / Widget
WWW · WA · Slack
ESCALATION
Question outside the knowledge base → bot informs and notifies an agent → Slack / email
60–80%
QUERIES HANDLED BY BOT
0 sec.
RESPONSE TIME
24/7
AVAILABILITY NO TIME OFF

How Much Does a Business Chatbot Cost - Concrete Numbers

This is the question I start every conversation with. The answer depends on three variables: scope, scale and architecture. No fluff:

Type of deploymentBuild costMonthly costFor whom
FAQ chatbot (simple, rule-based)£400-1,600£0-40Small business, a few questions a day
AI chatbot (RAG, small knowledge base)£2,400-5,000£80-200SMB, 20-100 queries a day
AI chatbot (RAG, large knowledge base)£5,000-12,000£160-400Shop/company with large knowledge base
AI chatbot with lead qualification£6,400-16,000£240-560B2B companies, lead generation
Multilingual chatbot + CRM integration£12,000-28,000£400-960E-commerce, customer service at scale

What makes up the monthly costs: - API model tokens (OpenAI/Anthropic) - usage depends on number of conversations and context length. - Vector database hosting (Pinecone, Qdrant) - from £0 to £55. - Middleware/orchestrator server (e.g. n8n) - £16-48. - Knowledge base updates - one-off work when content changes.

Real example: supplements shop, 250 conversations per day, knowledge base of 800 products + 40 FAQ documents. Build: £8,800. Monthly costs: ~£300. Previously the same support required 2.5 full-time employees - £7,200/month in labour costs.

What One Conversation Costs - the Model Makes the Difference

A typical shop conversation is 4-6 messages. With knowledge base context and history, that's about 10k input tokens and 1k output tokens. At October 2026 prices:

ModelCost per conversation7,500 conversations a month (250 a day)
GPT-6 Luna ($0.10 / $0.50 per million tokens)about $0.0015about $11
Claude Haiku 4.5 ($1 / $5)about $0.015about $113
Claude Sonnet 5.5 ($2 / $10)about $0.03about $225

The gap between the cheapest and the strongest option is 20x. In practice you combine them: a cheap model answers simple delivery and returns questions, and a stronger one gets conversations where the customer compares products or asks something unusual. On top of that, prompt caching cuts the cost of the fixed part (instructions and FAQ base) by up to 90%. That's why monthly costs at the supplement shop below stay at a few hundred PLN despite 250 conversations a day.

When a Chatbot Makes Sense - The Three-Question Test

Before you call me about a chatbot, answer three questions honestly:

1. How many repetitive questions do you handle per month? Under 200 enquiries per month - an AI chatbot probably won't pay off in a reasonable timeframe. Over 500 - the conversation makes sense. Over 2,000 - this is an urgent priority.

2. Are your questions similar to each other? If 60%+ of questions cover the same topics (pricing, availability, how it works, delivery time, return procedure) - the chatbot will handle the majority of traffic. If every enquiry is unique and requires expert analysis - a chatbot may not be enough.

3. Do you have a knowledge base to feed the chatbot? A chatbot is only as good as the documents you give it. FAQs, product descriptions, policies, guides - if these exist in some form, they can be processed. If knowledge lives only in employees' heads - documentation first, then a bot.

/// ROI: CUSTOMER SERVICE — BEFORE AND AFTER THE AI CHATBOT

// BEFORE — 250 queries/day
Staff2.5 FTE
Labor cost~9 000 PLN/mo
Response time2–8 hours
Availability8:00–17:00
Onboarding3 weeks for a new hire
// AFTER — AI chatbot + 0.5 FTE
Bot handles70% of queries
System cost~380 PLN/mo
Response time0 seconds
Availability24/7 / 365
Knowledge baseupdated in minutes
~8 600 PLN
MONTHLY SAVINGS
~1.5 mo
RETURN ON INVESTMENT
~103k PLN
ANNUAL SAVINGS

* Example deployment — a supplements store, 250 queries/day, 2.5 FTE support staff.

Types of Chatbots - Which Fits Your Business

There's no one-size-fits-all chatbot. The right choice depends on what you want to achieve.

Customer Support Bot Goal: answering questions, resolving problems, handling returns and complaints. For: e-commerce stores, SaaS companies, services with large customer bases. Key feature: RAG with knowledge base + escalation to human + ticketing system integration.

Lead Qualification Bot Goal: collecting data from potential customers, assessing fit, booking meetings. For: B2B companies with long sales cycles, agencies, consultants, service businesses. Key feature: asking qualification questions, CRM data entry, sending notifications to sales reps.

Internal Knowledge Base Bot Goal: answering employee questions about procedures, benefits, IT, HR. For: companies with many employees and extensive internal documentation. Key feature: RAG with company documents, role-based access control.

E-commerce Product Advisor Bot Goal: helping with product selection, comparisons, cross-sell/up-sell. For: shops with a wide range or complex products. Key feature: integration with product database (WooCommerce API, Shopify), dynamic recommendations.

Where to Deploy a Chatbot - Channels and Integrations

A chatbot doesn't have to live only on your website. A well-designed system works everywhere your customers are:

  • Website widget - classic pop-up in the corner. Highest traffic, easiest start.
  • Messenger / Instagram DM - Meta Business Suite + webhook. Handling social media enquiries.
  • WhatsApp Business - WhatsApp API + n8n. Very effective in industries where customers use WhatsApp.
  • Slack / Teams (internal) - for HR and IT helpdesk chatbots.
  • Email - bot reading emails and responding automatically. Less interactive, but handles an existing channel without changing customer habits.

One deployment, multiple channels simultaneously - possible when the architecture is correct. The brain (RAG + model) is one, channels are just interfaces.

How My Deployment Works - Step by Step

I don't build chatbots by clicking in off-the-shelf SaaS platforms. Every "chatbot-as-a-service" platform means vendor lock-in, limitations and costs that grow with scale. I build on a custom architecture - n8n + chosen LLM + vector database.

Stage 1 - Audit and Knowledge Inventory (3-5 days) We gather all documents: FAQs, product descriptions, procedures, terms and conditions. We identify gaps - questions the bot won't be able to answer because the information doesn't exist in any document.

Stage 2 - Building the RAG Knowledge Base (3-5 days) I process documents: chunking, embeddings, indexing in the vector database. I test search quality - does the question "how much is shipping to Germany" actually retrieve the right fragment from the pricing document?

Stage 3 - Model Configuration and System Prompt (2-3 days) I set the bot's personality, tone of voice, escalation rules and limits - what the bot cannot do (e.g. it doesn't promise discounts without verification, it doesn't give medication dosages without legal disclaimers).

system-prompt-chatbot.txt
### ROLEYou are a helpful customer service assistant for [COMPANY NAME]. You answer exclusively based on the provided knowledge base. If you don't know the answer - say so clearly and offer to connect the customer with a consultant.

RULES - Never invent prices, delivery times or product specifications. - Do not make promises not found in the documents. - If the customer is frustrated - show empathy and escalate to a human. - Do not comment on competitors.

ESCALATION Transfer the conversation to a consultant when: 1. The customer explicitly asks to speak with a person. 2. The question involves a complaint over £400. 3. The topic is not covered in the knowledge base.

Stage 4 - Interface Build and Integrations (3-7 days) Website widget, channel connections, CRM integration (lead capture), Slack notifications on escalation.

Stage 5 - Testing and Calibration (3-5 days) 100+ test questions - including trick questions, incorrect inputs and edge cases. We check whether the bot hallucinates, whether it escalates at the right moments, whether it maintains the brand's personality.

Stage 6 - Launch and Monitoring (ongoing) The first 2-4 weeks are live calibration. I review logs, fill gaps in the knowledge base, improve prompts where the bot answered poorly.

Security and GDPR - The Most Common Concern

"Do customers enter personal data in the chat, and does it fly off to OpenAI?" - I hear this regularly.

The answer: it depends how you build it. I build it like this:

  • The chatbot runs through a paid API under business terms - OpenAI and Anthropic don't train models on this data. No training isn't the same as no storage, though: OpenAI keeps API data for up to 30 days by default in abuse monitoring logs, and zero retention requires vendor approval. That's why masking is added:
  • Before sending to the API, the conversation passes through a PII masking layer - name, email, phone are replaced with tokens [NAME_1], [EMAIL_1] and restored locally after the response.
  • Conversation logs are stored on your server, not with the model provider.
  • Log retention according to your GDPR policy - default 90 days, then automatic deletion.

This PII masking layer is exactly the pseudonymize-before-the-prompt mechanism I break down step by step in GDPR and AI - along with when a chatbot like this needs a DPIA.

A customer writes "I want to cancel my order, I'm John Smith, order number 12345". What goes to the API: "I want to cancel my order, I'm [NAME_1], order number [ORDER_1]". The model responds, the system substitutes the data back. John Smith gets a personalised response. His data never left your infrastructure in plain form.

The AI Act and Liability for the Bot's Answers

Two things worth knowing before launching in 2026:

  • Telling people it's AI. From 2 August 2026, Article 50 of the EU AI Act requires that a person interacting with an AI system knows they aren't talking to a human - unless it's obvious from the context. In practice a clear message in the chat window is enough ("AI assistant - I can make mistakes, and I can connect you to a person at any time"). I cover the obligations in more detail in the AI Act guide.
  • The company is responsible for what the bot says. In 2024 a Canadian tribunal ordered Air Canada to compensate a customer whose airline chatbot had described a discount policy incorrectly. The airline argued the chatbot was "responsible for its own actions" - the tribunal rejected that. The lesson: the bot must not promise discounts, refunds or deadlines that aren't in the documents, and answers about money should rest on a quoted passage of the terms.

What a Chatbot Won't Do - Realistic Expectations

Chatbot vendors often over-promise. I prefer to say clearly what a bot won't do:

  • It won't replace an expert in complex, multi-threaded consultations (e.g. legal, medical or financial advice requiring deep situation analysis).
  • It won't fix a bad offer or bad product - unhappy customers will be unhappy faster and through more channels.
  • It won't work well without an up-to-date knowledge base - the chatbot is only as good as the documents it received.
  • It won't handle 100% of traffic - there will always be cases requiring a human. The goal is handling 60-80% of traffic, not 100%.

A chatbot is a tool for scaling the first line of support, not for replacing the entire team.

Comparison: Custom Architecture vs. SaaS Platforms (Tidio, Intercom, Drift)

Clients often ask: "Can I just buy Tidio for $50?" The answer: it depends.

CriterionSaaS Platform (Tidio/Intercom)Custom Architecture (n8n + RAG)
Time to deploy1-3 days2-4 weeks
Cost at 1,000 conversationsSubscription plus AI fees (e.g. Intercom Fin: $0.99 per resolved outcome)Tokens and server: usually $30-100
Data privacyData through SaaS serversData stays with you
Custom knowledge base (RAG)Limited / weakFull control
Integration with custom ERP/CRMOften unavailableYes (via API/n8n)
Own AI model (Ollama, local)NoYes
Logic flexibilityLimitedFull
Vendor lock-inYesNo
Best forQuick start, low trafficScale, sensitive data, customisation

My recommendation: Tidio or Crisp to start - to see what chat traffic looks like and what questions actually come in. After 3-6 months of data, when you know it's worth it - build the custom architecture that doesn't limit you.

How to Measure Whether the Chatbot Is Working - KPIs

A chatbot without measurement is a chatbot for show. Here are the metrics I track for every deployment:

  • Containment Rate - % of conversations resolved by the bot without escalation. Target: 60-80%.
  • CSAT (Customer Satisfaction Score) - user ratings of conversations. Target: >4/5.
  • First response time - 0 seconds. This always beats a human queue.
  • Qualified leads captured - for sales bots: how many leads the bot collected and passed to CRM.
  • Cost per conversation - total system cost / number of conversations. Compare with hourly labour cost × average conversation time.
  • Fallback Rate - % of "I don't know" responses. High fallback = gaps in the knowledge base.

FAQ

---

Getting hundreds of repetitive questions a month and several people answering the same things in rotation? I help with this as part of AI process automation - starting with an analysis of a sample of your conversations to work out how many a chatbot would take over.

/// SOURCES

/// AUTHOR
Paweł Wiszniewski – AI & Web Engineer

Paweł Wiszniewski

SEO & GEO Specialist & AI Engineer

SEO/GEO specialist (10 years) and AI engineer (3 years). I build search visibility, AI systems and automations that reduce costs and improve operational efficiency.

Signal received?

Terminate
Silence

Initiate protocol. Establish connection. Let's build something loud.

> WAITING_FOR_INPUT...