AI Business Case StudyNo. 354
87% self-serve, 95% accuracy: how two companies actually got there
Business Analytics Newsletter
· 11 min read
The Support Bot That Works Because It’s Not Allowed to Improvise
What You’ll Learn From This Case Study
The specific architectural choice that separates AI support tools that hold up in production from ones that only look good in a demo
Why Intercom’s own engineers swapped a more powerful model for a cheaper one, and what that reveals about evaluating any AI vendor’s model claims
Why vendor-reported “resolution rates” in this category tend to run well above what independent, production-level testing finds, and how to define the metric for yourself
The scoping and ramp-time pattern behind two documented deployments, Synthesia and Fundrise, that hit real numbers within three to six months
A five-step framework for evaluating or building an AI support agent that won’t fall apart under real ticket volume
Table of Contents
Executive Summary
Case Study in One Sentence
The Organization
The Challenge
The AI Strategy
The Implementation
Results
Why It Worked
Lessons for Readers
Replication Framework
Mistakes to Avoid
Steal This Idea
The Strategic Insight
Key Takeaways
Closing Thought
Executive Summary
Intercom’s Fin AI Agent resolves support conversations using a multi-step pipeline, not a chatbot connected directly to a language model.
Two documented customer deployments show real, specific outcomes: Synthesia resolved over 6,000 conversations and saved over 1,300 hours in six months; Fundrise automated more than half its support volume in three months at 95% accuracy.
Members only
This is a Daily Edition
Members get the full analysis every publishing day, by email and on the web.
10 more minutes of this edition
Membership opens soon, at $89 a year or $9 a month. See what members get
Get the free edition meanwhile
The Free Edition by email, plus the opening of every Elite Edition.
Email sign-ups open soon
Every Free Edition is already open on the web, and the feed works in any reader.
Already a member? Sign in
Reader sign-in opens very soon, together with free and paid subscriptions.