Skip to content
Members

AI Business Case StudyNo. 354

87% self-serve, 95% accuracy: how two companies actually got there

Business Analytics Newsletter

· 11 min read

The Support Bot That Works Because It’s Not Allowed to Improvise

Illustration for 87% self-serve, 95% accuracy: how two companies actually got there

What You’ll Learn From This Case Study

  • The specific architectural choice that separates AI support tools that hold up in production from ones that only look good in a demo

  • Why Intercom’s own engineers swapped a more powerful model for a cheaper one, and what that reveals about evaluating any AI vendor’s model claims

  • Why vendor-reported “resolution rates” in this category tend to run well above what independent, production-level testing finds, and how to define the metric for yourself

  • The scoping and ramp-time pattern behind two documented deployments, Synthesia and Fundrise, that hit real numbers within three to six months

  • A five-step framework for evaluating or building an AI support agent that won’t fall apart under real ticket volume

Table of Contents

  1. Executive Summary

  2. Case Study in One Sentence

  3. The Organization

  4. The Challenge

  5. The AI Strategy

  6. The Implementation

  7. Results

  8. Why It Worked

  9. Lessons for Readers

  10. Replication Framework

  11. Mistakes to Avoid

  12. Steal This Idea

  13. The Strategic Insight

  14. Key Takeaways

  15. Closing Thought

Executive Summary

  • Intercom’s Fin AI Agent resolves support conversations using a multi-step pipeline, not a chatbot connected directly to a language model.

  • Two documented customer deployments show real, specific outcomes: Synthesia resolved over 6,000 conversations and saved over 1,300 hours in six months; Fundrise automated more than half its support volume in three months at 95% accuracy.

Members only

This is a Daily Edition

Members get the full analysis every publishing day, by email and on the web.

10 more minutes of this edition

Membership opens soon, at $89 a year or $9 a month. See what members get

Get the free edition meanwhile

The Free Edition by email, plus the opening of every Elite Edition.

Email sign-ups open soon

Every Free Edition is already open on the web, and the feed works in any reader.

Read the Free EditionsFollow by RSS

Already a member? Sign in

Reader sign-in opens very soon, together with free and paid subscriptions.

Share this editionLinkedInX