4
1 Comment

Good AI Products Don't Feel Like AI.

What six deployments taught us about the relationship between visible intelligence and actual usefulness.


The voice agent went live at a large auto dealership group in Q3 of last year. Full-duplex. End-to-end latency under 800 milliseconds. It handled appointment scheduling, inbound inquiries, trade-in assessments, and outbound follow-up on dormant leads.

Three weeks in, the dealer principal pulled us into a call.

We braced.

"I've been monitoring the call recordings," he said. "I want to make sure I'm hearing this right. Customers are talking to the system like it's a person."

He was waiting for us to tell him there was a problem.

There wasn't one. That was the product working.


That call stuck with me, because it surfaced something we'd been noticing across deployments but hadn't named cleanly.

The AI products that performed best in the field — the ones that got renewed, expanded, and referred — weren't the ones with the most impressive AI surfaces. They weren't the ones where users could select models, adjust parameters, or interact with an agent framework.

They were the ones where the user experience contained almost no evidence that AI was involved at all.

That sounds counterintuitive in an industry that has spent three years making AI as visible as possible.

It's the most consistent pattern we've seen across six deployments.


The dealership: what disappearance looks like at scale.

The auto group had a specific problem. Their inbound call volume during advertising pushes exceeded what their human staff could handle. High-intent callers — people who had just seen a TV spot or clicked a digital ad — were hitting voicemail or hold queues and dropping off. The CRM was full of dead leads that had never been properly worked.

The conventional AI product answer is a chatbot or an AI-assisted call routing system. Both require the caller to do something — select from a menu, type their question, interact with a system that announces itself as AI.

We built a full-duplex voice agent that answered like a real intake call. Callers described what they wanted. The agent extracted the relevant details — vehicle interest, time preference, trade-in situation — compared against live inventory and calendar, confirmed availability, and booked the appointment. Complex requests got routed to a human without the caller being told they were being transferred.

The agent never mentioned AI. It didn't need to.

Appointment conversion hit 90%. A single location reduced operational costs by over $100,000 annually. The dormant lead database, which had been sitting untouched for months, was activated through a parallel outbound campaign at a scale no human team could have matched.

"We didn't implement an AI system," the dealer principal told us later. "We fixed our intake process."

That's the right way to describe it.

The AI was the mechanism. The fixed intake process was the product.


The fertility network: where "no AI interface" was a deliberate design decision.

In a nine-location fertility coordination network, the clinical coordinator team was responsible for processing medical files on prospective candidates — detailed health backgrounds, lab reports, genetic screenings, often exceeding 100 pages per applicant, arriving in every format imaginable.

The previous workflow: a coordinator spent 2-3 hours per file, reading through documents, flagging anomalies, preparing a summary for the clinical review team. At volume, this became the primary bottleneck in the entire intake pipeline.

We deployed a system that processed these files automatically. Medical-grade OCR handled the scanning. A fine-tuned language model extracted the relevant indicators — endocrine markers, genetic flags, cross-referenced lab values — and generated a structured diagnostic summary with every flagged item linked directly to the source page in the original document.

The coordinator didn't select a model. They didn't write a prompt. They didn't have a chat interface with an AI.

They opened a case. The summary was there. Each flag had a citation. Their job was to review the summary and make clinical decisions — the part of the job that actually required their expertise.

Processing time: 3 hours per file down to 10 minutes.

"The system handles the reading," one coordinator explained to a new hire during onboarding. "You handle the judgment."

She didn't describe it as AI. She described it as how the job works now.

The experience wasn't AI-flavored. It was the job, restructured.


WHAT WE KEPT GETTING WRONG IN EARLIER DEPLOYMENTS

There's a version of these deployments we would have built two years ago that looked different.

We would have given the coordinators an AI assistant panel. They would have been able to ask the system questions, generate summaries on demand, highlight sections of documents and ask for analysis. The AI surface would have been visible, interactive, and impressive in a demo.

It also would have made the coordinators into AI operators. Part of their job would have been formulating queries, reviewing AI outputs, deciding which flags to trust, managing a new workflow on top of their existing one.

The system would have been capable of doing the same underlying analysis. But the capability would have been locked behind a layer of user effort.

The question isn't what the AI can do. The question is how much of the user's time and attention the AI requires in exchange for doing it.

We've seen this failure mode in enough enterprise AI deployments now that we've started treating it as a design principle: every interaction surface you expose to the user is a tax you're levying on their attention. Visible AI is an attention tax. The best products minimize the tax.

This is harder than it sounds. Visible AI is easy to demo. An impressive chat interface, a model selector, an "Ask AI" button with a dropdown menu — these features look good in procurement presentations. They make the AI feel powerful and flexible.

What they don't do is reduce the work the user has to perform.

If the user is still doing the hard part — formulating the question, interpreting the output, acting on the result — you've added a tool to their workflow, not removed work from it.


The medical device company: AI that the clinical team stopped thinking about.

A cardiopulmonary device manufacturer we worked with had a specific problem. Their different product lines each ran on their own local software, with no shared data layer. Patients moved between devices and facilities, but their health records didn't. The company wanted to expand into hospital systems and skilled nursing facilities, but the data fragmentation made enterprise procurement conversations impossible.

We rebuilt the underlying platform — multi-tenant, cloud-native, with a consistent data model across all device types. Deep inside that platform, we embedded an AI voice agent handling 24/7 patient inquiries, device usage guidance, and clinic appointment scheduling.

The clinical staff who used the platform didn't think about the AI. They thought about the patient record, the alert feed, the scheduling dashboard. The AI was answering calls in a different part of the system. The two surfaces didn't meet.

Six months into deployment, we were on a review call with the VP of Clinical Operations.

She had to be reminded, mid-conversation, that the voice agent was AI.

"I just thought that was the support line," she said.

That reaction — confusion about whether AI is involved at all — is the deployment going right.


THE THING THAT KEEPS GETTING BUILT INSTEAD

There is a persistent pressure in enterprise AI sales to make the AI legible to the buyer.

Buyers want to understand what they're purchasing. They want to see the model, interact with the interface, understand how the system works. This is a reasonable thing to want. These are sophisticated procurement decisions involving real budget and real organizational change.

The problem is that what makes AI easy to evaluate is often the opposite of what makes AI useful to operate.

A chatbot interface is easy to evaluate. You type questions. You see answers. The demo takes fifteen minutes and the capability is self-evident.

A voice agent that answers calls, processes requests, integrates with your CRM, and handles edge cases in real time is harder to evaluate. You need call recordings. You need conversion data. You need to understand the integration architecture. The demo takes an hour and requires context.

The pressure to build AI that's easy to demo creates AI that's designed to be visible. Which creates AI that stays in the user's workflow rather than replacing part of it.

We've made this mistake. We've built interfaces because the interface made the product legible. Some of those interfaces created more work than they removed.


WHAT THIS MEANS IF YOU'RE BUILDING AI PRODUCTS

The test we've landed on — after watching this pattern repeat across industries, client types, and use cases — is one question asked at the product design phase, before any interface is built:

What does the user have to do that they didn't have to do before?

If the answer is: "They need to formulate a prompt, review the AI output, correct errors, and then take the action they were going to take anyway" — that's a workflow with new steps added, not removed.

If the answer is: "The task is done. They review the output and make a judgment call if something is flagged" — that's a workflow with steps removed.

First, design for the outcome the user needs, not the capability the AI provides. The dealership didn't need a voice AI product. They needed a higher appointment conversion rate. Those are different starting points that can produce very different systems.

Second, minimize the surface area between the user and the AI. Every configuration option, every mode selector, every "Ask AI" button is a decision you're delegating to the user. Sometimes that delegation is correct — power users genuinely benefit from control. Usually, in operational B2B contexts, the user wants the work done, not the tools to do the work.

Third, measure what disappears, not what appears. The metric that matters isn't how many users engaged with the AI interface. It's how many hours of coordinator time were eliminated, how many inbound calls were handled without a human, how many decisions were made faster. The useful AI is usually the invisible AI.


ONE THING WE MIGHT BE WRONG ABOUT

This framework — less visible is better — has a real failure mode we've run into once, and it matters enough to name.

In the fertility network deployment, the first version of the system gave coordinators almost no visibility into how the AI was reaching its conclusions. The summaries were accurate. The flags were correct. But when a coordinator wanted to understand why a particular marker had been elevated to a primary flag, the system couldn't explain the reasoning path — only point to the source document.

The clinical team started to feel uncomfortable. Not because the outputs were wrong. Because they couldn't see the basis for the outputs. And in a medical context, "I'm not sure why the system thinks this is important" is an accountability gap that matters.

We rebuilt the diagnostic layer to include explicit reasoning chains alongside each flag — not as a UI element the coordinator had to interact with, but as a background layer they could pull up when they wanted it.

The goal isn't to make AI invisible. The goal is to make it appropriate to what the user needs to see. For routine outputs, invisibility is right. For high-stakes decisions in regulated environments, the reasoning needs to be accessible even if it doesn't need to be prominent.

The coordinator shouldn't have to think about the AI. But they should be able to, when it matters.


Working notes from B2B AI deployment in North America. Part of an ongoing series on what we keep noticing across wildly different industries — and what the industry isn't ready to say out loud.

Curious what this looks like in practice? We share more at [zenaicorp.com/en](https://zenaicorp.com/en).

posted toAvatar for product Carbuki
Carbuki
  1. 1
    Across these deployments, what evidence determines when removing AI visibility improves the workflow versus when limited transparency creates enough accountability risk to justify a more visible layer?