Essay 81
AI in your business: start small, define success, then measure
2026-10-01
Expand from evidence, not enthusiasm: a trial you can measure in one narrow flow is worth more than a rollout nobody can grade.
The pattern repeats across the market: a company hears what AI did for someone else, buys the broadest version of it, and points the system at every customer conversation on day one. A month later there is activity everywhere and knowledge nowhere. Nobody can say which questions the system resolved, which ones it mangled, or whether anything improved at all, because no baseline was written down before the tool arrived.
We deploy AI in our own funnel before we recommend it to anyone, and the case we keep arriving at is smallness. Start with one narrow flow: the place where volume is real, the answers are knowable, and failure is visible. Real volume means the trial teaches you something worth learning. Knowable answers mean right and wrong can be judged, not merely felt. Visible failure means a mistake surfaces quickly, in front of someone able to catch it, instead of spreading silently for months.
Before the tool arrives, write down what success means. Define what counts as a resolved conversation, and what counts as a handover to a human, including the point at which handing over is the correct answer rather than a defeat. Pick the number that, watched over the trial window, would let you say this worked. If those definitions do not exist before deployment, you will grade the homework after seeing the student, and almost every system passes a test written that way.
Then run a bounded trial on real traffic: real conversations, a defined window, and honest counting at the end of it. A demonstration on curated questions proves nothing, because curated questions are exactly what the tool was built to answer. The trial exists to meet the awkward cases: the vague question, the angry customer, the request that needs judgment. How the system behaves there is the actual finding.
Expansion earns its way from evidence. The second flow is justified by what the first one showed, the way the first was justified by the baseline before it. This is slow next to the big-bang rollout, and the slowness is the point: the big-bang rollout meets every customer on day one, spends its credibility inside a week, and leaves the team defending a system nobody can evaluate. Evidence scales: enthusiasm merely spreads.
This is how we run AI for ourselves: transparent systems that say they are AI, narrow scopes, defined handovers, and numbers we can show a client without flinching. It is how we deploy for clients, and we hold both to the same bar. We offer method, not guarantees: the method exists so that when the results arrive, good or bad, you know what they mean.
FAQ
Direct, unambiguous answers
How should a small business start using AI?
Start with one narrow flow: the place where volume is real, the answers are knowable, and failure is visible. Real volume means the trial teaches you something worth learning, knowable answers mean right and wrong can be judged, and visible failure means a mistake surfaces quickly in front of someone able to catch it.
How do I measure whether an AI assistant is actually working?
Define success before the tool arrives. Write down what counts as a resolved conversation, what counts as a handover to a human, and the number that, watched over the trial window, would let you say this worked. Without those definitions you grade the homework after seeing the student, and almost every system passes a test written that way.
Can we judge an AI tool from a demo on curated questions?
No, because curated questions are exactly what the tool was built to answer. A demonstration proves nothing about your reality. Run a bounded trial on real traffic instead: real conversations, a defined window, and honest counting at the end. The trial exists to meet the awkward cases, and how the system behaves there is the actual finding.
When should a company expand AI to more of its work?
When the first flow has earned it with evidence. The second flow is justified by what the first one showed, the way the first was justified by the baseline before it. This is slower than a big-bang rollout, and the slowness is the point: evidence scales, while enthusiasm merely spreads and leaves a team defending a system nobody can evaluate.
Should an AI assistant admit it is not human?
Yes, and we hold that line in our own funnel: transparent systems that say they are AI, narrow scopes, defined handovers, and numbers we can show a client without flinching. Honesty is not a weakness here; it is what makes the measured trial meaningful, because a system that misrepresents itself poisons every result it reports.
Next step
AI Systems
AI that holds a conversation and closes work (WhatsApp consultants, extraction pipelines, grounded answers): Maryam's architecture tuned to your business.
Start an order, request a private consultation, or simply ask a question: one WhatsApp message in Arabic or English opens the conversation.
Talk on WhatsApp