Why pilots stall
A pilot usually succeeds on its own terms. Someone demonstrates that a model can draft the email, summarise the document or answer the question, and everyone agrees it is impressive. Then it stops, because the pilot was never connected to the system where the work is recorded, and nobody's job changed as a result.
The second common failure is subtler. The pilot solves a problem that was real but rare. Automating something that happens twice a month produces a good demonstration and almost no operational change. The work that is worth automating is usually the work people find too boring to describe.
- The pilot produced output but had nowhere to write it
- The chosen task was infrequent, so time saved was negligible
- Nobody owned the change once the pilot team moved on
- Success was never defined against a measured baseline
Choose problems by shape, not by excitement
The tasks that repay automation share a recognisable shape: they happen many times a day, they follow rules a competent new hire could learn in a week, the information needed is already recorded somewhere, and getting one wrong is inconvenient rather than dangerous.
That description covers a great deal of ordinary commercial work — responding to enquiries, gathering qualifying information, booking and confirming appointments, chasing missing documents, routing questions to the right person. It rarely covers the judgement-heavy work that leadership finds most interesting.
Value comes from the integration, not the model
The model is the commodity part. What determines whether anything changes is whether the output lands in the system your team already uses, whether it arrives in a structured form, and whether the exceptions reach a human quickly and with context.
This is ordinary software engineering: authentication, data mapping, error handling, retries, audit trails, permissions. It is also where most of the effort goes, and where an engagement succeeds or fails.
Measure against what you do today
Before building anything, record how the process currently performs: how long a response takes, how many enquiries are handled, how often a step is missed. Without that baseline, any improvement is a matter of opinion.
Then deploy narrowly — one team, one location, one category of enquiry — and compare. A narrow deployment that demonstrably works is far more persuasive internally than a broad one whose effects nobody can isolate.
Key takeaways
- Pick high-frequency, rule-shaped work, not rare and interesting work
- Budget most of the effort for integration, not for the model
- Record a baseline before you build, or you cannot prove anything
- Deploy narrowly first; a measured small win beats an unmeasured large one