AI AGENCY SELECTION
FIELD NOTE 10 / 13An AI agency should not sell you AI. It should own the system around it.
An AI agency should turn a business problem into a working system and remain accountable when that system meets real data, real customers and real consequences.
Access to AI is abundant. Accountability for making it work inside a business is not.
SHARE THIS FIELD NOTE
Pass the useful signal on.
The AI agency category grew faster than its meaning.
Search for an AI agency and you can find a strategy consultancy, a software studio, a chatbot builder, an automation freelancer and a company reselling somebody else's platform under the same label. All may be competent. They are not offering the same kind of responsibility.
At its most useful, an AI agency is an implementation and operating partner. It identifies where AI can improve a piece of work, designs the system around that outcome, connects the required context and tools, tests the behaviour, introduces it into the team and keeps improving it after launch.
That definition matters because the technology is only one ingredient. A model can generate, classify, retrieve and reason. It cannot decide which customer promise your company should make, which source your sales team trusts, who may approve a discount or what a failed action should cost the business. Those decisions belong to the system around the model—and to the people accountable for it.
An AI agency is not a source of artificial intelligence. It is a source of accountable implementation.
A prototype proves that something can happen once.
AI makes demonstrations unusually persuasive. Give a model a clean brief, a complete customer record and a cooperative example, and it can produce an account summary, campaign or service reply that feels like the future arrived early.
Production supplies the examples the demonstration avoided. A company name matches three businesses. The CRM field is empty. Two documents disagree. An integration loses permission. A customer asks for something outside policy. The model returns a polished inference with no evidence behind it.
The agency's real work begins here. It must decide how the system handles missing context, uncertain conclusions, changing tools, costly actions and cases that require human judgment. If the engagement ends when the happy path works, the buyer has purchased a prototype and inherited an operating problem.
Not every problem needs an AI agency.
If a standard product already performs the task, fits the existing process and carries acceptable controls, buy the product. If the need is occasional and personal, use a general assistant. If the organisation has the engineering, operational ownership and domain expertise to build and run the system internally, an outside agency may add delay rather than value.
An agency becomes useful when the work crosses boundaries: several tools must cooperate, company context changes the answer, decisions require explicit permissions, failures have commercial consequences, or nobody internally can own both the build and its continued operation.
This is not a question of company size. A small recurring task can justify a managed system when it touches every lead. A large, exciting idea may not justify one when the outcome is vague. The correct starting point is the value and shape of the work, not the desire to announce an AI initiative.
- Use a product when the process can adapt to the product without losing what matters.
- Build internally when the capability is strategic and the organisation can operate it after launch.
- Use an AI agency when valuable work needs external system design, integration and accountable operation.
- Do nothing yet when the outcome, owner or evidence of value is still unclear.
Buy a changed piece of work, not a collection of AI artefacts.
A discovery deck, prompt library, agent, workflow and dashboard can all be legitimate deliverables. None is the outcome. The buyer should be able to point to a recurring activity and explain what now happens faster, better or more reliably because the system exists.
For revenue teams, that may mean qualified buying signals reach the right seller sooner, campaign decisions use current customer evidence, service requests arrive with the correct context or account plans improve as won and lost deals teach the system. The technology should disappear into a clearer way of working.
A credible agency therefore defines more than scope. It names the commercial intent, authoritative inputs, decisions the system may make, actions it may take, quality standard, approval points, failure routes and evidence used to judge the result. The prompt is an implementation detail. The operating agreement is the valuable artefact.
RELATED FIELD NOTEOnce the agency's responsibility is clear, the next question is which parts of the system genuinely need to be custom.
Custom AI agents should fit the work, not merely wear your brand.The most revealing line in the proposal comes after ‘go live’.
Models change. APIs change. Customer behaviour changes. The system encounters edge cases that nobody included in the workshop. A launch date cannot make those conditions stop moving.
Ongoing support should mean more than hosting and a helpdesk. Someone should watch whether runs complete, sample whether the work remains useful, investigate failures, maintain business context, update evaluations and decide when a repeated exception requires a change to the system.
This does not require endless agency dependence. Ownership can sit with the agency, transfer to the client or be shared. What matters is that it is explicit. A system with no named operator is not autonomous. It is unattended.
Deployed is a technical state. Dependable is an operating achievement.
Ask who owns the difficult Tuesday, not who can win the polished pitch.
Before comparing agencies, choose one real use case and bring an awkward example. Ask the prospective partner to explain how they would establish a baseline, separate observation from inference, constrain permissions, test variable behaviour and respond when the system fails halfway through an action.
The strongest answer may include software you have never heard of. It may also recommend a standard tool, a smaller scope or no agent at all. That is a better signal than a long catalogue of models and integrations. You are testing whether the agency can make a sound operating decision when selling more technology is not automatically the right answer.
- Which business outcome and user decision will this system improve?
- What context is authoritative, and who keeps it current?
- What may the system read, recommend, change or send?
- How will you test common cases, difficult cases and costly exceptions?
- How will failures become visible, and who responds to them?
- What will you measure after launch besides usage and time saved?
- What can we operate ourselves if the relationship ends?
Do not hire an AI agency because it knows the tools. Hire one when it can remain accountable for the work the tools are meant to change.
Evidence and further reading.
Practical guidance on choosing the simplest suitable architecture and distinguishing controlled workflows from autonomous agents.
02OpenAI: A practical guide to building agentsA production-oriented guide to use-case selection, tools, instructions, orchestration and layered guardrails.
03McKinsey: Agents for growthEvidence that meaningful value comes from redesigning end-to-end work, supported by shared data, governance and a new operating model.
