Scope
Allowed data and actions
Production agent field guide
A practical operating checklist for moving an agent from a convincing demo to a system people can supervise and correct.
The route
A production agent is a supervised workflow with clear permissions, test cases, human recovery, and observable outcomes.
Allowed data and actions
Known cases and failure cases
Human review and escalation
Quality, cost, and drift
Workflow context: Model / Tools / CRM / Knowledge base / Audit log
Define the records the agent may read, the tools it may call, the actions it may take, and the actions that always require approval. Keep those boundaries outside the model’s natural-language instructions wherever the platform allows it.
Use separate credentials or service accounts for the first version. The system should be able to say which request, record, and tool call produced an action later.
A test set should include normal examples, missing fields, contradictory records, duplicate requests, prompt injection attempts, unavailable tools, and a request outside the agent’s remit. The point is not to prove perfection; it is to make unsafe behavior visible before customers do.
Keep expected outcomes and escalation rules with the tests. If a model or tool changes, rerun the same cases before treating the result as equivalent.
A handoff should include the original request, relevant context, attempted actions, uncertainty, and the decision the person needs to make. “Please review†is not a recovery path if the reviewer has to reconstruct the entire route.
Assign the owner and the response window. If the person does not respond, the workflow needs an escalation or a safe stop rather than another invisible retry.
Track successful completions, escalations, tool failures, unsafe attempts, time to human recovery, and cost per completed case. A route that saves model time but creates more manual rework is not improving the operation.
Review the log with the people who own the underlying business process. They can spot a misleading success faster than a dashboard that only counts completed calls.
Check your business readiness
Check whether your website, systems, transaction path, fulfillment, and verification can support reliable AI agent access.
Reference material
This field note is an educational guide. Platform behavior, availability, permissions, and plan limits should always be checked against the current vendor documentation.