Assessment scopeAI agent readiness dimensions we can evaluate
The final scope is tailored to the proposed use cases, autonomy level, systems involved, jurisdictions and the organisation’s existing AI governance maturity.
1. Business value and process suitability
Clarify the outcome, user, workflow, decision points, exception volume, reversibility, service impact and economic case. Distinguish work that benefits from an agent from work better served by deterministic automation, analytics, search or human expertise.
- Use-case qualification
- Process decomposition
- Value hypothesis
- Autonomy boundaries
- Human-in-the-loop design
2. Data, knowledge and grounding readiness
Review the availability, quality, provenance, sensitivity, permissions and update frequency of information the agent will use. Assess retrieval design, context management, reference sources and treatment of conflicting or missing evidence.
- Data quality
- Knowledge sources
- Metadata and lineage
- Access controls
- Retrieval grounding
- Retention
3. Architecture, integrations and tool use
Assess agent orchestration, model and platform choices, API availability, tool interfaces, event flows, sandboxing, state and memory, observability, failure handling, vendor dependencies and environment separation.
- Agent orchestration
- API readiness
- Tool permissions
- Identity delegation
- Logging
- Fallback paths
4. Governance, security, privacy and assurance
Identify applicable policies, risk classifications, approval gates, accountability, data protection obligations, security threats, third-party risks, evaluation requirements, incident response and evidence needed for internal assurance.
- AI inventory
- Risk classification
- Threat modelling
- Privacy review
- Audit evidence
- Change control
5. Operating model, skills and production support
Define who owns the agent, who approves changes, who monitors quality and cost, who handles incidents, and how business, data, engineering, security, legal, risk and operations teams work together.
- RACI
- Service ownership
- Model operations
- Agent operations
- Training
- Support model