Evidence-led review
Separate documented evidence from vendor assertions and unresolved gaps.
DataConsultant helps procurement, AI, technology, security, privacy, risk and business teams assess third-party AI vendors before contract, deployment, renewal or material change. We review the intended use, data handling, model and component supply chain, evaluation evidence, responsible-AI controls, security, operational dependencies and monitoring obligations, then translate the evidence into prioritised findings and decision-ready actions.
This is an advisory assessment, not a statutory audit, legal opinion, certification or guarantee of vendor safety, compliance, model performance or future behaviour. Scope, evidence access, timeline and commercial terms are confirmed during discovery.
Separate documented evidence from vendor assertions and unresolved gaps.
Map model providers, subprocessors, data flows and critical dependencies.
Focus assessment effort on use, impact, autonomy, data and failure consequences.
Convert findings into practical conditions, remediation and monitoring actions.
AI vendors can introduce risks that are not visible in a conventional software questionnaire: model-provider dependencies, training-data uncertainty, output limitations, agent permissions, changing subprocessors, opaque evaluation evidence and unclear responsibility boundaries. The assessment is designed to make those dependencies explicit before the organisation accepts them.
Foundation models, hosted APIs, external tools, retrieval services or subprocessors can create concentration, continuity and change risks beyond the primary vendor relationship.
Procurement teams may need clarity on collection, retention, model training, logging, human review, location, deletion and downstream processing of client or user data.
Performance claims can be hard to interpret without intended-use criteria, representative scenarios, failure analysis, test conditions and documented limitations.
Prompt injection, tool misuse, retrieval exposure, model or data supply-chain risks and unsafe automation can require additional review beyond standard application controls.
Without explicit decision rights, material findings can sit between teams while the vendor progresses toward contract or production.
Model upgrades, new agent capabilities, new data uses or subprocessor changes can alter risk after the original vendor onboarding decision.
Share the vendor, intended use, decision deadline, data involved and the evidence already available. We can help define a proportionate assessment scope and identify the highest-value due-diligence questions first.
An AI vendor risk assessment evaluates whether the risks, controls and evidence associated with a third-party AI product are understood well enough for an accountable procurement, deployment, renewal or change decision. The review connects the vendor’s claims with the client’s intended use, data, architecture, operating model and risk tolerance.
The engagement does not assume every vendor requires the same questionnaire or depth. A low-impact AI feature used on public data should not automatically receive the same level of review as an AI agent with sensitive-data access, external tools and operational decision authority.
Final criteria are tailored to the intended use and evidence available. The domains below cover the issues most likely to distinguish AI vendor due diligence from a conventional software supplier review.
Define intended purpose, users, decisions supported, automation level, failure consequences and prohibited or out-of-scope uses.
Review data categories, collection, transfer, retention, deletion, model-training use, logging, human access and processor boundaries.
Map foundation models, subprocessors, external datasets, libraries, plugins, retrieval services, tools and concentration dependencies.
Assess identity, access, secrets, APIs, logging, tenant isolation, permissions, incident response and AI-specific security considerations.
Examine evaluation objectives, test conditions, metrics, datasets, human review, failure analysis, robustness evidence and documented limits.
Review accountability, human review, escalation, transparency, harmful-impact considerations and controls around autonomous action.
Identify material responsibility, audit-evidence, data-processing, notification and change-control questions for review by accountable legal and compliance teams.
Review service continuity, model updates, change notification, monitoring, incident escalation, vendor exit and reassessment triggers.
Evidence availability varies by vendor. The assessment records what was reviewed, what could not be verified, and how evidence limitations affect confidence in the findings.
Product architecture, deployment model, integrations, data flows, storage, logging, retrieval, tool use, human review and hosting boundaries.
Model or system cards, provider information, external model dependencies, subprocessors, libraries, datasets, plugins and component-change processes.
Data-processing agreements, privacy terms, retention and deletion commitments, training-use terms, residency, user data controls and subprocessor notices.
Security policies, independent assurance reports where available, identity and access design, encryption, incident processes, vulnerability management and continuity evidence.
Evaluation plans, benchmark results, representative test sets, red-team findings, human-review methods, known limitations, safety tests and remediation history.
AI governance policies, accountable roles, monitoring processes, model-change notifications, incident escalation, support arrangements, exit planning and reassessment mechanisms.
We can turn the current document set into an evidence register, identify unanswered decision-critical questions and separate material gaps from lower-priority requests before the next vendor review round.
Outputs are tailored to the decision and scope. They document assumptions and evidence limitations so reviewers can distinguish verified findings from unresolved questions.
Purpose, scope, vendor/product boundary, evidence requirements, stakeholders, evaluation lenses and exclusions.
Evidence received, source, date, relevance, verification status, missing items and material limitations.
Third-party models, subprocessors, data paths, tools, integrations and critical operating dependencies.
Evidence-backed observations, affected use, rationale, potential impact, ownership and unresolved questions.
Missing evaluation evidence, control weaknesses, model limitations and areas requiring deeper technical validation.
Human oversight, transparency, data, safety, accountability and higher-impact concerns relevant to the intended use.
Prioritised actions, responsibility boundaries, evidence requests, operational controls and decision dependencies.
Material-change triggers, evidence refresh needs, review cadence considerations, escalation and vendor exit dependencies.
Material findings, trade-offs, limitations, proposed conditions, residual-risk questions and agreed next steps.
Risk prioritisation should be transparent and relevant to the client context. DataConsultant can use an agreed qualitative or quantitative method where supportable, but does not apply an undocumented proprietary pass/fail threshold.
Criticality of the process, decisions, users, data and operational dependency on the vendor.
Magnitude and type of plausible harm across business, customers, security, privacy, operations or governance.
Quality, recency, provenance, completeness and independence of the evidence supporting a conclusion.
Existing safeguards, detectability, compensating controls, vendor commitments, dependencies and feasibility of treatment.
The sequence is adapted to procurement deadlines, vendor responsiveness and the depth of technical review. Timeline is confirmed after scoping rather than fixed in advance.
Define vendor, product, intended use, data, stakeholders, jurisdictions, decision and exclusions.
Create the evidence register and target the documents needed for the material risk questions.
Review AI components, data flows, evaluations, controls, contracts, operations and dependencies.
Resolve priority questions through client and vendor interviews, workshops or evidence follow-up.
Rate material findings using agreed impact, exposure, evidence and control considerations.
Define remediation, conditions, additional testing, ownership, monitoring and reassessment needs.
Present findings, limitations, unresolved risks and decision considerations to accountable stakeholders.
We can structure the assessment around a shared evidence set, explicit responsibility boundaries and a decision readout that shows where specialist follow-up is needed rather than duplicating disconnected reviews.
The best assessment starts with the business context, not only the vendor questionnaire. Inputs do not need to be complete on day one; evidence gaps are captured as limitations and follow-up actions.
Framework mapping is selected for the use case and jurisdiction rather than applied mechanically. The references below can help structure AI-specific third-party, supply-chain, governance and risk questions; applicability must be confirmed for the organisation and intended use.
The NIST AI RMF is a voluntary framework organised around Govern, Map, Measure and Manage. Its Core explicitly addresses risks from third-party software, data and AI technologies, making it useful for structuring vendor and supply-chain review.
Review NIST AI RMF ↗For generative-AI vendors, NIST AI 600-1 extends AI RMF guidance to generative-AI risks and lifecycle considerations, including acquisition and value-chain dependencies.
Review NIST GenAI Profile ↗ISO/IEC 42001 specifies requirements for an AI management system for organisations providing or using AI products and services. It can inform governance, accountability, risk treatment and operating-model questions.
Review ISO/IEC 42001 ↗ISO/IEC 23894 provides guidance for organisations that develop, produce, deploy or use AI products, systems and services to integrate AI risk management into organisational activities.
Review ISO/IEC 23894 ↗OWASP’s 2025 LLM supply-chain guidance highlights risks involving third-party pretrained models, data and deployment dependencies. It can inform security-focused evidence requests for generative-AI vendors.
Review OWASP guidance ↗Where relevant, the assessment can identify questions for accountable legal and compliance teams under instruments such as the EU AI Act or India’s Digital Personal Data Protection framework. Applicability and commencement must be verified for the specific context.
EU AI Act ↗India DPDP Act ↗Clear boundaries help the assessment stay decision-focused and prevent a procurement review from becoming an undefined security, legal, privacy or model-testing programme.
DataConsultant does not publish a fixed fee for this service. AI vendor reviews can vary materially by product, intended use, evidence depth, risk profile and technical scope, so commercial terms are confirmed through a scoped proposal rather than an unsupported generic price.
Commercial scope is shaped by the vendor, intended use, evidence depth and the number of specialist lenses required. A document-led review of one AI SaaS supplier is materially different from a multi-vendor assessment involving sensitive data, foundation-model dependencies, agent capabilities, technical evaluation and multiple jurisdictions.
Send the vendor name, intended use, evidence already collected, number of stakeholders and the decision date. We can use those inputs to define the assessment boundary and commercial proposal.
The value of vendor assessment comes from connecting business use, AI behaviour, data, architecture, controls and decision ownership instead of treating supplier due diligence as a standalone compliance form.
Make evidence provenance, missing documents, vendor claims and confidence limits visible in the final findings.
Review model providers, datasets, subprocessors, tools and external dependencies that a generic SaaS assessment may miss.
Adjust depth to intended use, business criticality, data, autonomy, users and potential failure impact.
Connect AI evaluation, data, architecture, security, privacy, governance and operational risk without pretending one discipline replaces another.
Document who advises, who provides evidence, who remediates, who approves and who accepts remaining risk.
Translate one-time findings into monitoring criteria, material-change triggers, reassessment and optional deeper assurance.
Answers to common questions about vendor evidence, AI-specific scope, technical testing, recognised frameworks, regulatory considerations, deliverables, timeline, pricing and reassessment.
Share your contact details and requirement. DataConsultant can review the likely assessment boundary, evidence needs, stakeholder involvement and appropriate next step.