Healthcare AI vendor risk · A ReMyll product
Sample assessment Contact
AITPRM Health™A ReMyll product

Evaluate AI as One Team. Deploy Software with a Defensible Record.

AITPRM Health unites IT, clinical leadership, legal, and procurement in a single workspace to assess, monitor, and manage third-party AI risk across the entire care continuum.

< 14 days
Target to first assessment
256
Cited questions
12
Governance domains
Zero-PHI
Architecture
aitprm.com/dashboard
AITPRM Health governance dashboard
Governance dashboardIllustrative. Sample data shown.

Built to operationalize emerging federal and state AI governance guidelines.

Civil rightsHHS OCR Section 155745 CFR 92.210
TransparencyONC HTI-1 DSI
Coverage policyCMS-4201-F
State AI actsCalifornia SB 1120
State AI actsColorado SB 26-189
Across the healthcare continuum

AITPRM Health supports organizations across the healthcare continuum.

Nine segments, one method. Each card names the AI tools that segment is most likely to be evaluating this year.

01

Hospitals and Health Systems

Govern clinical decision support, ambient EHR scribes, and predictive risk tools across complex multi-facility networks.

How it applies →
02

Physician Groups and Clinics

Fast-track safe adoption of clinical documentation and patient messaging AI without requiring a dedicated IT risk team.

How it applies →
03

Behavioral Health Providers

Protect sensitive mental health records and ensure AI tools maintain proper clinical boundaries and human oversight.

How it applies →
04

Post-Acute and Senior Living

Safely evaluate remote monitoring systems, fall-prediction algorithms, and automated care-plan recommendations.

How it applies →
05

Home Health and Hospice

Secure mobile AI workflows, field documentation tools, and predictive care-escalation engines.

How it applies →
06

Payers and ACOs

Audit prior-authorization algorithms, population health models, and claims automation for fairness and clinical necessity.

How it applies →
07

Dental Groups and DSOs

Assess AI-driven radiologic imaging, treatment planning software, and automated patient scheduling tools.

How it applies →
08

Health Technology Vendors

Map third-party AI supply chains (AI-SBOM), secure PHI pathways, and generate verifiable readiness scorecards for enterprise procurement review.

How it applies →
09

First-Time Governance Builders

Establish a structured, repeatable AI vendor review workflow from scratch without starting from a blank spreadsheet.

How it applies →

Built for shared organizational responsibility: Procurement · IT and Security · Clinical Leadership · Legal and Risk

See how each role reads the record →
Why evaluation matters

The vendor runs the model. Your organization carries the obligation.

Three shifts a security questionnaire and a BAA review were never designed to catch. Each reduces to a question you can put to any AI vendor in writing, before signature.

01

Non-delegable liability

A vendor may run the model, hold the data and manage the infrastructure. Under HIPAA and state law, your organization still answers for how the tool is used.

Ask the vendor

Which of these obligations have you assumed in writing, and what happens if you cannot meet them?

HIPAA 45 CFR 164.308(b), 164.504(e)
02

Aggregate accuracy vs local performance

A model validated on national data may perform differently for your population, your documentation patterns and your care setting. Vendors report the average.

Ask the vendor

What performance do you report by subgroup and by site, and for which populations was the model validated?

ONC HTI-1 source attributes · D4
03

The hidden AI supply chain

Behind the vendor sits a foundation model provider, a hosting environment and a chain of subprocessors. Standard BAAs rarely name them.

Ask the vendor

Name every model provider and subprocessor in the chain, with the agreement that binds each one.

45 CFR 164.504(e) · D2
How it works

Three steps. One record.

Each step has a defined input, a defined output and a named owner, so a review can be handed to a colleague without losing the thread.

aitprm.com/vendors
Vendor register with archetype, score, domain rail and lifecycle state

Illustrative. Sample data shown.

Step 01 · Scoping and outreach

Six deployment facts scope the review. The vendor answers only its set.

The scoped question set and state overlays go to the vendor through the portal; response time depends on the vendor and the documentation it has on hand.

See the full walkthrough →
Clinical safety and drift

Continuous Drift & Workflow Governance

A model approved at contract signing decays as patient populations shift and unannounced vendor updates land. AITPRM Health manages ongoing algorithmic performance across three core controls:

01
Defined Model Incidents
Explicit vendor notification timelines and liability triggers for drift, managed separately from data security breaches.
02
Automation Bias Protection
Mandatory tracking of clinician override rates, hallucination controls, and human in the loop verification steps.
03
Recurring Re-Certification
Scheduled re-evaluation of safety telemetry and contractual suspension rights across the software lifecycle.
Explore Clinical Safety Framework Domain →
Safety telemetry · Ambient scribe v4.2Reviewed 14 Sep
Calibration
Expected calibration error
0.031
threshold ≤ 0.05
✓ Within
Drift
Population stability index, 30 d
0.18
threshold ≤ 0.10
! Breach
Accuracy
Note completeness vs. clinician edit
91.4%
threshold ≥ 90%
✓ Within
Hallucination
Unsupported clinical statements / 1k notes
2.7
threshold ≤ 2.0
! Breach
Manual failover
Revert to dictation workflow
Armed · Privacy Officer, CMIO
Vendor suspension right
Contract §7.3, unilateral
In force
Finding opened · Tier 2. Two thresholds breached. Reassessment triggered; vendor notice under model incident clause due in 5 business days.

Illustrative. Sample data shown.

Regulatory overlays and the procurement matrix

Five evaluation domains. Overlays applied by where you operate.

Every vendor is assessed across the same five areas. Statutory overlays for HIPAA, HTI-1, CMS coverage policy and state AI acts are selected during scoping, based on your organization’s location, care setting and the tool’s intended use, so the question set reflects the deployment under review.

01

Model Provenance

Training data origin, output generation, and whether updates alter core functions.

02

Drift and Safety

Operational thresholds for accuracy, monitoring, and manual fallback when tools need human review.

03

Data Privacy and Security

Zero data retention, isolated environments, and exclusion from secondary model training.

04

Bias and Equity

Subgroup performance and local validation across populations and care settings.

05

Audit Rights and Indemnity

Balanced liability boundaries, inspection rights, and access to performance logs.

Federal
HIPAA · HITECH · 42 CFR Part 2
HHS ASTP/ONC
HTI-1 DSI source attributes
CMS
CMS-4201-F coverage determinations
State AI acts
TX · CA · CO statutes

AITPRM Health sits alongside your existing security and legal review and covers the AI-specific questions neither asks.

Governance Lab · The Record

Operational guidance for healthcare AI decisions.

Briefs from the AITPRM Health Governance Lab for the leaders accountable for third-party AI risk. Open access. No gates.

All briefs in The Record →
Request a demo

See a Scoped Review in 30 Minutes

Explore a complete evaluation in a guided 30 minute walkthrough using standard clinical and administrative AI reference models.

256 Cited Questions · Automatically scoped to specific clinical and operational workflows.
12 Weighted Risk Domains · Independent scoring of vendor claims against submitted evidence.
Designed without PHI · The evaluation is built to run without patient health data.
Configuration, not a project · Workspace setup through organizational configuration rather than a multi month IT project.

Prefer to read first? Explore the 2026 AI Renewal Guide or download the sample scorecard.

AITPRM walkthrough · 30 minutes · Eastern timeOctober 2026
October 2026
SMTWTFS
AvailableSelected
Select a date

Loading available times…

Times shown in Eastern. Your request is confirmed by email; nothing is charged and nothing is shared.