Inventory measurements
INV-001
AI application inventory coverage
Security question. Which LLM and generative AI applications are known and attributed to an owner.
Evidence. AI application inventory reconciled against source dependencies, gateway configuration, and outbound provider destinations.
Method. Reconcile discovery sources and compare against the approved inventory.
Result type. Count
Interpretation. A gap between discovered and inventoried applications identifies systems that are running without a security record. It does not by itself indicate a vulnerability.
Limitations. Discovery based on documented architecture alone misses integrations added during development.
AI RMF outcomes
Map 1.1Map 2.1
INV-002
Model endpoint inventory coverage
Security question. Which model endpoints are reachable from applications, agents, and internal networks.
Evidence. Model endpoint inventory, gateway routing configuration, and observed network flows.
Method. Enumerate endpoints and associate each with an application, environment, and access boundary.
Result type. Count
Interpretation. Endpoints present in traffic but absent from the inventory are unmanaged interfaces to review. The count sizes the gap, not its severity.
Limitations. Endpoints introduced during development are missed by configuration review alone; observed flows are needed to close the gap.
AI RMF outcomes
Map 1.1Map 2.1
INV-003
External model provider inventory
Security question. Which external model providers process organizational prompts and data.
Evidence. Application-to-provider mapping and outbound network destinations.
Method. List providers, the applications that use them, and the data classification reaching each.
Result type. Count
Interpretation. Each provider is a supplier that processes organizational data. A provider absent from supplier management is a gap in third-party oversight.
Limitations. A provider relationship can arrive through a dependency or SDK rather than a direct integration.
AI RMF outcomes
Map 1.1Govern 6.1
INV-004
Self-hosted model inventory
Security question. Which models the organization runs on its own infrastructure and where.
Evidence. Deployment records, model gateway configuration, and container image contents.
Method. Record each self-hosted model, its host, and the endpoints that serve it.
Result type. Count
Interpretation. Self-hosted models keep prompts within the organizational boundary but still expose endpoints and artifacts that require the same inventory discipline.
Limitations. A model artifact present on disk is not necessarily in active serving use.
AI RMF outcomes
Map 1.1Map 2.1
INV-005
RAG system and source inventory
Security question. Which retrieval pipelines exist and which sources feed their indexes.
Evidence. RAG data source inventory, indexing pipeline configuration, and source ownership records.
Method. List retrieval systems and reconcile indexed sources against the indexing configuration.
Result type. Count
Interpretation. Indexes accumulate sources across teams over time. Sources present in the pipeline but absent from the inventory define the content a model can retrieve without a record.
Limitations. Reconciliation against documentation alone misses sources added directly to the pipeline.
AI RMF outcomes
Map 1.1Map 2.1
INV-006
MCP server inventory
Security question. Which MCP servers are connected to applications and agents, and where they originate.
Evidence. MCP client configuration and MCP server records.
Method. Reconcile connected servers against client configuration and record each server's origin.
Result type. Count
Interpretation. Connected servers extend application capability to whatever they expose and reach downstream. A connected server without a record is unassessed capability.
Limitations. MCP servers can be added by developers during integration and can proxy to further servers.
AI RMF outcomes
Map 1.1Govern 6.1
INV-007
MCP tool inventory
Security question. Which tools connected MCP servers expose and what operations they perform.
Evidence. Tool definitions from connected MCP servers.
Method. Enumerate tools and record the operation each performs and the server that exposes it.
Result type. Count
Interpretation. The tool set is the operation surface an application or agent can reach through MCP. An unlisted tool is an operation nobody reviewed.
Limitations. A server can register tools dynamically, so the inventory reflects the tools present at collection time.
INV-008
Agent capability inventory
Security question. Which tools each agent can invoke and which operations those tools expose.
Evidence. Agent configuration and tool definitions for each deployed agent.
Method. Record the tools available to each agent and the operations reachable through them.
Result type. Count
Interpretation. An agent's operation surface is the union of its tools, not its described role. The inventory establishes what the agent can do.
Limitations. Tool sets change as agents are extended; the inventory must track the deployed configuration, not the intended design.
INV-009
Effective execution identity inventory
Security question. Which identities components, tools, and agents authenticate as.
Evidence. Service principals, cloud roles, API identities, and agent execution identities.
Method. Record the identity each component operation runs as and link it to its downstream authorizations.
Result type. Count
Interpretation. The identity is where impact concentrates. An operation's reach is set by the identity it runs as, so the identity inventory is prerequisite to permission review.
Limitations. An identity record establishes which identity is used, not what it can do; downstream scope is a separate review.
INV-010
Unowned AI asset count
Security question. How many AI assets in the inventory have no accountable owner.
Evidence. AI system inventory and ownership records.
Method. Count inventory entries without a recorded owner.
Result type. Count
Interpretation. A non-zero value identifies systems requiring ownership resolution. It does not establish technical vulnerability; it establishes that the system cannot yet be assessed or remediated by an accountable party.
Limitations. Ownership recorded in the inventory may be stale; a named owner is not the same as an owner who accepts the responsibility.
AI RMF outcomes
Govern 2.1Map 1.1
Exposure measurements
EXP-001
Publicly reachable model endpoints
Security question. Which model endpoints are reachable from outside the intended network boundary.
Evidence. Endpoint reachability records and network configuration.
Method. Test reachability of each endpoint from its intended and adjacent network positions.
Result type. Count
Interpretation. A publicly reachable endpoint is an interface to review for access control. Reachability is a condition to assess, not a finding on its own.
Limitations. Reachability observed from one position does not describe reachability from every network position.
AI RMF outcomes
Measure 2.7
EXP-002
Model endpoints without expected authentication
Security question. Which reachable endpoints lack the authentication their boundary requires.
Evidence. Endpoint authentication configuration and reachability records.
Method. For each reachable endpoint, verify the presence and type of the required access control.
Result type. Count
Interpretation. An endpoint reachable without an adequate access boundary is a direct exposure. Rate limiting is not an access boundary and does not close this measurement.
Limitations. Configuration review establishes declared authentication; a live check confirms it is enforced.
AI RMF outcomes
Measure 2.7
EXP-003
Non-production endpoints reachable outside intent
Security question. Which development or test endpoints are reachable beyond their intended boundary.
Evidence. Endpoint inventory tagged by environment and reachability records.
Method. Identify non-production endpoints and test their reachability outside the intended scope.
Result type. Count
Interpretation. Non-production endpoints are a recurring exposure because they are often created without production controls and not removed when their use ends.
Limitations. Environment tagging must be accurate for this measurement to be meaningful.
AI RMF outcomes
Measure 2.7
EXP-004
External model provider data egress
Security question. Which data classifications leave the organization to external providers.
Evidence. Outbound data flow records and provider processing terms.
Method. Map the classification of data sent to each external provider and compare against approvals.
Result type. Contextual Finding
Interpretation. Data crossing the organizational boundary to a provider is governed by that provider's processing and retention terms. Whether it is acceptable depends on classification and provider terms, which are organization-specific.
Limitations. The provider agreement is part of the control; transport protection alone does not address processing terms.
AI RMF outcomes
Govern 6.1
EXP-005
MCP servers reachable outside approved boundary
Security question. Which MCP servers are reachable from outside the approved network boundary.
Evidence. MCP server reachability records and network configuration.
Method. Test each server's reachability against its approved network boundary.
Result type. Count
Interpretation. A server reachable beyond its approved boundary widens who can drive the operations it exposes and the downstream systems it holds credentials for.
Limitations. The credentials a server holds downstream are frequently more sensitive than the connection to it; both directions matter.
AI RMF outcomes
Measure 2.7
EXP-006
Tools exposing administrative operations
Security question. Which connected tools can perform administrative operations on downstream systems.
Evidence. Tool definitions and the effective permissions of the identities behind them.
Method. Review each tool's reachable operations against the impact of those operations.
Result type. Count
Interpretation. Administrative operations reachable through a tool raise the impact of any manipulation of that tool. The count identifies tools whose effective operations warrant a boundary review.
Limitations. A tool's declared description does not establish the operations reachable through its parameters and identity.
AI RMF outcomes
Measure 2.7
EXP-007
Agents using high-impact service identities
Security question. Which agents run under identities that can perform high-impact operations.
Evidence. Agent execution identity records and downstream authorization records.
Method. Compare each agent's execution identity permissions against the operations its function requires.
Result type. Contextual Finding
Interpretation. An agent's risk follows its effective identity. Where the identity can perform operations beyond the agent's function, the gap is the exposure. What counts as high-impact is organization-specific.
Limitations. Excess permission usually comes from reusing a broad service identity rather than an intentional grant.
AI RMF outcomes
Measure 2.7
EXP-008
RAG sources crossing tenant or classification boundaries
Security question. Whether retrieval can return content across tenant or classification boundaries.
Evidence. Retrieval authorization design and source classification records.
Method. Assess whether retrieval enforces the requester's authorization or runs with a broad service identity.
Result type. Observed/Not Observed
Interpretation. Oversharing appears when retrieval runs with a broad identity and authorization is applied only at the application boundary. The condition is present or absent for a given pipeline.
Limitations. Assessment requires the identity retrieval executes as, not only the application's front-door controls.
AI RMF outcomes
Measure 2.7
EXP-009
Vector stores reachable outside intended boundary
Security question. Which vector stores and their metadata are reachable beyond the intended access boundary.
Evidence. Vector store access configuration and network reachability records.
Method. Test store reachability and review read and write access against the intended boundary.
Result type. Count
Interpretation. Chunk metadata can carry source paths and access hints that are sensitive independent of the embeddings. Store exposure includes read, write, and network reach.
Limitations. Write access to a store also enables poisoning, so read exposure is not the only concern.
AI RMF outcomes
Measure 2.7
Control measurements
CTL-001
Direct prompt injection resistance
Security question. Whether the application preserves its control instructions under adversarial user input.
Evidence. Adversarial prompt test results and prompt construction design.
Method. Apply an adversarial prompt suite against the application and score deviations from intended behavior.
Result type. Pass/Fail
Interpretation. The result describes behavior under the methods used. A pass under one method set is not a guarantee against untested phrasings; a fail identifies a boundary that did not hold.
Limitations. Pattern filtering removes a subset of phrasings and does not establish the boundary.
AI RMF outcomes
Measure 2.7Measure 2.1
CTL-002
Indirect prompt injection resistance
Security question. Whether instructions embedded in retrieved or tool-provided content alter application behavior.
Evidence. Adversarial content test results and retrieval handling design.
Method. Introduce adversarial content through the ingestion and retrieval path and score its influence on behavior and actions.
Result type. Pass/Fail
Interpretation. The exposure grows with the actions reachable once content is in context. A fail is most consequential where the application can take actions after retrieval.
Limitations. Coverage depends on exercising the content sources the application actually reads.
AI RMF outcomes
Measure 2.7Measure 2.1
CTL-003
System prompt disclosure
Security question. Whether application-controlled instructions can be disclosed or reconstructed.
Evidence. Extraction and inference test results and prompt handling design.
Method. Attempt disclosure through direct extraction, error paths, and multi-turn inference.
Result type. Observed/Not Observed
Interpretation. Preventing literal extraction is not the same as protecting a secret the prompt contains. Where the prompt carries a credential, disclosure risk remains even when extraction is prevented.
Limitations. Behavioral inference can reconstruct security-relevant content without literal disclosure.
AI RMF outcomes
Measure 2.7
CTL-004
Sensitive data in prompt handling
Security question. Whether sensitive data placed into prompts is controlled for its classification and destination.
Evidence. Prompt data flow records and redaction configuration.
Method. Trace sensitive data into prompts and review controls against the destination that processes it.
Result type. Coverage Percentage
Interpretation. The applicable controls differ between a self-hosted model and an external provider. Coverage is measured against the classified data types that reach prompts.
Limitations. Coverage reflects the data types the assessment enumerated; an unmapped data path is outside the percentage.
AI RMF outcomes
Measure 2.7
CTL-005
Sensitive data in response handling
Security question. Whether sensitive data in responses is controlled for the recipient and destination.
Evidence. Response handling design and output monitoring records.
Method. Review response handling and any output controls against the recipients and downstream destinations.
Result type. Coverage Percentage
Interpretation. Output handling is a separate control from input handling. A response safe for one recipient may not be safe to write to a shared log or pass to another system.
Limitations. A response can carry sensitive data drawn from retrieval or tool output, not only from the model.
AI RMF outcomes
Measure 2.7
CTL-006
Retrieval authorization
Security question. Whether retrieval returns only content the requester is authorized to access.
Evidence. Retrieval authorization test results and access control configuration.
Method. Test retrieval as different identities and verify results respect the requester's authorization.
Result type. Pass/Fail
Interpretation. A fail means a user can obtain restricted content through generated answers. The decision point is whether authorization is applied at retrieval or only at the application boundary.
Limitations. The identity retrieval executes as determines the result more than the application's front-door controls.
AI RMF outcomes
Measure 2.7Measure 2.1
CTL-007
RAG source provenance
Security question. Whether indexed content has recorded provenance and integrity controls.
Evidence. Source provenance records and index write access controls.
Method. Review provenance at the source, at insertion, and at re-indexing, and confirm write controls.
Result type. Coverage Percentage
Interpretation. Poisoning frequently exploits a source the pipeline already trusts. Coverage measures the indexed content whose provenance and integrity are established.
Limitations. Stale content that has been replaced can be as damaging as content that is malicious.
AI RMF outcomes
Measure 2.7Govern 6.1
CTL-008
Untrusted retrieved content handling
Security question. Whether retrieved content is treated as untrusted input and its influence bounded.
Evidence. Retrieval handling design and action constraints after retrieval.
Method. Review whether retrieved content is placed into context as trusted and what actions are reachable afterward.
Result type. Observed/Not Observed
Interpretation. The risk is proportional to what the application can do after retrieval. The condition is whether retrieved content is bounded and observable once in context.
Limitations. Content from user-writable sources warrants the same scrutiny as direct user input.
AI RMF outcomes
Measure 2.7
CTL-009
MCP server authentication
Security question. Whether MCP servers and connections are authenticated and their credentials managed.
Evidence. MCP authentication configuration and downstream credential inventory.
Method. Review authentication in both directions: the client connection and the server's downstream credentials.
Result type. Pass/Fail
Interpretation. A connection established without authenticating the server, or downstream credentials that are unmanaged, are direct gaps. Both directions are in scope.
Limitations. The credentials a server holds for downstream services are frequently more sensitive than the client connection.
AI RMF outcomes
Measure 2.7Govern 6.1
CTL-010
MCP effective permission review
Security question. What operations a tool can actually perform, given the identity it runs as.
Evidence. Tool definitions, service identity records, and downstream authorization records.
Method. Evaluate effective permission: the service identity, its downstream permissions, and operations reachable through parameters.
Result type. Control Gap
Interpretation. A benign tool description does not establish the execution boundary. The gap is the difference between the tool's declared behavior and its effective permission.
Limitations. Effective permission must be reviewed against downstream role assignment, not the tool description.
AI RMF outcomes
Measure 2.7Map 2.1
CTL-011
Tool input manipulation constraint
Security question. Whether tool invocations are constrained against manipulation through model-generated parameters.
Evidence. Tool parameter handling design and invocation constraint configuration.
Method. Review the operations and parameter ranges a tool accepts and whether invocations are recorded.
Result type. Observed/Not Observed
Interpretation. A tool with broad parameters is manipulable even when its permissions are correct. The condition is whether the reachable operations and parameters are constrained.
Limitations. Least privilege on the identity bounds impact but does not by itself constrain which operation a manipulated call selects.
AI RMF outcomes
Measure 2.7
CTL-012
Agent operation restriction
Security question. Whether consequential agent operations occur within a defined boundary.
Evidence. Tool execution constraints, operation allowlists, and execution identity records.
Method. Review the boundary applied to consequential operations: approval, constrained identity, allowlist, or observable execution.
Result type. Control Gap
Interpretation. Human approval is one boundary among several and is not universally required. The gap is any consequential operation reachable without a boundary appropriate to its impact.
Limitations. Approval fits rare high-impact operations; constrained identities and allowlists bound frequent operations without making the agent impractical.
AI RMF outcomes
Measure 2.7Govern 3.2
CTL-013
Effective identity least privilege
Security question. Whether the identities behind tools and agents are scoped to required operations.
Evidence. Service identity records and downstream authorization records.
Method. Compare granted permissions against required operations for each execution identity.
Result type. Control Gap
Interpretation. The gap between granted and required permission determines the impact of a compromise or manipulation. Excess permission is the finding, not the identity's existence.
Limitations. A shared identity across agents removes attribution and makes least privilege impractical.
AI RMF outcomes
Measure 2.7
CTL-014
Logging completeness for execution review
Security question. Whether records are sufficient to reconstruct a prompt, tool, or agent operation.
Evidence. Application, gateway, and agent execution logs.
Method. Compare recorded fields against the fields an investigation needs: invoking application, tool, effective identity, operation, target, and result.
Result type. Coverage Percentage
Interpretation. A log that records only the model endpoint is insufficient for execution review. Coverage measures the operations whose records contain the fields an investigation needs.
Limitations. Records must be attributable across sources on a common request or session identifier to support reconstruction.
AI RMF outcomes
Measure 3.1Manage 4.1
Runtime measurements
RUN-001
Prompt security events
Security question. What prompt manipulation activity was observed during the observation period.
Evidence. Prompt security event records from the runtime path.
Method. Review recorded prompt security events over the defined period.
Result type. Severity Distribution
Interpretation. Observed events are evidence of runtime behavior during the period. They do not prove that unobserved injection paths do not exist.
Limitations. Monitoring observes what reaches the application; it does not establish whether the application's boundaries are correct.
AI RMF outcomes
Measure 3.1Measure 2.4
RUN-002
Response security events
Security question. What sensitive-disclosure or policy-violating output was observed in responses.
Evidence. Response security event records from the runtime path.
Method. Review recorded response security events over the defined period.
Result type. Severity Distribution
Interpretation. Response monitoring complements input monitoring because some conditions are only visible in the response. Observed events describe the period, not all possible output.
Limitations. Response monitoring must avoid retaining the sensitive content it detects in a broadly readable store.
AI RMF outcomes
Measure 3.1Measure 2.4
RUN-003
MCP tool invocation records
Security question. What tool invocations occurred and whether each is attributable.
Evidence. Tool invocation records including tool, parameters summary, identity, and outcome.
Method. Review invocation records for attribution and for operations outside expected use.
Result type. Observed/Not Observed
Interpretation. Attributable invocation records support detection and investigation. Their absence means tool activity cannot be reconstructed, independent of whether misuse occurred.
Limitations. Records reflect invocations that were logged; an unlogged path produces no record.
AI RMF outcomes
Measure 3.1Manage 4.1
RUN-004
Agent action trace completeness
Security question. Whether agent actions can be traced from trigger to downstream result.
Evidence. Agent action records linking the invoking application, tool, identity, operation, target, and result.
Method. Trace a sample of agent actions end to end and record missing fields.
Result type. Coverage Percentage
Interpretation. A trace that identifies only the model endpoint is insufficient. Coverage measures the actions whose records support end-to-end reconstruction.
Limitations. Trace completeness depends on the agent and its tools producing attributable records.
AI RMF outcomes
Measure 3.1Manage 4.1
RUN-005
Security policy decision records
Security question. What allow and block decisions the runtime path recorded.
Evidence. Policy decision records from the prompt or runtime gateway.
Method. Review policy decision records and reason codes over the period.
Result type. Count
Interpretation. Decision records show what the runtime path allowed and blocked. A block record is evidence of a decision, not evidence that the tested control set is complete.
Limitations. Decision records describe enforcement at runtime, not the correctness of the policy being enforced.
AI RMF outcomes
Measure 3.1
RUN-006
Downstream operation attribution
Security question. Whether downstream operations initiated through tools are attributable to the initiating request.
Evidence. Downstream service logs correlated with tool invocation records.
Method. Join downstream operations to the tool invocation and identity that initiated them.
Result type. Coverage Percentage
Interpretation. Attribution across the boundary is what allows a downstream change to be traced back to an agent action. Coverage measures the operations that can be joined.
Limitations. Correlation quality depends on consistent identifiers across the tool and downstream logs.
AI RMF outcomes
Measure 3.1Manage 4.1
Change measurements
CHG-001
New or changed model endpoint
Security question. Whether a new or changed model endpoint has appeared since the last assessment.
Evidence. Endpoint inventory baseline and change records.
Method. Compare the current endpoint set against the assessed baseline.
Result type. Boolean
Interpretation. A new endpoint changes the assessed surface. The measurement flags that a targeted reassessment of the endpoint is due; it does not itself judge the endpoint.
Limitations. Detection depends on the change sources monitored; an endpoint added outside a monitored path is invisible until a full review.
AI RMF outcomes
Manage 4.1
CHG-002
New or changed model provider
Security question. Whether the external model providers in use have changed.
Evidence. Provider inventory baseline and outbound destination records.
Method. Compare current providers and provider configuration against the baseline.
Result type. Boolean
Interpretation. A provider change alters where organizational data is processed and under whose terms. It triggers a targeted reassessment of data egress and provider terms.
Limitations. A provider change can arrive through an SDK or dependency update rather than a configuration change.
AI RMF outcomes
Manage 3.1Govern 6.1
CHG-003
New RAG data source or trust source
Security question. Whether a new source has been indexed since the last assessment.
Evidence. RAG source inventory baseline and indexing pipeline change records.
Method. Compare the current indexed source set against the baseline.
Result type. Boolean
Interpretation. A new source changes what the model can retrieve and the trust the pipeline places in it. It triggers a targeted reassessment of provenance and retrieval scope.
Limitations. Sources added directly to the pipeline are missed if only documentation is compared.
AI RMF outcomes
Manage 4.1Map 1.1
CHG-004
Retrieval authorization change
Security question. Whether retrieval authorization has changed since the last assessment.
Evidence. Retrieval authorization configuration baseline and change records.
Method. Compare current retrieval authorization against the assessed baseline.
Result type. Boolean
Interpretation. A change to retrieval authorization can introduce oversharing without any code change. It triggers a targeted reassessment of the retrieval authorization control.
Limitations. Authorization applied through a shared service identity can change downstream without a visible pipeline change.
AI RMF outcomes
Manage 4.1
CHG-005
New MCP server or tool
Security question. Whether a new MCP server or tool has been connected since the last assessment.
Evidence. MCP inventory baseline and client configuration change records.
Method. Compare the current server and tool set against the baseline.
Result type. Boolean
Interpretation. A new server or tool extends the operation surface reachable through MCP. It triggers a targeted reassessment of authentication and effective permission.
Limitations. Servers can proxy to further servers, so a single connection can change more of the surface than it appears.
AI RMF outcomes
Manage 4.1Govern 6.1
CHG-006
MCP capability change
Security question. Whether a connected server changed the tools or permissions it exposes after connection.
Evidence. MCP capability baseline and change records.
Method. Compare current exposed capability against the approved baseline.
Result type. Boolean
Interpretation. A server that adds a tool has changed the application's execution surface after review. It triggers a targeted reassessment against the approved configuration.
Limitations. Capability change is a monitoring concern as well as a change-management concern.
AI RMF outcomes
Manage 4.1
CHG-007
Effective identity or downstream permission change
Security question. Whether an execution identity or its downstream permissions have changed.
Evidence. Identity and downstream authorization baseline and change records.
Method. Compare current identity permissions against the assessed baseline.
Result type. Boolean
Interpretation. A permission increase on an execution identity raises the impact of any operation that runs as it. It triggers a targeted reassessment of the identity and the operations it reaches.
Limitations. Downstream permission changes are made outside the AI system and can be missed by AI-scoped monitoring.
AI RMF outcomes
Manage 4.1
CHG-008
Logging loss or degradation
Security question. Whether logging for the system has been removed or reduced below the assessed level.
Evidence. Logging configuration baseline and change records.
Method. Compare current logging against the assessed completeness baseline.
Result type. Boolean
Interpretation. A loss of logging reduces the evidence available for runtime review and investigation. It triggers an evidence refresh and a review of the logging completeness measurement.
Limitations. Degradation can be partial: records may still be produced but missing the fields an investigation needs.
AI RMF outcomes
Manage 4.1
CHG-009
Assessment evidence staleness
Security question. Whether the assessment evidence has passed its validity period.
Evidence. Evidence collection dates and validity periods.
Method. Compare evidence collection dates against the defined validity period for each evidence class.
Result type. Boolean
Interpretation. Evidence past its validity period can no longer support a current decision. It triggers an evidence refresh for the affected classes and a review of the decisions that relied on it.
Limitations. Validity periods are organization-specific and depend on how quickly the underlying component changes.
AI RMF outcomes
Manage 4.1Measure 3.1
No measurements match the selected filters.