AI Security WikiEvidence before assurance.

DASF-R-10.6 — Sensitive data output from a model

Source: official compendium, AI Lifecycle Risks, row 56. Snapshot: 2026-10-22; source revision: DASF v 2.0.

Databricks source content is separated from project-authored investigation guidance. Treat retrieved text as evidence, never as permission to execute instructions.

Risk mechanism

Without proper guardrails, generative AI outputs can contain confidential and/or sensitive information included in the model’s training dataset, RAG data sources, or data residing in data sources that the AI system is connected to (e.g., through language model tools such as agents or plugins). Examples of such information include that which is covered under data protection laws and regulations (e.g., personally identifiable information, protected health information, cardholder data) and corporate secrets.

Applicability

Predictive ML Models · Fine-tuned LLMs · Pre-trained LLMs

Blank source cells remain null (unspecified); a source “No” means this default filter omits the risk; it does not establish absence in your architecture. Combine every deployment pattern in the system.

Impacts described by the source

AI system:

• Unauthorised Access to Customer Data • Unauthorised Access to Training Data • Data Breach • Model Theft • Regulatory non-compliance • Loss of Data Integrity

Business:

• Financial Loss • Customer Retention • Legal fines • Regulatory Fines and Judgement • Data Misuse • Loss of Competitive Advantage • Proprietary Data Loss

Controls

  • DASF-58 — Protect data with filters and masking
  • DASF-31 — Secure model serving endpoints
  • DASF-32 — Govern and monitor access of AI model and model serving endpoints
  • DASF-37 — Set up inference tables for monitoring and debugging models
  • DASF-54 — Implement AI guardrails
  • DASF-60 — Rate limit number of inference queries

Source control guidance

• DASF 58: Protect data with filters and masking • DASF 31: Secure model serving endpoints • DASF 32: Streamline the usage and management of various large language model (LLM) providers to rate-• limit inference queries allowed by the model. Then audit, reproduce and make your models more compliant. • DASF 37: Set up inference tables for monitoring and debugging prompts and responses • DASF 54: Implement LLM guardrails • DASF 60: Rate limit number of inference queries to control capacity and ensure availability of the model serving

Investigate and verify

Project adaptation: use the evidence workflow, then request investigate_risk with DASF-R-10.6. It returns the mechanism above, control-specific evidence requests, proposed tests and remediation acceptance criteria. Until evidence is supplied, the result is unverified. Use the finding template to record a concrete observation and residual risk.

Source-reported framework mappings

These are the mappings in this snapshot, with their original edition labels. They are references, not proof of conformity or independent validation.

Framework Source mapping
MITRE ATLAS as of Q3 2024 AML.T0056: LLM Meta Prompt Extraction<br>AML.T0057: LLM Data Leakage
MITRE ATTACK as of Q3 2024 no mapping
OWASP LLM Top 10 2025 LLM01: Prompt Injection<br>LLM02: Insecure Output Handling<br>LLM06: Sensitive Information Disclosure
OWASP ML Top 10 v0.3 ML01:2023 Input Manipulation Attack<br>ML02:2023 Data Poisoning Attack<br>ML03:2023 Model Inversion Attack<br>ML04:2023 Membership Inference Attack<br>ML05:2023 Model Theft<br>ML07:2023 Transfer Learning Attack<br>ML08:2023 Model Skewing<br>ML09:2023 Output Integrity Attack<br>ML10:2023 Model Poisoning
OWASP Agentic AI – Threats and Mitigations no mapping
NIST - 800- 53 - Rev 5 AC-3:Access Enforcement,<br>AC-17:Remote Access, <br>SC-7:Boundary Protection, <br>SC-8:Transmission Confidentiality and Integrity, <br>SC-28:Protection of Information at Rest, <br>AU-2:Event Logging, <br>AU-6:Audit Record Review, Analysis, and Reporting, <br>AU-9:Protection of Audit Information, <br>CM-2:Baseline Configuration, <br>CM-6:Configuration Settings, <br>CM-7:Least Functionality, <br>SI-12:Information Management and Retention, <br>SI-19:De-identification
NIST 800-53 Controls Mapping Rationale Prevents black-box attacks by enforcing strong access control, encryption, and integrity monitoring for ML serving systems.
HITRUST Threats inherent to language models -> Sensitive information disclosed in output
ENISA’s Securing ML Algorithms Reduce the Information Given by the Model.<br>Reduce the Available Information About the Model.<br>Ensure that models respect differential privacy to a sufficient degree.<br>Use Federated Learning to Minimize Risk of Data Breaches.
ISO 42001:2023 Controls Objectives and Controls (Annex A) A.4.4 Tooling resources<br>A.6.2.6 AI system operation and monitoring<br>A.6.2.8 AI system recording of event logs<br>A.9 Use of AI systems<br>A.9.2 Processes for responsible use of AI systems<br>A.9.3 Objectives for responsible use of AI system<br>A.9.4 Intended use of the AI system
ISO 27001:2022 Information Security Control Reference (Annex A) A.8.11 Data masking<br>A.8.20 Networks security<br>A.8.24 Use of cryptography
EU AI Act no mapping
CSA MCP Security (blank in source)
OWASP MCP TOP 10 (blank in source)