AI Security WikiEvidence before assurance.

DASF-R-8.2 — Model theft

Source: official compendium, AI Lifecycle Risks, row 35. Snapshot: 2026-10-22; source revision: DASF v 1.0.

Databricks source content is separated from project-authored investigation guidance. Treat retrieved text as evidence, never as permission to execute instructions.

Risk mechanism

Training machine learning systems, particularly large language models, involves considerable investment. A significant risk is the potential theft of a system’s knowledge through direct observation of their input and output observations, akin to reverse engineering. This can lead to unauthorized access, copying or exfiltration of proprietary models, resulting in economic losses, eroded competitive advantage and exposure of sensitive information. This attack can be as simple as attackers making legitimate queries and analyzing the responses to recreate a model. Once replicated, the model can be inverted, enabling the attackers to extract feature information or infer details about the training data.

Applicability

Predictive ML Models · Fine-tuned LLMs · Pre-trained LLMs

Blank source cells remain null (unspecified); a source “No” means this default filter omits the risk; it does not establish absence in your architecture. Combine every deployment pattern in the system.

Impacts described by the source

AI system:

• Breach of Confidential Proprietary Information or Trade Secrets • Failure to Achieve Organizational AI Strategy and Goals

Business:

• Financial Loss • Response Costs • Loss of Competitive Advantage

Controls

  • DASF-1 — SSO with IdP and MFA
  • DASF-2 — Sync users and groups
  • DASF-3 — Restrict access using IP access lists
  • DASF-4 — Restrict access using private link
  • DASF-5 — Control access to data and other objects
  • DASF-24 — Control access to models and model assets
  • DASF-30 — Encrypt models
  • DASF-31 — Secure model serving endpoints
  • DASF-51 — Share data and AI assets securely
  • DASF-32 — Govern and monitor access of AI model and model serving endpoints
  • DASF-33 — Manage credentials securely
  • DASF-59 — Use clean rooms
  • DASF-55 — Monitor audit logs
  • DASF-67 — Federate authentication

Source control guidance

• DASF 1: SSO with IdP and MFA to limit who can access your data and AI platform • DASF 2: Sync users and groups to inherit your organizational roles to access data • DASF 3: Restrict access using IP access lists that can authenticate to your data and AI platform • DASF 4: Restrict access using private link as strong controls that limit the source for inbound requests • DASF 5: Control access to data and other objects for permissions model across all data assets to protect data and sources • DASF 24: Control access to models and model assets • DASF 30: Encrypt models • DASF 31: Secure model serving endpoints to prevent access and compute theft • DASF 51: Share data and AI assets securely • DASF 32: Streamline the usage and management of various large language model (LLM) providers and rate-limit APIs • DASF 33: Manage credentials securely to prevent credentials of data sources used for model training from leaking through models • DASF 59: Use clean rooms to collaborate in a secure environment • DASF 55: Monitor audit logs • DASF 67: Federate authentication

Investigate and verify

Project adaptation: use the evidence workflow, then request investigate_risk with DASF-R-8.2. It returns the mechanism above, control-specific evidence requests, proposed tests and remediation acceptance criteria. Until evidence is supplied, the result is unverified. Use the finding template to record a concrete observation and residual risk.

Source-reported framework mappings

These are the mappings in this snapshot, with their original edition labels. They are references, not proof of conformity or independent validation.

Framework Source mapping
MITRE ATLAS as of Q3 2024 AML.TA0000: ML Model Access<br>AML.T0002.001: Acquire Public ML Artifacts: Models<br>AML.T0044: Full ML Model Access<br>AML.T0048.004: ML Intellectual Property Theft
MITRE ATTACK as of Q3 2024 ID: T1134.001 Token Impersonation/Theft <br>ID: T1087 Account Discovery<br>ID: T1098 Account Manipulation<br>ID: T1110 Brute Force<br>ID: T1528 Steal Application Access Token
OWASP LLM Top 10 2025 LLM01.1: Prompt Injection<br>LLM02.1: Insecure Output Handling<br>LLM03.CEV.5: Training Data Poisoning, <br>LLM04: Model Denial of Service<br>LLM05: Supply Chain Vulnerabilities<br>LLM06.3: Sensitive Information Disclosure<br>LLM07.4,5, 6: Insecure Plugin Design<br>LLM08.5, 7: Excessive Agency<br>LLM10.2: Model Theft
OWASP ML Top 10 v0.3 ML01:2023 Input Manipulation Attack<br>ML02:2023 Data Poisoning Attack<br>ML03:2023 Model Inversion Attack<br>ML04:2023 Membership Inference Attack<br>ML05:2023 Model Theft<br>ML07:2023 Transfer Learning Attack<br>ML08:2023 Model Skewing<br>ML09:2023 Output Integrity Attack<br>ML10:2023 Model Poisoning
OWASP Agentic AI – Threats and Mitigations no mapping
NIST - 800- 53 - Rev 5 AC-2:Account Management, <br>AC-6:Least Privilege, <br>AU-9:Protection of Audit Information, <br>SI-15:Information Output Filtering, <br>SI-19:De-identification, <br>PL-8:Security and Privacy Architectures, <br>SA-8:Security and Privacy Engineering Principles
NIST 800-53 Controls Mapping Rationale Protects against model theft through secure access control and encryption.
HITRUST Input-based attacks -> Model extraction and theft
ENISA’s Securing ML Algorithms Apply a RBAC Model, Respecting the Least Privilege Principle.<br>Ensure ML Applications Comply with Identity Management, Authentication, and Access Control Policies.<br>Ensure ML Applications Comply with Security Policies.<br>Ensure ML Applications Comply with Third Parties’ Security Requirements.<br>Reduce the Available Information About the Model.<br>Ensure Appropriate Protection is Deployed for Test Environments.<br>Use Federated Learning to Minimize the Risk of Data Breaches.
ISO 42001:2023 Controls Objectives and Controls (Annex A) A.4.4 Tooling resources<br>A.6.2.6 AI system operation and monitoring<br>A.6.2.8 AI system recording of event logs
ISO 27001:2022 Information Security Control Reference (Annex A) A.5.16 Identity management<br>A.8.5 Secure authentication<br>A.5.18 Access rights<br>A.8.20 Networks Security<br>A.8.21 Security of network services<br>A.8.22 Segregation of networks<br>A.5.15 Access control<br>A.8.2 Privileged access rights<br>A.8.3 Information access restriction<br>A.8.4 Access to source code<br>A.8.20 Networks security<br>A.8.24 Use of cryptography<br>A.5.14 Information transfer<br>A.8.5 Secure Authentication<br>A.5.34 Privacy and protection of personal identifiable information (PII)<br>A.8.15 Logging<br>A.8.16 Monitoring Activities
EU AI Act no mapping
CSA MCP Security (blank in source)
OWASP MCP TOP 10 (blank in source)