Horizon Alert
Summary of the vulnerability and why it matters
A vulnerability in vLLM, a system for serving large language models, allows unauthenticated attackers to execute arbitrary code. This occurs when a specially crafted multimodal request is sent to the `/tokenize` endpoint, potentially compromising the API process.
- Unauthenticated code execution flaw in vLLM.
- Matters if you use vLLM for AI model inference.
- Confirm relevance and scope of potential exposure.
Attack Path
How an attacker could exploit the issue
An attacker could target an unauthenticated `/tokenize` endpoint exposed by vLLM. By crafting a multimodal request that manipulates the `mm_processor_kwargs.code_revision` parameter, an attacker could trick the system into loading a malicious revision of the model's processor code. If `trust_remote_code` is enabled, this allows the attacker to execute arbitrary Python code within the vLLM API process.
- No authentication required for entry.
- Malicious `code_revision` in multimodal request.
- Arbitrary Python code execution.
Live Threat
Current exploitation, exposure, and threat context
When `trust_remote_code` is enabled, an attacker could execute arbitrary Python code within the vLLM API process by crafting a multimodal request to the `/tokenize` endpoint. This occurs when a malicious revision of dynamic processor code is served from the model repository, allowing the attacker to control the code imported by the `Transformers AutoProcessor.from_pretrained` function.
- Arbitrary code execution in API process.
- Malicious model revision via multimodal request.
- Compromise of vLLM API service.
Operational Fix
Recommended remediation, mitigation, and detection steps
Teams responsible for managing and securing AI inference platforms, including platform engineering and security operations, should lead the response. The first step is to inventory all vLLM deployments, determine their exposure to untrusted input, and identify business-critical instances to prioritize remediation efforts.
- Platform or AI engineering teams own remediation.
- Verify vLLM deployment reachability and criticality.
- Plan risk-based updates or temporary mitigations.