Horizon Alert
Summary of the vulnerability and why it matters
This advisory concerns a critical vulnerability in the ExLlamaV3 EXL3 loader. The issue arises from the loader's failure to validate model-supplied data before invoking specific functions, potentially leading to crashes or, under certain circumstances, indirect code execution. The primary concern is to confirm if this technology is in use and assess any potential exposure.
- A flaw in model loading can cause system crashes.
- It could allow unauthorized code execution.
- Confirm relevance and check for potential exposure.
Attack Path
How an attacker could exploit the issue
An attacker can leverage a malicious model file to trigger a vulnerability during the loading process of ExLlamaV3's EXL3 loader. This occurs when the loader uses an untrusted index to select a CUDA kernel without proper boundary checks. If successful, an attacker could potentially achieve controlled indirect kernel dispatch, leading to a reproducible crash or, under specific memory conditions, more severe consequences.
- Requires loading a malicious model.
- Vulnerable component accesses untrusted index.
- Risk of crash or controlled code execution.
Live Threat
Current exploitation, exposure, and threat context
When loading a malicious model, an attacker could cause the application to crash by invoking an out-of-range function pointer. In specific scenarios, this may allow for controlled indirect kernel dispatch during model loading.
- Code execution from a malicious model.
- Invoking out-of-range function pointers.
- Application crash and potential code execution.
Operational Fix
Recommended remediation, mitigation, and detection steps
The ExLlamaV3 EXL3 loader's handling of untrusted model data presents a risk that could allow for controlled indirect kernel dispatch during model load. Identifying deployments of this loader, confirming their reachability and criticality, and assigning ownership are the critical first steps. Remediation planning should follow based on this assessment.
- Application owners to investigate model loader usage.
- Verify model loading process and reachability.
- Plan remediation based on exposure and criticality.