CVE 6.5 MEDIUM

vLLM: extract_hidden_states speculative decoding crashes server on any request with penalty parameters_CVE-2026-44223

6.5 / 10
MEDIUM
CVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:U/C:N/I:N/A:H

Description

vLLM is an inference and serving engine for large language models (LLMs). From to before 0.20.0, the extract_hidden_states speculative decoding proposer in vLLM returns a tensor with an incorrect shape after the first decode step, causing a RuntimeError that crashes the EngineCore process. The crash is triggered when any request in the batch uses sampling penalty parameters (repetition_penalty, frequency_penalty, or presence_penalty). A single request with a penalty parameter (e.g., "repetition_penalty": 1.1) is sufficient to crash the server. This vulnerability is fixed in 0.20.0.

Basic Information

ID CVE-2026-44223
Source GitHub_M
Published May 12, 2026 at 19:58

Affected Product

Vendor vllm-project
Product vllm
Version >= 0.18.0, < 0.20.0
Affected Versions vllm-project vllm >= 0.18.0, < 0.20.0

CWE Classification

References

💭 Join the Security Discussion

🔒 Your email address will not be published. Required fields are marked *

⚠️ Please be respectful and constructive in your comments. Security discussions should remain professional.