wowsuch ai
Live

vllm-projectDeveloper platform

vllm v0.30.0

vllm v0.30.0 is a new release of the open-source vllm inference/serving engine providing Python wheels and Docker images across CUDA, ROCm, XPU and CPU targets. The release adds broad model support, GPU weight-caching for faster engine restarts, watermarking support, host-resident sparse decode tiers, and many performance and speculative-decoding improvements.

What it does

Developers can use it to serve supported models through an inference API on their own hardware.

Availability
Released September 22, 2026; Python wheels and Docker images listed
Pricing model
Not stated.
Deployment
Python wheels and Docker images for CUDA, ROCm, CPU, and XPU
Privacy
Not stated.
Licence
Not stated.
Capability
text generationimage generationaudio generationanalysiscode generation
Modality
textimageaudiovideocodemultimodal
Access
APICLI
Deployment
on-premisesprivate cloud
Pricing
unknown
Target user
developerresearcherenterprise

Evidence

6 claims
  • vLLM 0.30.0 was released on September 22. [1]
  • The release provides Python wheels and Docker images for CUDA, ROCm, CPU, and XPU. [1]
  • The release adds support for DeepSeek-V4.1-Flash, GLM-5.3-Flash, K2-Horizon, and other models. [1]
    GLM-5.3-Flash : EPLB support ( #55119 ), FlashKDA for KDA chunked prefill (1.7-3.8x faster than the Triton chunk path, #55737 ), dense and masked-MHA sparse prefill for the NoPE (256, 0, 256) layout ( #55738 ), decode hot-path cleanups removing per-layer copies and a duplicate router GEMM ( #55736 ), and the glm5next NVIDIA subtree now packaged in wheels ( #55214 ).
    GitHub watchlist. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • The release adds Gumbel-max watermarked generation and detection, with per-request opt-out. [1]
    Watermarking : Gumbel-max watermarked generation and detection with a keyed PRF, per-request opt-out and an example detection endpoint ( #54053 ); dual-key Gumbel-max makes it compatible with speculative decoding ( #56122 ); the Rust frontend forwards the per-request controls ( #56338 ).
    GitHub watchlist. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • HiSparse can spill sparse-MLA KV pages to pinned host memory under GPU pressure. [1]
    HiSparse : a host-resident tier for sparse-MLA decode that spills KV pages to pinned host memory under GPU pressure and serves top-k misses from a per-request GPU hot buffer, enabled through HiSparseConnector ( #53781 ), with Prometheus counters ( #56061 ), a host cache shared across TP ranks ( #56629 ), and the attention config inferred from the connector ( #57041 ).
    GitHub watchlist. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • Model Runner V2 adds dual-batch overlap in eager mode and with FULL CUDA graphs. [1]

Sources

1
1
GitHub watchlistOwner-controlled
https://github.com/vllm-project/vllm/releases/tag/v0.30.0 Retrieved 2026-10-28 00:02 UTC
Verified

Versions

35
VersionEffectiveChangeChanged fieldsState
352026-10-28 00:02 UTCmaterial changecapability, modality, access, availability, deploymentCurrent
342026-10-26 01:12 UTCmaterial changecapability, access, availability, deploymentCurrent
332026-10-25 01:09 UTCmaterial changecapability, deployment, availability, deploymentCurrent
322026-10-24 01:40 UTCmaterial changemodality, access, availability, deploymentCurrent
312026-10-23 01:34 UTCmaterial changecapability, modality, access, deployment, pricing, availability, deploymentCurrent
302026-10-22 00:52 UTCmaterial changecapability, deployment, pricing, availability, deployment, privacyCurrent
292026-10-20 19:44 UTCmaterial changecapability, access, deployment, availability, pricing model, deploymentCurrent
282026-10-19 20:40 UTCmaterial changecapability, modality, deployment, pricing, availability, deploymentCurrent
272026-10-18 21:38 UTCmaterial changecapability, modality, deployment, availability, deploymentCurrent
262026-10-17 22:29 UTCmaterial changecapability, pricing, availabilityCurrent
252026-10-16 23:28 UTCmaterial changecapability, modality, access, deployment, pricing, availability, deploymentCurrent
242026-10-16 00:25 UTCmaterial changecapability, modality, access, availability, deploymentCurrent
232026-10-15 01:17 UTCmaterial changecapability, modality, access, deployment, availability, deploymentCurrent
222026-10-14 02:09 UTCmaterial changecapability, access, deployment, availability, deploymentCurrent
212026-10-13 03:01 UTCmaterial changecapability, availability, deploymentCurrent
202026-10-12 03:58 UTCmaterial changecapability, modality, access, pricing, availability, deploymentCurrent
192026-10-11 04:51 UTCmaterial changecapability, modality, access, pricing, availabilityCurrent
182026-10-10 05:45 UTCmaterial changecapability, access, availabilityCurrent
172026-10-09 06:40 UTCmaterial changecapability, modality, access, availability, deploymentCurrent
162026-10-08 07:35 UTCmaterial changecapability, availability, deploymentCurrent
152026-10-07 08:32 UTCmaterial changecapability, modality, access, deployment, availability, deploymentCurrent
142026-10-06 09:31 UTCmaterial changecapability, modality, access, deployment, availability, deploymentCurrent
132026-10-05 10:28 UTCmaterial changecapability, access, availability, deploymentCurrent
122026-10-04 11:24 UTCmaterial changecapability, availability, deploymentCurrent
112026-10-03 12:22 UTCmaterial changecapability, modality, availability, deploymentCurrent
102026-10-02 13:17 UTCmaterial changecapability, access, availability, deploymentCurrent
92026-10-01 14:09 UTCmaterial changecapability, modality, access, availability, deploymentCurrent
82026-09-30 15:03 UTCmaterial changecapability, access, availability, deploymentCurrent
72026-09-29 15:57 UTCmaterial changecapability, modality, access, pricing, availability, deploymentCurrent
62026-09-28 16:47 UTCmaterial changecapability, pricing, availability, deploymentCurrent
52026-09-27 17:42 UTCmaterial changecapability, modality, access, pricing, availability, deploymentCurrent
42026-09-26 18:36 UTCmaterial changecapability, modality, access, pricing, availability, deploymentCurrent
32026-09-25 19:29 UTCmaterial changecapability, access, pricing, availability, deploymentCurrent
22026-09-24 20:22 UTCmaterial changecapability, deployment, pricing, availability, deploymentCurrent
12026-09-23 21:18 UTCpublicationNoneCurrent

In briefs

1

Open in the catalog

Original catalog content is licensed under CC BY 4.0, attributed to wowsuchai. Source quotations and linked content keep their original rights.