Read 2026-10-22
vllm-project/vllm: technical due diligence, read from its repository
What Borehole read in vllm-project/vllm's code and history at f0abb2f: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.
| Dimension | Rating |
|---|---|
| Architecture & Codebase — including AI provenance | strong |
| Engineering Process & SDLC Maturity | strong |
| Product & Engineering Maturity | not assessable |
| Security & Reliability Posture | strong |
| Observability & Operations | adequate |
| Fit with the Acquirer | not assessable |
What the repository says
- Releases are cut from another branch than the one surveyed
AGENTS.md:3: states a policy on AI-generated contributions
Architecture & Codebase — including AI provenance
strongrust/src/server/src/routes/tests.rs is 8,943 lines, 43× this codebase's median file
adequateThe median source file here is 206 lines. 50 files exceed 2,060 lines, the largest being 8,943. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.
rust/src/server/src/routes/tests.rs:1 — 8,943 lines (43× median) |
vllm/v1/worker/gpu_model_runner.py:1 — 7,193 lines (34× median) |
vllm/_aiter_ops.py:1 — 5,206 lines (25× median) |
vllm/_custom_ops.py:1 — 4,865 lines (23× median) |
vllm/v1/attention/ops/rocm_aiter_mla_sparse.py:1 — 4,757 lines (23× median) |
Engineering Process & SDLC Maturity
strongTests are retried until they pass
adequate34 tests are individually marked to retry. A retry turns a flaky test green without saying why it failed, so a green build means the tests passed eventually. Ask how many retries a typical run needs, and which tests need them.
tests/basic_correctness/models/test_basic_correctness.py:83 — test retry |
tests/entrypoints/multimodal/openai/chat_completion/test_video.py:438 — test retry |
Product & Engineering Maturity
not assessableReleases are cut from another branch than the one surveyed
adequateThe newest release, v0.32.0, is not on the branch this survey read; the newest release on it is v0.11.1. The shipped product may differ from what this report describes. Survey the release branch too.
| tag v0.32.0 |
Security & Reliability Posture
strong10 dependencies float, and no lockfile is committed
adequateDependency versions are declared as ranges and no lockfile is committed, so a build today does not necessarily produce what a build last month produced. That matters twice over in a transaction: the thing being bought cannot be reproduced exactly, and a compromised upstream release arrives without anyone choosing to take it.
benchmarks/kernels/requirements.txt:1 — any version |
benchmarks/multi_turn/requirements.txt:1 — >=1.24 |
benchmarks/multi_turn/requirements.txt:2 — >=2.0.0 |
benchmarks/multi_turn/requirements.txt:3 — >=3.10 |
benchmarks/multi_turn/requirements.txt:4 — >=4.46 |
The build runs third-party code it does not pin
adequate1 third-party CI action is referenced by a tag or branch rather than a commit, so they run whatever that tag points to on the day; 2 steps pipe a download straight into a shell. Tags have been moved to malicious commits in real supply-chain attacks, and a piped script is whatever the server returns that minute. Pinning to a commit is the fix, and it is small.
.github/workflows/recipes.yml:25 — action pinned by tag |
docker/Dockerfile:169 — download piped into a shell |
10 outbound calls can wait forever
adequate10 HTTP calls use a client with no timeout (Python `requests` without `timeout=`, or Go's default client). When a dependency slows down, each one holds a worker until the connection gives up, and enough of them take the service down with the dependency.
vllm/v1/core/sched/diffusion_scheduler.py:42 — outbound call without a timeout |
vllm/v1/core/sched/scheduler.py:2075 — outbound call without a timeout |
vllm/v1/core/sched/scheduler.py:2097 — outbound call without a timeout |
2 shell commands built from strings
adequate2 places run a command through a shell (`shell=True`, `os.system`, `exec` with a template) rather than passing arguments. Where any part comes from outside, it is command injection. Ask where each one's input comes from.
vllm/utils/cpu_resource_utils.py:289 — command run through a shell |
vllm/utils/cpu_resource_utils.py:293 — command run through a shell |
19 deserialisers that can run code
adequate19 places read data with a deserialiser that executes what it reads (pickle). That is safe on data the system wrote itself and remote code execution on anything else. Ask where each one's input comes from.
vllm/compilation/caching.py:130 — code-executing deserialiser |
vllm/compilation/caching.py:311 — code-executing deserialiser |
vllm/distributed/device_communicators/all_reduce_utils.py:417 — code-executing deserialiser |
19 locked dependencies have published vulnerabilities
adequate19 of 631 locked dependencies match 22 published advisories in OSV. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version. This lockfile pins development tools alongside what ships and does not say which is which, so some of these may never reach a user.
rust/Cargo.lock — rustls 0.23.37: GHSA-2mjx-qc3c-rqvc (moderate), fixed in 0.23.45 |
rust/Cargo.lock — anyhow 1.0.102: RUSTSEC-2026-0190 (unrated), fixed in 1.0.103 |
rust/Cargo.lock — backoff 0.4.0: RUSTSEC-2025-0012 (unrated) |
146 advisories against this project in the last 24 months, 56 high or critical
adequateThe newest was published on 2026-10-21. A project that publishes advisories is telling its users about its fixes, and the count and pace say how much security work it carries. Whether 52 of them are fixed in the code you ship could not be told from this history: its version is only known to be at least 0.11.1. Answer lives in: the release you run, set against each fixed version. GHSA-q97c-p368-75c4 (moderate), GHSA-6757-hggm-hp2w (high), GHSA-vfp2-c8pq-v6h6 (high) and 50 more are fixed in the surveyed commit; which release carries them cannot be told from this history, which does not place the release users run. Answer lives in: the version you run. The record is incomplete: NVD: 8 records name vllm with nothing tying them to this repository (CVE-2024-11041, CVE-2024-8939, CVE-2024-9053, …).
| 2026-10-21: CVE-2026-114049 (moderate): vLLM before 0.31.0 contains a cross-request mask leak in InputBatch.condense() that allows remote attackers to constrain other clients' outputs by leaving stale |
| 2026-10-21: CVE-2026-114051 (high): vLLM before 0.31.0 skips the min_tokens <= max_tokens check for /inference/v1/generate requests with a null max_tokens, so the EngineCore input thread later die |
| 2026-10-21: CVE-2026-114052 (high): vLLM after 0.24.0 and before 0.31.0 contains a memory exhaustion vulnerability in MOSS-Audio model serving that caches a processor for every distinct request-co |
| 2026-10-21: CVE-2026-114053 (critical): vLLM from 0.7.3 before 0.31.0 forwards the request-supplied mm_processor_kwargs.code_revision to Transformers AutoProcessor.from_pretrained, letting clients sel |
| 2026-10-21: CVE-2026-114054 (high): vLLM before 0.31.0 contains a cache aliasing vulnerability that allows authenticated attackers to collide shared cache keys by supplying caller-controlled value |
Observability & Operations
adequateNo structured logging library is in use
adequateNothing references a structured logging library. Logs that are written to be read by a person are not searchable by a machine, which means incident response here is proportional to how well someone remembers the codebase rather than to what the tooling can find.
| searched 6,620 files for 10 structured logging libraries; 0 matched |
No error reporter is wired in
adequateNothing in the service initialises an error reporter (Sentry, Rollbar, Bugsnag, Honeybadger or an APM agent). An exception in production reaches a person only if someone is reading the logs, which usually means a customer reports it first.
| no error reporter initialised |
Sends usage data to stats.vllm.ai by default
adequatevllm/envs.py sends to stats.vllm.ai, and rust/src/server/src/routes/inference/generate/convert.rs leaves reporting on as shipped. Every installation reports to the vendor unless its operator turns this off. For a buyer running it inside their own product, that is an outbound data flow to a third party: ask what is sent, how often, and whether the buyer's customers were told.
vllm/envs.py:37 — reports to stats.vllm.ai |
rust/src/server/src/routes/inference/generate/convert.rs:317 — the reporting setting is on by default |
Fit with the Acquirer
not assessableNot rated: structurally not assessable from a repository.
Read more, or read your own
The full report on vllm-project/vllm: every dimension, the questions for the room, and the audit log.
Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.