Borehole · Project · free tier
vllm-project/vllm
Free reading: not for reliance
f0abb2f · 23,618 commits · 8,367 files
Read 2026-10-22

vllm-project/vllm: technical due diligence, read from its repository

What Borehole read in vllm-project/vllm's code and history at f0abb2f: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.

DimensionRating
Architecture & Codebase — including AI provenancestrong
Engineering Process & SDLC Maturitystrong
Product & Engineering Maturitynot assessable
Security & Reliability Posturestrong
Observability & Operationsadequate
Fit with the Acquirernot assessable

What the repository says

  • Releases are cut from another branch than the one surveyed
  • AGENTS.md:3: states a policy on AI-generated contributions

Architecture & Codebase — including AI provenance

strong
01.6

rust/src/server/src/routes/tests.rs is 8,943 lines, 43× this codebase's median file

adequate

The median source file here is 206 lines. 50 files exceed 2,060 lines, the largest being 8,943. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.

Evidence
rust/src/server/src/routes/tests.rs:1 — 8,943 lines (43× median)
vllm/v1/worker/gpu_model_runner.py:1 — 7,193 lines (34× median)
vllm/_aiter_ops.py:1 — 5,206 lines (25× median)
vllm/_custom_ops.py:1 — 4,865 lines (23× median)
vllm/v1/attention/ops/rocm_aiter_mla_sparse.py:1 — 4,757 lines (23× median)

Engineering Process & SDLC Maturity

strong
02.16

Tests are retried until they pass

adequate

34 tests are individually marked to retry. A retry turns a flaky test green without saying why it failed, so a green build means the tests passed eventually. Ask how many retries a typical run needs, and which tests need them.

Product & Engineering Maturity

not assessable
04.62

Releases are cut from another branch than the one surveyed

adequate

The newest release, v0.32.0, is not on the branch this survey read; the newest release on it is v0.11.1. The shipped product may differ from what this report describes. Survey the release branch too.

Evidence
tag v0.32.0

Security & Reliability Posture

strong
05.3

10 dependencies float, and no lockfile is committed

adequate

Dependency versions are declared as ranges and no lockfile is committed, so a build today does not necessarily produce what a build last month produced. That matters twice over in a transaction: the thing being bought cannot be reproduced exactly, and a compromised upstream release arrives without anyone choosing to take it.

05.27

The build runs third-party code it does not pin

adequate

1 third-party CI action is referenced by a tag or branch rather than a commit, so they run whatever that tag points to on the day; 2 steps pipe a download straight into a shell. Tags have been moved to malicious commits in real supply-chain attacks, and a piped script is whatever the server returns that minute. Pinning to a commit is the fix, and it is small.

Evidence
.github/workflows/recipes.yml:25 — action pinned by tag
docker/Dockerfile:169 — download piped into a shell
05.13

10 outbound calls can wait forever

adequate

10 HTTP calls use a client with no timeout (Python `requests` without `timeout=`, or Go's default client). When a dependency slows down, each one holds a worker until the connection gives up, and enough of them take the service down with the dependency.

Evidence
vllm/v1/core/sched/diffusion_scheduler.py:42 — outbound call without a timeout
vllm/v1/core/sched/scheduler.py:2075 — outbound call without a timeout
vllm/v1/core/sched/scheduler.py:2097 — outbound call without a timeout
05.21

2 shell commands built from strings

adequate

2 places run a command through a shell (`shell=True`, `os.system`, `exec` with a template) rather than passing arguments. Where any part comes from outside, it is command injection. Ask where each one's input comes from.

Evidence
vllm/utils/cpu_resource_utils.py:289 — command run through a shell
vllm/utils/cpu_resource_utils.py:293 — command run through a shell
05.22

19 deserialisers that can run code

adequate

19 places read data with a deserialiser that executes what it reads (pickle). That is safe on data the system wrote itself and remote code execution on anything else. Ask where each one's input comes from.

Evidence
vllm/compilation/caching.py:130 — code-executing deserialiser
vllm/compilation/caching.py:311 — code-executing deserialiser
vllm/distributed/device_communicators/all_reduce_utils.py:417 — code-executing deserialiser
05.26

19 locked dependencies have published vulnerabilities

adequate

19 of 631 locked dependencies match 22 published advisories in OSV. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version. This lockfile pins development tools alongside what ships and does not say which is which, so some of these may never reach a user.

Evidence
rust/Cargo.lock — rustls 0.23.37: GHSA-2mjx-qc3c-rqvc (moderate), fixed in 0.23.45
rust/Cargo.lock — anyhow 1.0.102: RUSTSEC-2026-0190 (unrated), fixed in 1.0.103
rust/Cargo.lock — backoff 0.4.0: RUSTSEC-2025-0012 (unrated)
05.65

146 advisories against this project in the last 24 months, 56 high or critical

adequate

The newest was published on 2026-10-21. A project that publishes advisories is telling its users about its fixes, and the count and pace say how much security work it carries. Whether 52 of them are fixed in the code you ship could not be told from this history: its version is only known to be at least 0.11.1. Answer lives in: the release you run, set against each fixed version. GHSA-q97c-p368-75c4 (moderate), GHSA-6757-hggm-hp2w (high), GHSA-vfp2-c8pq-v6h6 (high) and 50 more are fixed in the surveyed commit; which release carries them cannot be told from this history, which does not place the release users run. Answer lives in: the version you run. The record is incomplete: NVD: 8 records name vllm with nothing tying them to this repository (CVE-2024-11041, CVE-2024-8939, CVE-2024-9053, …).

Evidence
2026-10-21: CVE-2026-114049 (moderate): vLLM before 0.31.0 contains a cross-request mask leak in InputBatch.condense() that allows remote attackers to constrain other clients' outputs by leaving stale
2026-10-21: CVE-2026-114051 (high): vLLM before 0.31.0 skips the min_tokens <= max_tokens check for /inference/v1/generate requests with a null max_tokens, so the EngineCore input thread later die
2026-10-21: CVE-2026-114052 (high): vLLM after 0.24.0 and before 0.31.0 contains a memory exhaustion vulnerability in MOSS-Audio model serving that caches a processor for every distinct request-co
2026-10-21: CVE-2026-114053 (critical): vLLM from 0.7.3 before 0.31.0 forwards the request-supplied mm_processor_kwargs.code_revision to Transformers AutoProcessor.from_pretrained, letting clients sel
2026-10-21: CVE-2026-114054 (high): vLLM before 0.31.0 contains a cache aliasing vulnerability that allows authenticated attackers to collide shared cache keys by supplying caller-controlled value

Observability & Operations

adequate
06.2

No structured logging library is in use

adequate

Nothing references a structured logging library. Logs that are written to be read by a person are not searchable by a machine, which means incident response here is proportional to how well someone remembers the codebase rather than to what the tooling can find.

Evidence
searched 6,620 files for 10 structured logging libraries; 0 matched
06.9

No error reporter is wired in

adequate

Nothing in the service initialises an error reporter (Sentry, Rollbar, Bugsnag, Honeybadger or an APM agent). An exception in production reaches a person only if someone is reading the logs, which usually means a customer reports it first.

Evidence
no error reporter initialised
06.35

Sends usage data to stats.vllm.ai by default

adequate

vllm/envs.py sends to stats.vllm.ai, and rust/src/server/src/routes/inference/generate/convert.rs leaves reporting on as shipped. Every installation reports to the vendor unless its operator turns this off. For a buyer running it inside their own product, that is an outbound data flow to a third party: ask what is sent, how often, and whether the buyer's customers were told.

Evidence
vllm/envs.py:37 — reports to stats.vllm.ai
rust/src/server/src/routes/inference/generate/convert.rs:317 — the reporting setting is on by default

Fit with the Acquirer

not assessable

Not rated: structurally not assessable from a repository.

Read more, or read your own

The full report on vllm-project/vllm: every dimension, the questions for the room, and the audit log.

Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.