Read 2026-10-23
skypilot-org/skypilot: technical due diligence, read from its repository
What Borehole read in skypilot-org/skypilot's code and history at 8e91a22: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.
| Dimension | Rating |
|---|---|
| Architecture & Codebase — including AI provenance | strong |
| Engineering Process & SDLC Maturity | strong |
| Product & Engineering Maturity | strong |
| Security & Reliability Posture | adequate |
| Observability & Operations | adequate |
| Fit with the Acquirer | not assessable |
What the repository says
- Releases are cut from another branch than the one surveyed
README.md:52: states a policy on AI-generated contributions
Architecture & Codebase — including AI provenance
strongsky/client/cli/command.py is 8,838 lines, 50× this codebase's median file
adequateThe median source file here is 175 lines. 37 files exceed 1,750 lines, the largest being 8,838. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.
sky/client/cli/command.py:1 — 8,838 lines (50× median) |
sky/backends/cloud_vm_ray_backend.py:1 — 7,269 lines (41× median) |
sky/jobs/state.py:1 — 6,480 lines (37× median) |
sky/provision/kubernetes/utils.py:1 — 6,109 lines (34× median) |
sky/data/storage.py:1 — 5,984 lines (34× median) |
Engineering Process & SDLC Maturity
strongNo finding.
Product & Engineering Maturity
strongGo 1.23 is past end of life
adequateThe code is pinned to Go 1.23 (end of life 2025-08-12). None of these receives security fixes any more; the first stopped on 2025-08-12. Moving off an unsupported runtime is rarely a one-line change, so a buyer should ask whether the upgrade is planned and what it touches.
addons/fuse-proxy/Dockerfile — Go 1.23, end of life 2025-08-12 |
Releases are cut from another branch than the one surveyed
adequateThe newest release, v0.14.1, is not on the branch this survey read; the newest pre-release on it is v0.5.0-rc1. The shipped product may differ from what this report describes. Survey the release branch too.
| tag v0.14.1 |
Security & Reliability Posture
adequate2 Dockerfiles run the application as root
adequateNo USER instruction switches away from root, so the process runs with full privileges inside the container. It is a one-line fix and an ordinary expectation, which is why its absence is worth asking about: it usually says more about whether anyone has reviewed the deployment than about this container specifically.
Dockerfile — runs as root |
addons/fuse-proxy/Dockerfile — runs as root |
The build runs third-party code it does not pin
adequate3 third-party CI actions are referenced by a tag or branch rather than a commit, so they run whatever that tag points to on the day; 2 steps pipe a download straight into a shell. Tags have been moved to malicious commits in real supply-chain attacks, and a piped script is whatever the server returns that minute. Pinning to a commit is the fix, and it is small.
.github/workflows/buildkite-trigger-wait.yml:77 — action pinned by tag |
.github/workflows/format.yml:25 — action pinned by tag |
Dockerfile:41 — download piped into a shell |
44 outbound calls can wait forever
adequate44 HTTP calls use a client with no timeout (Python `requests` without `timeout=`, or Go's default client). When a dependency slows down, each one holds a worker until the connection gives up, and enough of them take the service down with the dependency.
sky/adaptors/verda.py:347 — outbound call without a timeout |
sky/adaptors/verda.py:384 — outbound call without a timeout |
sky/adaptors/verda.py:418 — outbound call without a timeout |
19 SQL statements built from strings
adequate19 places in product code build SQL by formatting or joining strings rather than passing parameters. 4 of them put a value into the string; in the rest, what the code shows going in is a table or column name, a constant, or something the line does not show. Ask whether any value reaches these strings, rather than a parameter.
sky/server/requests/requests.py:886 — SQL built from a string |
sky/server/requests/requests.py:1792 — SQL built from a string |
sky/skylet/job_lib.py:293 — SQL built from a string |
59 shell commands built from strings
adequate59 places run a command through a shell (`shell=True`, `os.system`, `exec` with a template) rather than passing arguments. Where any part comes from outside, it is command injection. Ask where each one's input comes from.
sky/authentication.py:160 — command run through a shell |
sky/authentication.py:200 — command run through a shell |
sky/authentication.py:213 — command run through a shell |
25 deserialisers that can run code
adequate25 places read data with a deserialiser that executes what it reads (pickle). That is safe on data the system wrote itself and remote code execution on anything else. Ask where each one's input comes from.
sky/global_user_state.py:2038 — code-executing deserialiser |
sky/global_user_state.py:2080 — code-executing deserialiser |
sky/global_user_state.py:2098 — code-executing deserialiser |
23 locked dependencies have published vulnerabilities, 33 high or critical in what ships
adequate23 of 449 locked dependencies match 90 published advisories in OSV, 44 of them rated high or critical. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version.
sky/dashboard/package-lock.json — next 14.2.4: GHSA-2464-fhr4-w9xw (critical), fixed in 15.5.28 |
sky/dashboard/package-lock.json — proxy-addr 2.0.7: GHSA-jqcg-44mw-7w3h (critical), fixed in 2.0.8 |
sky/dashboard/package-lock.json — @remix-run/router 1.23.0: GHSA-2w69-qvjg-hvjx (high), fixed in 1.23.2 |
2 workload settings give a container the host
adequate2 places in the deployment configuration run a container privileged or in the host's network, process or IPC namespace. A compromise of that container is a compromise of the machine, and most acquirers' security reviews block it. Node agents (network, storage, monitoring) are excluded.
charts/skypilot/templates/api-deployment.yaml:84 — privileged or host namespace |
sky/provision/kubernetes/manifests/fusermount-server-daemonset.yaml:28 — privileged or host namespace |
10 places insert HTML from a variable without sanitising it
adequate10 places set HTML from a value that is neither a literal nor passed through a sanitiser. Where the value can come from a user, that is stored cross-site scripting, and it is the first thing a buyer's security review looks for in a frontend.
llm/distributed-rl-eval/static/dashboard.html:704 — HTML from a variable |
llm/distributed-rl-eval/static/dashboard.html:770 — HTML from a variable |
llm/distributed-rl-eval/static/dashboard.html:826 — HTML from a variable |
3 advisories against this project in the last 24 months, 2 high or critical
adequateThe newest was published on 2026-09-26. A project that publishes advisories is telling its users about its fixes, and the count and pace say how much security work it carries. Whether 1 of them are fixed in the code you ship could not be told from this history. Answer lives in: the release you run, set against each fixed version.
| 2026-09-26: GHSA-97rf-2jrp-2m59 (critical), fixed in 0.14.0rc1: Path traversal in SkyPilot API server /download endpoint allows authenticated users to read arbitrary files |
| 2026-08-17: CVE-2026-75481 (high): SkyPilot fails to validate that authenticated users are entitled to grant administrator roles when updating service account permissions. Attackers can create a |
| 2026-06-28: CVE-2026-13482 (low): A vulnerability was detected in skypilot-org skypilot up to 0.12.0. Impacted is the function username.encode of the file sky/users/server.py of the component Us |
Observability & Operations
adequateNo structured logging library is in use
adequateNothing references a structured logging library. Logs that are written to be read by a person are not searchable by a machine, which means incident response here is proportional to how well someone remembers the codebase rather than to what the tooling can find.
| searched 2,319 files for 10 structured logging libraries; 0 matched |
No error reporter is wired in
adequateNothing in the service initialises an error reporter (Sentry, Rollbar, Bugsnag, Honeybadger or an APM agent). An exception in production reaches a person only if someone is reading the logs, which usually means a customer reports it first.
| no error reporter initialised |
3 of 5 deployed images carry no version, or `latest`
adequate3 images in the deployment configuration are named without a version or as `latest`. A redeploy can change the software without a commit, a rollback has nothing to roll back to, and nobody can say from the repository what is running.
charts/skypilot/values.yaml:21 — image without a version |
charts/skypilot/values.yaml:638 — image without a version |
sky/utils/kubernetes/k8s_gpu_labeler_job.yaml:16 — image without a version |
Readiness and liveness probes are identical in 1 of 1 workloads
adequateBoth probes call the same endpoint. When a dependency slows down, the liveness probe fails with the readiness probe, so the platform restarts pods that only needed taking out of rotation, and a partial outage becomes a full one. Liveness should ask whether the process is alive; readiness whether it can serve.
charts/skypilot/values.yaml — same probe endpoint twice |
2 of 3 deployments run a single replica
adequate2 deployments set `replicas: 1`, and nothing (an autoscaler, a disruption budget) adds more. Every deploy and every node drain is downtime, and the availability the buyer inherits has a ceiling.
charts/skypilot/templates/oauth2-proxy-deployment.yaml — replicas: 1 |
charts/skypilot/templates/oauth2-proxy-redis.yaml — replicas: 1 |
Fit with the Acquirer
not assessableNot rated: structurally not assessable from a repository.
Read more, or read your own
The full report on skypilot-org/skypilot: every dimension, the questions for the room, and the audit log.
Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.