Read 2026-11-03
kubeflow/pipelines: technical due diligence, read from its repository
What Borehole read in kubeflow/pipelines's code and history at 3d4c6f1: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.
| Dimension | Rating |
|---|---|
| Architecture & Codebase — including AI provenance | adequate |
| Engineering Process & SDLC Maturity | adequate |
| Product & Engineering Maturity | strong |
| Security & Reliability Posture | adequate |
| Observability & Operations | adequate |
| Fit with the Acquirer | not assessable |
What the repository says
CONTRIBUTING.md:85: This repository is a mirror; development happens elsewhere- Releases are cut from another branch than the one surveyed
README.md:6: names OpenSSFREADME.md:93: names Cloud Native Computing Foundation
Architecture & Codebase — including AI provenance
adequatebackend/src/apiserver/resource/resource_manager.go is 4,431 lines, 41× this codebase's median file
adequateThe median source file here is 106 lines. 25 files exceed 1,060 lines, the largest being 4,431. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.
backend/src/apiserver/resource/resource_manager.go:1 — 4,431 lines (41× median) |
sdk/python/kfp/compiler/pipeline_spec_builder.py:1 — 2,961 lines (27× median) |
frontend/server/handlers/artifacts.ts:1 — 2,267 lines (21× median) |
release/kfpr/steps.py:1 — 2,206 lines (20× median) |
backend/src/v2/component/launcher_v2.go:1 — 2,133 lines (20× median) |
1 base image floats: no version, or `latest`
adequate1 of 7 `FROM` lines in product Dockerfiles name an image without a version, or with `latest`. Each build pulls whatever the registry serves that day, so the image that ships can change without a commit, and last month's build cannot be reproduced. Pin a version, or a digest.
components/google-cloud/Dockerfile:16 — base image without a version |
Engineering Process & SDLC Maturity
adequateTests are retried until they pass
adequateThe suite is configured to retry failing tests (test/frontend-integration-test/dependency-smoke.test.mjs). A retry turns a flaky test green without saying why it failed, so a green build means the tests passed eventually. Ask how many retries a typical run needs, and which tests need them.
test/frontend-integration-test/dependency-smoke.test.mjs:37 — test retry |
5% of recent commits change more than 2,000 lines
adequate64 of 1209 commits in the last 24 months changed over 2,000 lines of code, not counting reformatting, renames, vendored or generated code. A change that size is rarely reviewed line by line. Ask how they were reviewed, and what made them that large.
| 64 commits over 2,000 lines |
Product & Engineering Maturity
strongEffort is shifting from building to rewriting
adequateDeleted lines per line added rose from 0.40 to 0.82 between the first and second halves of this history. Rework is normal and often healthy, but a rising ratio means an increasing share of the team's time is spent replacing code that already exists rather than building what does not. Whether that is deliberate repayment or churn is a question for the team.
| first half 0.40, second half 0.82 (split 2022-08-07) |
15 files still carry code deprecated more than two years ago
adequate15 files were marked deprecated over two years ago and still are, the oldest since Oct 2019. A deprecation is a promise to remove. Ask what still depends on these, and whether removing them is scheduled.
sdk/python/kfp/compiler/compiler.py — deprecated since Oct 2019 |
api/v2alpha1/go/pipelinespec/pipeline_spec.pb.go — deprecated since Aug 2021 |
frontend/src/generated/pipeline_spec/pipeline_spec.ts — deprecated since Dec 2021 |
api/v2alpha1/go/cachekey/cache_key.pb.go — deprecated since Mar 2022 |
sdk/python/kfp/v2/__init__.py — deprecated since Mar 2022 |
Releases are cut from another branch than the one surveyed
adequateThe newest release, 2.18.0, is not on the branch this survey read; the newest release on it is 2.3.0. The shipped product may differ from what this report describes. Survey the release branch too.
| tag 2.18.0 |
Security & Reliability Posture
adequate4 Dockerfiles run the application as root
adequateNo USER instruction switches away from root, so the process runs with full privileges inside the container. It is a one-line fix and an ordinary expectation, which is why its absence is worth asking about: it usually says more about whether anyone has reviewed the deployment than about this container specifically.
backend/Dockerfile — runs as root |
backend/api/Dockerfile — runs as root |
components/google-cloud/Dockerfile — runs as root |
frontend/Dockerfile — runs as root |
12 outbound calls can wait forever
adequate12 HTTP calls use a client with no timeout (Python `requests` without `timeout=`, or Go's default client). When a dependency slows down, each one holds a worker until the connection gives up, and enough of them take the service down with the dependency.
backend/src/common/client/api_server/util.go:131 — outbound call without a timeout |
components/google-cloud/google_cloud_pipeline_components/container/preview/gcp_launcher/job_remote_runner.py:233 — outbound call without a timeout |
components/google-cloud/google_cloud_pipeline_components/container/v1/bigquery/export_model/remote_runner.py:35 — outbound call without a timeout |
1 SQL statement built from strings
adequate1 places in product code build SQL by formatting or joining strings rather than passing parameters. In each, what the code shows going in is a table or column name, a constant, or something the line does not show, not a request's value. Ask whether any value reaches these strings, rather than a parameter.
backend/src/apiserver/client_manager/client_manager.go:1044 — SQL built from a string |
27 of 32 Kubernetes workloads declare no resource limits
adequate27 workload manifests set no CPU or memory limits. One pod that leaks memory or spins can starve everything else on its node, and the scheduler cannot plan capacity for what it cannot see.
manifests/kustomize/base/installs/multi-user/api-service/deployment-patch.yaml — workload with no limits |
manifests/kustomize/base/installs/multi-user/persistence-agent/deployment-patch.yaml — workload with no limits |
manifests/kustomize/base/installs/multi-user/pipelines-profile-controller/deployment.yaml — workload with no limits |
The production build publishes source maps
adequateThe build configuration emits source maps for production, so the original source, with its comments and structure, is downloadable by every visitor. Upload them to an error tracker and keep them off the public server instead.
frontend/vite.config.mts:57 — source maps in a production build |
2 vendored components with no licence
adequateThird-party code is committed into this repository without any statement of the terms it arrived under. Unknown terms are harder to deal with than inconvenient ones: an awkward licence can be complied with, an absent one cannot. Each of these needs its origin established before the code changes hands.
third_party/OWNERS — 1 tracked files, no licence file |
third_party/README.md — 1 tracked files, no licence file |
25 advisories against this project in the last 24 months, 13 high or critical
adequateThe newest was published on 2026-10-29. A project that publishes advisories is telling its users about its fixes, and the count and pace say how much security work it carries. Whether 2 of them are fixed in the code you ship could not be told from this history: its version is only known to be at least 2.3.0. Answer lives in: the release you run, set against each fixed version. GHSA-w95g-prjh-32jh (high), GHSA-m6q4-2p22-7x6f (moderate), GHSA-r98w-fgcr-qc52 (moderate) and 14 more are fixed in the surveyed commit; which release carries them cannot be told from this history, which does not place the release users run. Answer lives in: the version you run. The record is incomplete: NVD: 60 records name pipelines with nothing tying them to this repository (CVE-2023-37264, CVE-2024-38363, CVE-2024-41950, …).
| 2026-10-29: GHSA-8fmv-6rg5-5924 (high), fixed in 0.0.0-20260831164314-ba9ae72cc860: Kubeflow Pipelines: Pipeline archive upload allows decompression bomb to exhaust server memory |
| 2026-10-29: GHSA-wg5q-x4j9-qm54 (high), fixed in 0.0.0-20260904182349-be4723e33727: Kubeflow Pipelines: Run-log endpoint permits unauthorized access to pod logs |
| 2026-10-29: GHSA-w95g-prjh-32jh (high), fixed in 2.18.0: ScheduledWorkflow controller permits cross-tenant run destination confusion |
| 2026-10-29: GHSA-c53j-pv7w-x95q (high), fixed in 2.18.0: Cross-tenant object-store credential minting through reachable KFP profile-controller webhook |
| 2026-10-29: GHSA-m6q4-2p22-7x6f (moderate), fixed in 2.18.0: Artifact and pod-log responses can execute active content in the UI origin |
Observability & Operations
adequateNo error reporter is wired in
adequateNothing in the service initialises an error reporter (Sentry, Rollbar, Bugsnag, Honeybadger or an APM agent). An exception in production reaches a person only if someone is reading the logs, which usually means a customer reports it first.
| no error reporter initialised |
Readiness and liveness probes are identical in 5 of 7 workloads
adequateBoth probes call the same endpoint. When a dependency slows down, the liveness probe fails with the readiness probe, so the platform restarts pods that only needed taking out of rotation, and a partial outage becomes a full one. Liveness should ask whether the process is alive; readiness whether it can serve.
manifests/kustomize/base/installs/multi-user/pipelines-profile-controller/deployment.yaml — same probe endpoint twice |
manifests/kustomize/base/pipeline/ml-pipeline-apiserver-deployment.yaml — same probe endpoint twice |
manifests/kustomize/base/pipeline/ml-pipeline-ui-deployment.yaml — same probe endpoint twice |
4 of 32 deployments run a single replica
adequate4 deployments set `replicas: 1`, and nothing (an autoscaler, a disruption budget) adds more. Every deploy and every node drain is downtime, and the availability the buyer inherits has a ceiling.
Fit with the Acquirer
not assessableNot rated: structurally not assessable from a repository.
Read more, or read your own
The full report on kubeflow/pipelines: every dimension, the questions for the room, and the audit log.
Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.