Read 2026-10-28
arize-ai/phoenix: technical due diligence, read from its repository
What Borehole read in arize-ai/phoenix's code and history at ca11e23: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.
| Dimension | Rating |
|---|---|
| Architecture & Codebase — including AI provenance | strong |
| Engineering Process & SDLC Maturity | adequate |
| Product & Engineering Maturity | strong |
| Security & Reliability Posture | adequate |
| Observability & Operations | adequate |
| Fit with the Acquirer | not assessable |
What the repository says
LICENSE:1: The licence is Elastic-2.0: source available, not open source
Architecture & Codebase — including AI provenance
strongjs/app/src/api/__generated__/v1.ts is 14,032 lines, 138× this codebase's median file
adequateThe median source file here is 101 lines. 73 files exceed 1,010 lines, the largest being 14,032. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.
js/app/src/api/__generated__/v1.ts:1 — 14,032 lines (138× median) |
js/packages/phoenix-client/src/__generated__/api/v1.ts:1 — 14,032 lines (138× median) |
js/packages/phoenix-testing/src/__generated__/api/v1.ts:1 — 14,032 lines (138× median) |
src/phoenix/server/api/helpers/playground_clients.py:1 — 4,327 lines (42× median) |
packages/phoenix-client/src/phoenix/client/resources/experiments/__init__.py:1 — 4,243 lines (42× median) |
Engineering Process & SDLC Maturity
adequateTests are retried until they pass
adequateThe suite is configured to retry failing tests (.github/workflows/python-CI.yml). A retry turns a flaky test green without saying why it failed, so a green build means the tests passed eventually. Ask how many retries a typical run needs, and which tests need them.
.github/workflows/python-CI.yml:787 — test retry |
6% of recent commits change more than 2,000 lines
adequate302 of 5120 commits in the last 24 months changed over 2,000 lines of code, not counting reformatting, renames, vendored or generated code. A change that size is rarely reviewed line by line. Ask how they were reviewed, and what made them that large.
| 302 commits over 2,000 lines |
Product & Engineering Maturity
strongNo finding.
Security & Reliability Posture
adequate1 credential-shaped string in the tree sit in tests, examples, documentation or local development settings
adequateStrings shaped like credentials appear only where fakes are usual: test fixtures, examples, documentation, placeholders and local stacks. They are almost always fakes. Ask someone to confirm that none of them works anywhere, because a real key in a development file is still a real key. 5 other matchs set aside: expired tokens, licence tokens a vendor verifies with a public key, or placeholder text where a key would go. None grants access to anything.
| JWT, where fakes are usual |
2 Dockerfiles run the application as root
adequateNo USER instruction switches away from root, so the process runs with full privileges inside the container. It is a one-line fix and an ordinary expectation, which is why its absence is worth asking about: it usually says more about whether anyone has reviewed the deployment than about this container specifically.
Dockerfile — runs as root |
evals/harbor/environments/Dockerfile — runs as root |
2 SQL statements built from strings
adequate2 places in product code build SQL by formatting or joining strings rather than passing parameters. In each, what the code shows going in is a table or column name, a constant, or something the line does not show, not a request's value. Ask whether any value reaches these strings, rather than a parameter.
src/phoenix/db/helpers.py:1281 — SQL built from a string |
src/phoenix/db/helpers.py:1289 — SQL built from a string |
11 locked dependencies have published vulnerabilities, 1 high or critical in what ships
adequate11 of 2,319 locked dependencies match 23 published advisories in OSV, 6 of them rated high or critical. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version.
js/pnpm-lock.yaml — tinypool 2.1.0: GHSA-5gmw-xhrv-c9v3 (critical), fixed in 2.1.1; a development dependency |
js/pnpm-lock.yaml — @faker-js/faker 8.4.1: GHSA-qxc2-j82w-r537 (high), fixed in 10.5.0 |
uv.lock — datamodel-code-generator 0.72.2: GHSA-77xj-x4rm-935c (high), fixed in 0.81.0; a development dependency |
The licence is Elastic-2.0: source available, not open source
adequateLICENSE grants Elastic-2.0: source available, not open source; offering it as a managed service is not allowed. The reading comes from the licence's own title and clauses. Whether the terms fit the buyer's intended use, and whether any paid licence transfers with the code, is a question for counsel and the licensor.
LICENSE:1 — 44 lines, Elastic-2.0 |
Observability & Operations
adequateNo structured logging library is in use
adequateNothing references a structured logging library. Logs that are written to be read by a person are not searchable by a machine, which means incident response here is proportional to how well someone remembers the codebase rather than to what the tooling can find.
| searched 7,117 files for 10 structured logging libraries; 0 matched |
2 of 4 deployments run a single replica
adequate2 deployments set `replicas: 1`, and nothing (an autoscaler, a disruption budget) adds more. Every deploy and every node drain is downtime, and the availability the buyer inherits has a ceiling.
kustomize/base/phoenix.yaml — replicas: 1 |
kustomize/base/postgres.yaml — replicas: 1 |
Fit with the Acquirer
not assessableNot rated: structurally not assessable from a repository.
Read more, or read your own
The full report on arize-ai/phoenix: every dimension, the questions for the room, and the audit log.
Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.