Borehole · Project · free tier
arize-ai/phoenix
Free reading: not for reliance
ca11e23 · 10,450 commits · 8,518 files
Read 2026-10-28

arize-ai/phoenix: technical due diligence, read from its repository

What Borehole read in arize-ai/phoenix's code and history at ca11e23: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.

DimensionRating
Architecture & Codebase — including AI provenancestrong
Engineering Process & SDLC Maturityadequate
Product & Engineering Maturitystrong
Security & Reliability Postureadequate
Observability & Operationsadequate
Fit with the Acquirernot assessable

What the repository says

  • LICENSE:1: The licence is Elastic-2.0: source available, not open source

Architecture & Codebase — including AI provenance

strong
01.6

js/app/src/api/__generated__/v1.ts is 14,032 lines, 138× this codebase's median file

adequate

The median source file here is 101 lines. 73 files exceed 1,010 lines, the largest being 14,032. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.

Engineering Process & SDLC Maturity

adequate
02.16

Tests are retried until they pass

adequate

The suite is configured to retry failing tests (.github/workflows/python-CI.yml). A retry turns a flaky test green without saying why it failed, so a green build means the tests passed eventually. Ask how many retries a typical run needs, and which tests need them.

Evidence
.github/workflows/python-CI.yml:787 — test retry
02.24

6% of recent commits change more than 2,000 lines

adequate

302 of 5120 commits in the last 24 months changed over 2,000 lines of code, not counting reformatting, renames, vendored or generated code. A change that size is rarely reviewed line by line. Ask how they were reviewed, and what made them that large.

Evidence
302 commits over 2,000 lines

Product & Engineering Maturity

strong

No finding.

Security & Reliability Posture

adequate
05.1

1 credential-shaped string in the tree sit in tests, examples, documentation or local development settings

adequate

Strings shaped like credentials appear only where fakes are usual: test fixtures, examples, documentation, placeholders and local stacks. They are almost always fakes. Ask someone to confirm that none of them works anywhere, because a real key in a development file is still a real key. 5 other matchs set aside: expired tokens, licence tokens a vendor verifies with a public key, or placeholder text where a key would go. None grants access to anything.

Evidence
JWT, where fakes are usual
05.6

2 Dockerfiles run the application as root

adequate

No USER instruction switches away from root, so the process runs with full privileges inside the container. It is a one-line fix and an ordinary expectation, which is why its absence is worth asking about: it usually says more about whether anyone has reviewed the deployment than about this container specifically.

Evidence
Dockerfile — runs as root
evals/harbor/environments/Dockerfile — runs as root
05.20

2 SQL statements built from strings

adequate

2 places in product code build SQL by formatting or joining strings rather than passing parameters. In each, what the code shows going in is a table or column name, a constant, or something the line does not show, not a request's value. Ask whether any value reaches these strings, rather than a parameter.

Evidence
src/phoenix/db/helpers.py:1281 — SQL built from a string
src/phoenix/db/helpers.py:1289 — SQL built from a string
05.26

11 locked dependencies have published vulnerabilities, 1 high or critical in what ships

adequate

11 of 2,319 locked dependencies match 23 published advisories in OSV, 6 of them rated high or critical. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version.

Evidence
js/pnpm-lock.yaml — tinypool 2.1.0: GHSA-5gmw-xhrv-c9v3 (critical), fixed in 2.1.1; a development dependency
js/pnpm-lock.yaml — @faker-js/faker 8.4.1: GHSA-qxc2-j82w-r537 (high), fixed in 10.5.0
uv.lock — datamodel-code-generator 0.72.2: GHSA-77xj-x4rm-935c (high), fixed in 0.81.0; a development dependency
05.66

The licence is Elastic-2.0: source available, not open source

adequate

LICENSE grants Elastic-2.0: source available, not open source; offering it as a managed service is not allowed. The reading comes from the licence's own title and clauses. Whether the terms fit the buyer's intended use, and whether any paid licence transfers with the code, is a question for counsel and the licensor.

Evidence
LICENSE:1 — 44 lines, Elastic-2.0

Observability & Operations

adequate
06.2

No structured logging library is in use

adequate

Nothing references a structured logging library. Logs that are written to be read by a person are not searchable by a machine, which means incident response here is proportional to how well someone remembers the codebase rather than to what the tooling can find.

Evidence
searched 7,117 files for 10 structured logging libraries; 0 matched
06.33

2 of 4 deployments run a single replica

adequate

2 deployments set `replicas: 1`, and nothing (an autoscaler, a disruption budget) adds more. Every deploy and every node drain is downtime, and the availability the buyer inherits has a ceiling.

Evidence
kustomize/base/phoenix.yaml — replicas: 1
kustomize/base/postgres.yaml — replicas: 1

Fit with the Acquirer

not assessable

Not rated: structurally not assessable from a repository.

Read more, or read your own

The full report on arize-ai/phoenix: every dimension, the questions for the room, and the audit log.

Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.