Read 2026-10-23
comet-ml/opik: technical due diligence, read from its repository
What Borehole read in comet-ml/opik's code and history at 2e08c8d: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.
| Dimension | Rating |
|---|---|
| Architecture & Codebase — including AI provenance | strong |
| Engineering Process & SDLC Maturity | adequate |
| Product & Engineering Maturity | adequate |
| Security & Reliability Posture | adequate |
| Observability & Operations | adequate |
| Fit with the Acquirer | not assessable |
What the repository says
CONTRIBUTING.md:111: states a policy on AI-generated contributions
Architecture & Codebase — including AI provenance
strongapps/opik-backend/src/main/java/com/comet/opik/domain/TraceDAO.java is 5,697 lines, 113× this codebase's median file
adequateThe median source file here is 50 lines. 70 files exceed 1,000 lines, the largest being 5,697. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.
apps/opik-backend/src/main/java/com/comet/opik/domain/TraceDAO.java:1 — 5,697 lines (113× median) |
apps/opik-backend/src/main/java/com/comet/opik/domain/DatasetItemVersionDAO.java:1 — 4,899 lines (97× median) |
sdks/python/src/opik/rest_api/datasets/raw_client.py:1 — 4,524 lines (90× median) |
sdks/python/src/opik/rest_api/traces/raw_client.py:1 — 4,521 lines (90× median) |
apps/opik-backend/src/main/java/com/comet/opik/domain/SpanDAO.java:1 — 3,761 lines (75× median) |
Engineering Process & SDLC Maturity
adequateTests are retried until they pass
adequateThe suite is configured to retry failing tests (.github/workflows/python_backend_e2e_tests.yml). A retry turns a flaky test green without saying why it failed, so a green build means the tests passed eventually. Ask how many retries a typical run needs, and which tests need them.
.github/workflows/python_backend_e2e_tests.yml:122 — test retry |
5% of recent commits change more than 2,000 lines
adequate299 of 5704 commits in the last 24 months changed over 2,000 lines of code, not counting reformatting, renames, vendored or generated code. A change that size is rarely reviewed line by line. Ask how they were reviewed, and what made them that large.
| 299 commits over 2,000 lines |
Product & Engineering Maturity
adequate103 direct dependencies in a single manifest
adequateapps/opik-frontend/package.json declares 103 direct dependencies. Each one is a maintenance obligation, a supply-chain surface and a potential licence question that transfers with the asset. The count says nothing about whether any given dependency was a good choice; it says how many such choices a buyer inherits.
apps/opik-frontend/package.json — 103 declared |
apps/opik-sandbox-executor-python/requirements.txt — 65 declared |
apps/opik-python-backend/requirements.txt — 34 declared |
sdks/typescript/package.json — 26 declared |
Node.js 20 is past end of life
adequateThe code is pinned to Node.js 20 (end of life 2026-04-30). None of these receives security fixes any more; the first stopped on 2026-04-30. Moving off an unsupported runtime is rarely a one-line change, so a buyer should ask whether the upgrade is planned and what it touches.
apps/opik-frontend/Dockerfile — Node.js 20, end of life 2026-04-30 |
Security & Reliability Posture
adequate1 Dockerfile runs the application as root
adequateNo USER instruction switches away from root, so the process runs with full privileges inside the container. It is a one-line fix and an ordinary expectation, which is why its absence is worth asking about: it usually says more about whether anyone has reviewed the deployment than about this container specifically.
apps/opik-python-backend/Dockerfile — runs as root |
2 environment files are committed
adequateapps/opik-frontend/.env.comet, apps/opik-frontend/.env.production are tracked in git. Environment files are where credentials usually live, and committing one usually means nobody decided how secrets reach the running application. Whatever is in it is in the history for good. Check 05.1 says whether it holds anything credential-shaped.
apps/opik-frontend/.env.comet — committed environment file |
apps/opik-frontend/.env.production — committed environment file |
The build runs third-party code it does not pin
adequate25 third-party CI actions are referenced by a tag or branch rather than a commit, so they run whatever that tag points to on the day. Tags have been moved to malicious commits in real supply-chain attacks, and a piped script is whatever the server returns that minute. Pinning to a commit is the fix, and it is small.
.github/workflows/backend_tests.yml:92 — action pinned by tag |
.github/workflows/build_and_publish_sdk.yaml:137 — action pinned by tag |
59 locked dependencies have published vulnerabilities, 31 high or critical in what ships
adequate59 of 1,281 locked dependencies match 153 published advisories in OSV, 71 of them rated high or critical. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version.
apps/opik-frontend/package-lock.json — protobufjs 7.5.4: GHSA-xq3m-2v4x-88gg (critical), fixed in 7.5.5 |
sdks/typescript/src/opik/configure/pnpm-lock.yaml — axios 1.13.4: GHSA-35jp-ww65-95wh (high), fixed in 1.16.0 |
sdks/typescript/src/opik/configure/pnpm-lock.yaml — form-data 4.0.5: GHSA-hmw2-7cc7-3qxx (high), fixed in 4.0.6 |
1 workload setting give a container the host
adequate1 places in the deployment configuration run a container privileged or in the host's network, process or IPC namespace. A compromise of that container is a compromise of the machine, and most acquirers' security reviews block it. Node agents (network, storage, monitoring) are excluded.
deployment/helm_chart/opik/values.yaml:429 — privileged or host namespace |
9 places insert HTML from a variable without sanitising it
adequate9 places set HTML from a value that is neither a literal nor passed through a sanitiser. Where the value can come from a user, that is stored cross-site scripting, and it is the first thing a buyer's security review looks for in a frontend.
apps/opik-frontend/src/lib/charts/vega.ts:458 — HTML from a variable |
apps/opik-frontend/src/shared/InteractiveMermaidDiagram/InteractiveMermaidDiagram.tsx:99 — HTML from a variable |
apps/opik-frontend/src/shared/MermaidDiagram/MermaidDiagram.tsx:19 — HTML from a variable |
The production build publishes source maps
adequateThe build configuration emits source maps for production, so the original source, with its comments and structure, is downloadable by every visitor. Upload them to an error tracker and keep them off the public server instead.
apps/opik-frontend/vite.config.ts:57 — source maps in a production build |
Observability & Operations
adequateNo structured logging library is in use
adequateNothing references a structured logging library. Logs that are written to be read by a person are not searchable by a machine, which means incident response here is proportional to how well someone remembers the codebase rather than to what the tooling can find.
| searched 11,500 files for 10 structured logging libraries; 0 matched |
Sends usage data to stats.comet.com by default
adequateapps/opik-backend/config.yml sends to stats.comet.com, and apps/opik-backend/config.yml leaves reporting on as shipped. Every installation reports to the vendor unless its operator turns this off. For a buyer running it inside their own product, that is an outbound data flow to a third party: ask what is sent, how often, and whether the buyer's customers were told.
apps/opik-backend/config.yml:1008 — reports to stats.comet.com |
apps/opik-backend/config.yml:1007 — the reporting setting is on by default |
Readiness and liveness probes are identical in 2 of 2 workloads
adequateBoth probes call the same endpoint. When a dependency slows down, the liveness probe fails with the readiness probe, so the platform restarts pods that only needed taking out of rotation, and a partial outage becomes a full one. Liveness should ask whether the process is alive; readiness whether it can serve.
deployment/helm_chart/opik/values.yaml — same probe endpoint twice |
Fit with the Acquirer
not assessableNot rated: structurally not assessable from a repository.
Read more, or read your own
The full report on comet-ml/opik: every dimension, the questions for the room, and the audit log.
Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.