Read 2026-10-23
tabbyml/tabby: technical due diligence, read from its repository
What Borehole read in tabbyml/tabby's code and history at 21b2904: its licence, security advisories, releases, review practice, tests, dependencies and operations. Every finding cites the file and line it rests on. The full report also covers the team and asks the questions the code cannot answer.
| Dimension | Rating |
|---|---|
| Architecture & Codebase — including AI provenance | strong |
| Engineering Process & SDLC Maturity | adequate |
| Product & Engineering Maturity | adequate |
| Security & Reliability Posture | adequate |
| Observability & Operations | not assessable |
| Fit with the Acquirer | not assessable |
What the repository says
- Releases are cut from another branch than the one surveyed
ee/LICENSE: Part of the code is under a separate licence: ee/.gitmodules:1: 1 submodule(s) this survey does not read: crates/llama-cpp-server/llama.cpp
Architecture & Codebase — including AI provenance
strongee/tabby-webserver/src/service/auth.rs is 2,067 lines, 29× this codebase's median file
adequateThe median source file here is 69 lines. 3 files exceed 1,000 lines, the largest being 2,067. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.
ee/tabby-webserver/src/service/auth.rs:1 — 2,067 lines (29× median) |
ee/tabby-schema/src/schema/mod.rs:1 — 1,974 lines (28× median) |
ee/tabby-webserver/src/service/page.rs:1 — 1,198 lines (17× median) |
135 errors caught and discarded in product code
adequate135 places catch an error and do nothing with it, across 45 files (0.8 per thousand lines). Each is a failure the system will not report. They surface later as problems nobody can explain, and they are cheap to fix now.
ee/tabby-ui/app/(dashboard)/settings/(integrations)/providers/[kind]/detail/components/provider-detail.tsx:328 — error caught and discarded |
ee/tabby-ui/app/files/components/code-editor-view.tsx:248 — error caught and discarded |
ee/tabby-ui/app/files/lib/search-match-extension/index.ts:39 — error caught and discarded |
A move from JavaScript to TypeScript began 39 months ago and is 77% done
adequate522 product files are in the new language and 159 are still in the old one, 39 months after the first new file appeared. The new language's share of the lines rose from 68% to 98%, and moved 0 percentage points in the last year. Two languages for one job doubles what an engineer has to know, and the unmoved half is usually what nobody wants to touch. Ask whether finishing it is planned, and what it costs.
| 159 old, 522 new |
Engineering Process & SDLC Maturity
adequateTests cover a thin slice of the codebase
adequate116 test files against 1,385 source files (8.4%). This does not measure whether the tests are good, only whether enough of them exist for the codebase to be changed safely by someone who did not write it — which is exactly the situation after an acquisition.
| 116 test files / 1,385 source files |
Product & Engineering Maturity
adequate118 direct dependencies in a single manifest
adequateee/tabby-ui/package.json declares 118 direct dependencies. Each one is a maintenance obligation, a supply-chain surface and a potential licence question that transfers with the asset. The count says nothing about whether any given dependency was a good choice; it says how many such choices a buyer inherits.
ee/tabby-ui/package.json — 118 declared |
website/package.json — 17 declared |
clients/tabby-chat-panel/package.json — 3 declared |
experimental/prompt-rewrite-eval/requirements.txt — 3 declared |
2% of bug fixes add or change a test
adequateOf 407 fixes in the last 24 months, 8 touched a test. A fix without the test that would have caught the bug can quietly come back, and the suite never learns from what went wrong.
| 8 of 407 |
Releases are cut from another branch than the one surveyed
adequateThe newest release, v4.3.1, is not on the branch this survey read; the newest release on it is v0.8.0. The shipped product may differ from what this report describes. Survey the release branch too.
| tag v4.3.1 |
Security & Reliability Posture
adequate2 credential-shaped strings in the tree sit in tests, examples, documentation or local development settings
adequateStrings shaped like credentials appear only where fakes are usual: test fixtures, examples, documentation, placeholders and local stacks. They are almost always fakes. Ask someone to confirm that none of them works anywhere, because a real key in a development file is still a real key. 1 other match set aside: expired tokens, licence tokens a vendor verifies with a public key, or placeholder text where a key would go. None grants access to anything.
| 2 cited: JWT, where fakes are usual |
None of the standard security guard rails are configured
adequateThere is no disclosure policy, no automated dependency updates, no named code owners and no pre-commit configuration. None of these is load-bearing on its own. Their collective absence says that security posture here is whatever the current team happens to remember to do, which is not a posture that survives the team changing.
| checked 5 kinds of guard rail across 2,099 tracked files; 0 present |
1 environment file is committed
adequate.env is tracked in git. Environment files are where credentials usually live, and committing one usually means nobody decided how secrets reach the running application. Whatever is in it is in the history for good. Check 05.1 says whether it holds anything credential-shaped.
.env — committed environment file |
The build runs third-party code it does not pin
adequate22 third-party CI actions are referenced by a tag or branch rather than a commit, so they run whatever that tag points to on the day. Tags have been moved to malicious commits in real supply-chain attacks, and a piped script is whatever the server returns that minute. Pinning to a commit is the fix, and it is small.
.github/workflows/ast-grep-lint.yml:13 — action pinned by tag |
.github/workflows/autofix-pnpm.yml:32 — action pinned by tag |
2 outbound calls can wait forever
adequate2 HTTP calls use a client with no timeout (Python `requests` without `timeout=`, or Go's default client). When a dependency slows down, each one holds a worker until the connection gives up, and enough of them take the service down with the dependency.
experimental/prompt-rewrite-eval/evaluator.py:25 — outbound call without a timeout |
experimental/prompt-rewrite-eval/evaluator.py:175 — outbound call without a timeout |
120 locked dependencies have published vulnerabilities, 13 high or critical in what ships
adequate120 of 3,967 locked dependencies match 217 published advisories in OSV, 108 of them rated high or critical. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version. This lockfile pins development tools alongside what ships and does not say which is which, so some of these may never reach a user.
pnpm-lock.yaml — next 13.5.3: GHSA-2464-fhr4-w9xw (critical), fixed in 15.5.28 |
Cargo.lock — lettre 0.11.7: GHSA-4pj9-g833-qx53 (critical), fixed in 0.11.22 |
pnpm-lock.yaml — koa 2.15.3: GHSA-593f-38f6-jp5m (critical), fixed in 2.15.4; a development dependency |
15 places insert HTML from a variable without sanitising it
adequate15 places set HTML from a value that is neither a literal nor passed through a sanitiser. Where the value can come from a user, that is stored cross-site scripting, and it is the first thing a buyer's security review looks for in a frontend.
clients/eclipse/plugin/chat-panel/index.html:80 — HTML from a variable |
ee/tabby-webserver/ui/_next/static/chunks/21c8b353-925bb40fc9c4670c.js:9 — HTML from a variable |
ee/tabby-webserver/ui/_next/static/chunks/2928-98ebfedf06caf8e1.js:1 — HTML from a variable |
Part of the code is under a separate licence: ee/
adequateA directory named for a paid edition carries its own licence. That code is usually not open source even where the rest is; what the buyer may do with each part differs.
ee/LICENSE — licence: unrecognised |
Observability & Operations
not assessableNo error reporter is wired in
adequateNothing in the service initialises an error reporter (Sentry, Rollbar, Bugsnag, Honeybadger or an APM agent). An exception in production reaches a person only if someone is reading the logs, which usually means a customer reports it first.
| no error reporter initialised |
Fit with the Acquirer
not assessableNot rated: structurally not assessable from a repository.
Read more, or read your own
The full report on tabbyml/tabby: every dimension, the questions for the room, and the audit log.
Survey a repository: free on public repositories. Private code is read on your own machine by a collector whose source you can read first.