{"band":"adequate","note":"Deterministic layer only. No model calls were made and no source content left this machine.","layer":"deterministic","coverage":{"statement":"A repository answers roughly three and a half of seven dimensions. The rest are reported as not assessable, with the questions a human would ask instead.","languages_read":["1C Enterprise","4D","ABAP","ABAP CDS","AGS Script","AIDL","AL","ALGOL","AMPL","ANTLR","APL","ASL","ASP.NET","ATS","ActionScript","Ada","Agda","Aiken","Aleo","Alloy","AngelScript","Answer Set Programming","Apex","Apollo Guidance Computer","AppleScript","Arc","ArkTS","AspectJ","Assembly","Augeas","AutoHotkey","AutoIt","Awk","B (Formal Method)","B4X","BAML","BQN","Ballerina","Batchfile","Beef","Befunge","Bend","Berry","Bicep","Bison","BitBake","BlitzBasic","BlitzMax","Bluespec","Boo","Boogie","Brightscript","C","C#","C++","C2hs Haskell","C3","CAP CDS","CLIPS","CMake","COBOL","CQL","CWeb","Cadence","Cairo","CameLIGO","Cangjie","Cap'n Proto","Carbon","CartoCSS","Ceylon","Chapel","Charity","ChucK","Circom","Cirru","Clarion","Clarity","Classic ASP","Clean","Click","Clojure","Clue","CodeQL","CoffeeScript","ColdFusion","ColdFusion CFC","Common Lisp","Common Workflow Language","Component Pascal","Crystal","Csound","Csound Document","Csound Score","Cuda","Curry","Cycript","Cypher","Cython","D","DIGITAL Command Language","DM","Dafny","Dart","Daslang","DataWeave","Dhall","Dockerfile","Dogescript","Dylan","E","ECL","EQ","EdgeQL","Elixir","Elm","Elvish","Emacs Lisp","EmberScript","Erlang","F#","F*","FIRRTL","FLUX","FPP","Factor","Fancy","Fantom","Fennel","Filebench WML","Flix","Fluent","Forth","Fortran","Fortran Free Form","FreeBASIC","FreeMarker","Futhark","G-code","GAML","GAMS","GAP","GDB","GDScript","GDShader","GLSL","GSC","Genero 4gl","Genshi","Gentoo Ebuild","Gentoo Eclass","Gherkin","Gleam","Glimmer JS","Glimmer TS","Glyph","Gno","Gnuplot","Go","Golo","Gosu","Grace","Grammatical Framework","Groovy","Groovy Server Pages","HCL","HIP","HLSL","Hack","Harbour","Hare","Haskell","Haxe","HiveQL","HolyC","Hurl","Hy","IDL","IGOR Pro","IL Assembly","ISPC","Idris","ImHex Pattern Language","ImageJ Macro","Imba","Inform 7","Ink","Inno Setup","Io","Ioke","Isabelle","J","JASS","JCL","JFlex","JSONiq","Jac","Jai","Janet","Java","Java Server Pages","Java Template Engine","JavaScript","JavaScript+ERB","JetBrains MPS","Jison","Jison Lex","Jolie","Jsonnet","Julia","Just","KCL","KRL","Kaitai Struct","KakouneScript","Koka","Kotlin","LFE","LLVM","LLVM TableGen","LOLCODE","LSL","LabVIEW","Langium","Lasso","Lean","Leo","Lex","LigoLANG","LilyPond","Linker Script","Liquidsoap","Literate Agda","Literate CoffeeScript","Literate Haskell","LiveCode Script","LiveScript","Lobster","Logos","Logtalk","LookML","Lua","Luau","M","M4","MATLAB","MAXScript","MLIR","MQL4","MQL5","MUF","Macaulay2","Makefile","Mako","Max","MeTTa","Mercury","Metal","MiniD","MiniZinc","Mint","Mirah","Modelica","Modula-3","Module Management System","Mojo","Monkey","MoonBit","MoonScript","Motorola 68K Assembly","Move","Myghty","NASL","NSIS","NWScript","Nearley","NetLinx","NetLinx+ERB","NetLogo","Nextflow","Nim","Nit","Nix","Nu","NumPy","OCaml","OMNeT++ NED","Oberon","Objective-C","Objective-C++","Objective-J","Odin","Omgrofl","Opa","Opal","Open Policy Agent","OpenCL","OpenQASM","OpenSCAD","OverPy","OverpassQL","Ox","Oxygene","Oz","P4","PDDL","PEG.js","PHP","PLSQL","PLpgSQL","POV-Ray SDL","Pact","Pan","Papyrus","Parrot","Parrot Assembly","Parrot Internal Representation","Pascal","Pawn","Pep8","Perl","PigLatin","Pike","PogoScript","Polar","Pony","Portugol","Power Query","PowerBuilder","PowerShell","Praat","Processing","Prolog","Promela","Propeller Spin","Puppet","PureBasic","PureScript","Pyret","Python","Q#","QML","QMake","QuakeC","Quint","R","RAScript","REALbasic","REXX","RPGLE","Racket","Ragel","Raku","Rascal","ReScript","Reason","ReasonLIGO","Rebol","Red","Redcode","RenderScript","Rhai","Ring","RobotFramework","Roc","Rocq Prover","Rouge","Ruby","Rust","SAS","SMT","SQF","SQL","SQLPL","SWIG","Sage","Sail","Salt","Scala","Scenic","Scheme","Scilab","Self","Shell","ShellSession","Shen","Sieve","Slang","Slash","SmPL","Smali","Smithy","Snakemake","Solidity","SourcePawn","Squirrel","Stan","Standard ML","Starlark","Stata","SurrealQL","Swift","SystemVerilog","TI Program","TL-Verilog","TLA","TSX","TXL","Tact","Talon","Tape","Tcl","Tcsh","Thrift","Toit","Tolk","Turing","TypeScript","Unified Parallel C","Uno","UnrealScript","Untyped Plutus Core","UrWeb","VBA","VBScript","VCL","VHDL","Vala","Verilog","Verse","Vim script","Visual Basic .NET","Visual Basic 6.0","Volt","Vyper","WDL","WGSL","WebAssembly","WebIDL","Whiley","Witcher Script","Wolfram Language","Wollok","Wren","X10","XC","XProc","XQuery","XS","XSLT","Xojo","Xonsh","Xtend","YARA","Yacc","Yul","ZAP","ZIL","Zeek","ZenScript","Zephir","Zig","Zimpl","eC","fish","hoon","mIRC Script","mcfunction","mupad","nesC","ooc","sed","wisp","xBase"],"total_dimensions":7,"assessable_dimensions":6},"dimensions":[{"id":"01","band":"adequate","name":"Architecture & Codebase — including AI provenance","coverage":"full","findings":[{"id":"01.6","band":"adequate","layer":"deterministic","title":"crates/ty_python_semantic/src/types/infer/builder.rs is 13,223 lines, 264× this codebase's median file","signal":"oversized_modules","weight":"corroborating","context":true,"evidence":[{"ref":"line-count","kind":"path","path":"crates/ty_python_semantic/src/types/infer/builder.rs","detail":"13,223 lines (264× median)","line_end":13223,"line_start":1},{"ref":"line-count","kind":"path","path":"crates/ty_python_semantic/src/types.rs","detail":"12,373 lines (247× median)","line_end":12373,"line_start":1},{"ref":"line-count","kind":"path","path":"crates/ty_ide/src/completion.rs","detail":"11,796 lines (235× median)","line_end":11796,"line_start":1},{"ref":"line-count","kind":"path","path":"crates/ty_python_semantic/src/types/call/bind.rs","detail":"10,381 lines (207× median)","line_end":10381,"line_start":1},{"ref":"line-count","kind":"path","path":"crates/ty_ide/src/inlay_hints.rs","detail":"7,906 lines (158× median)","line_end":7906,"line_start":1}],"observed":{"largest":13223,"library":{"n":382,"share":94,"value":264.5,"cutoff":138.63,"material":true,"percentile":85},"threshold":1000,"files_over":173,"median_lines":50},"standing":"Measured against its own codebase's median, it is larger than 94% of 382 surveyed projects' largest files.","dimension":"01","rationale":"The median source file here is 50 lines. 173 files exceed 1,000 lines, the largest being 13,223. Size is not a defect on its own — some problems genuinely live in one place — but these are where merge conflicts, review fatigue and single-owner knowledge concentrate, and they are the first thing that slows an inheriting engineer down.","context_why":"A note that does not affect this rating: notes like it are common in well-run projects."},{"id":"01.25","band":"adequate","layer":"deterministic","title":"1 base image floats: no version, or `latest`","signal":"build_reproducibility","weight":"corroborating","evidence":[{"ref":"Dockerfile","kind":"path","path":"Dockerfile","detail":"base image without a version","line_end":1,"line_start":1}],"observed":{"floating":1,"from_lines":2},"dimension":"01","rationale":"1 of 2 `FROM` lines in product Dockerfiles name an image without a version, or with `latest`. Each build pulls whatever the registry serves that day, so the image that ships can change without a commit, and last month's build cannot be reproduced. Pin a version, or a digest."}],"signals_run":11,"conclusive_signals":10,"what_a_person_adds":[{"id":"01.38","kind":"H+","where":"The team","measured":"No architecture or design document is in the tree, across 7,128 product files.","question":"Where does the design live, and who holds it?"},{"id":"01.39","kind":"H","where":"Your architects, with the product roadmap","question":"Is the architecture right for the next three years of the product?"},{"id":"01.40","kind":"H","where":"The team's reasoning at the time","question":"Were the home-grown components reasonable choices when they were made, and are they now?"}]},{"id":"02","band":"adequate","name":"Engineering Process & SDLC Maturity","coverage":"high","findings":[{"id":"02.17","band":"adequate","layer":"deterministic","title":"CI runs tests that cannot fail the build","signal":"ci_test_gating","weight":"corroborating","evidence":[{"ref":".github/workflows/ci.yaml","kind":"path","path":".github/workflows/ci.yaml","detail":"a test command that cannot fail","line_end":417,"line_start":417}],"observed":{"soft_test_runs":1},"dimension":"02","rationale":"1 test command in CI ends in `|| true` or an equivalent, so the pipeline passes whatever the tests say. A green build then means the tests ran, not that they passed."}],"signals_run":16,"conclusive_signals":15,"what_a_person_adds":[{"id":"02.32","kind":"H","where":"The code host's pull request data","question":"Is review real or a rubber stamp? Comment depth and time to approve need the pull request history."},{"id":"02.38","kind":"H","where":"The issue tracker: backlog, sprint history, estimate accuracy","question":"Is delivery planned and measured, or heroic?"},{"id":"02.37","kind":"H","where":"Tickets, chat and postmortems","question":"How are incidents run, reviewed and learned from?"}]},{"id":"03","band":"strong","name":"Organization & Key-Person Risk","coverage":"partial","findings":[],"signals_run":10,"conclusive_signals":10,"what_a_person_adds":[{"id":"03.29","kind":"H+","where":"The deal terms","measured":"One contributor authored a quarter or more of the commits in this history.","question":"Is that person part of the transaction, and for how long after it?"},{"id":"03.28","kind":"H","where":"The team; review history only suggests candidates","question":"Who mentors whom, and would that survive a departure?"},{"id":"03.30","kind":"H","where":"Recruiting data and the org chart","question":"Can the team grow, and who stands behind the top three contributors?"},{"id":"03.31","kind":"H","where":"HR data","question":"Is the seniority mix sound, and will pay survive your salary bands?"},{"id":"03.14","kind":"H","where":"Interviews and on-call history","question":"Is the pace sustainable? Commit times cannot say: git keeps no reliable local time."},{"id":"03.32","kind":"H","where":"Interviews","question":"Does the team want to stay after close?"},{"id":"03.33","kind":"H","where":"Time with the team","question":"How are decisions made and disagreements resolved?"}]},{"id":"04","band":"strong","name":"Product & Engineering Maturity","coverage":"minimal","findings":[{"id":"04.38","band":"adequate","layer":"deterministic","title":"5 files still carry code deprecated more than two years ago","signal":"deprecations_lingering","weight":"corroborating","context":true,"evidence":[{"ref":"crates/ruff_python_stdlib/src/builtins.rs","kind":"path","path":"crates/ruff_python_stdlib/src/builtins.rs","detail":"deprecated since Jul 2023"},{"ref":"crates/ruff_workspace/src/options.rs","kind":"path","path":"crates/ruff_workspace/src/options.rs","detail":"deprecated since Oct 2023"},{"ref":"crates/ruff_linter/src/rules/numpy/rules/numpy_2_0_deprecation.rs","kind":"path","path":"crates/ruff_linter/src/rules/numpy/rules/numpy_2_0_deprecation.rs","detail":"deprecated since Nov 2023"},{"ref":"crates/ruff_linter/src/rules/pycodestyle/rules/type_comparison.rs","kind":"path","path":"crates/ruff_linter/src/rules/pycodestyle/rules/type_comparison.rs","detail":"deprecated since Nov 2023"},{"ref":"crates/ruff_linter/src/rules/pylint/rules/invalid_index_return.rs","kind":"path","path":"crates/ruff_linter/src/rules/pylint/rules/invalid_index_return.rs","detail":"deprecated since Apr 2024"}],"observed":{"older_than_two_years":5,"files_with_deprecations":39},"dimension":"04","rationale":"5 files were marked deprecated over two years ago and still are, the oldest since Jul 2023. A deprecation is a promise to remove. Ask what still depends on these, and whether removing them is scheduled.","context_why":"A note that does not affect this rating: in Borehole's calibration, this check's notes were usually true but overstated."}],"signals_run":19,"conclusive_signals":13,"what_a_person_adds":[{"id":"04.32","kind":"H","where":"The data room and the team's record of estimates","question":"Can this team deliver the stated roadmap on the stated timeline?"},{"id":"04.31","kind":"H","where":"Budget and roadmap decisions","question":"Does leadership know about the debt, and is time budgeted to repay it?"},{"id":"04.33","kind":"H","where":"Revenue, customer and churn data","question":"Is the engineering shape consistent with the commercial story?"}]},{"id":"05","band":"adequate","name":"Security & Reliability Posture","coverage":"partial","findings":[{"id":"05.6","band":"adequate","layer":"deterministic","title":"1 Dockerfile runs the application as root","signal":"container_runs_as_root","weight":"corroborating","evidence":[{"ref":"no-USER-instruction","kind":"path","path":"Dockerfile","detail":"runs as root"}],"observed":{"rootful":1,"dockerfiles":1},"dimension":"05","rationale":"No USER instruction switches away from root, so the process runs with full privileges inside the container. It is a one-line fix and an ordinary expectation, which is why its absence is worth asking about: it usually says more about whether anyone has reviewed the deployment than about this container specifically."},{"id":"05.27","band":"adequate","layer":"deterministic","title":"The build runs third-party code it does not pin","signal":"supply_chain_pinning","weight":"corroborating","context":true,"evidence":[{"ref":"Dockerfile","kind":"path","path":"Dockerfile","detail":"download piped into a shell","line_end":21,"line_start":21}],"observed":{"action_refs":209,"pipe_to_shell":1,"unpinned_third_party":0},"dimension":"05","rationale":"1 step pipes a download straight into a shell. Tags have been moved to malicious commits in real supply-chain attacks, and a piped script is whatever the server returns that minute. Pinning to a commit is the fix, and it is small.","context_why":"A note that does not affect this rating: notes like it are common in well-run projects."},{"id":"05.26","band":"adequate","layer":"deterministic","title":"6 locked dependencies have published vulnerabilities, 4 high or critical","signal":"known_vulnerabilities","weight":"corroborating","context":true,"evidence":[{"ref":"uv.lock","kind":"path","path":"uv.lock","detail":"anyio 4.14.1: GHSA-82r6-8w77-94w6 (critical), fixed in 4.14.2; a development dependency"},{"ref":"uv.lock","kind":"path","path":"uv.lock","detail":"urllib3 2.7.0: GHSA-8988-9cw3-xx77 (high), fixed in 2.8.0; a development dependency"},{"ref":"Cargo.lock","kind":"path","path":"Cargo.lock","detail":"rand 0.8.5: GHSA-cq8v-f236-94qc (low), fixed in 0.8.6"}],"observed":{"advisories":10,"dependencies":787,"high_or_critical":4,"pinned_to_a_commit":0,"ecosystems_not_read":[],"vulnerable_packages":6,"set_aside_not_imported":0,"high_or_critical_shipping":0,"high_or_critical_not_shipped":{"dev":4}},"dimension":"05","rationale":"6 of 787 locked dependencies match 10 published advisories in OSV, 4 of them rated high or critical. A lockfile says which version is installed, not whether the flawed code is reachable from this product, so each needs a look. Most are fixed by an upgrade, and the advisory names the version. None of the high or critical ones is in what the product ships: they are development dependencies. This lockfile pins development tools alongside what ships and does not say which is which, so some of these may never reach a user.","context_why":"A note that does not affect this rating: in Borehole's calibration, this check's notes were usually true but overstated."},{"id":"05.9","band":"adequate","layer":"deterministic","title":"1 vendored component with no licence","signal":"license_vendored_unlicensed","weight":"corroborating","context":true,"evidence":[{"ref":"crates/ruff_db/src/vendored/path.rs","kind":"path","path":"crates/ruff_db/src/vendored/path.rs","detail":"1 tracked files, no licence file"}],"observed":{"unlicensed":["crates/ruff_db/src/vendored/path.rs"],"total_components":2,"stated_in_headers_or_notices":0},"dimension":"05","rationale":"Third-party code is committed into this repository without any statement of the terms it arrived under. Unknown terms are harder to deal with than inconvenient ones: an awkward licence can be complied with, an absent one cannot. Each of these needs its origin established before the code changes hands.","context_why":"A note that does not affect this rating: in Borehole's calibration, this check's notes were usually true but overstated."}],"signals_run":34,"conclusive_signals":24,"what_a_person_adds":[{"id":"05.43","kind":"H+","where":"The security owner","measured":"A threat model is in the tree (agents/references/cli-threat-model.md).","question":"Does it name the assets this code actually handles, and is it current against the deployment?"},{"id":"05.41","kind":"H","where":"Ticketing and chat","question":"What has actually broken, how often, and how badly?"},{"id":"05.42","kind":"H","where":"Reports in the data room","question":"What did external testing find, and was it fixed?"},{"id":"05.44","kind":"H","where":"Audit reports; policy files in the tree are not evidence","question":"What is the SOC 2, ISO 27001 or GDPR status, and where is the evidence?"}]},{"id":"06","band":"adequate","name":"Observability & Operations","coverage":"partial","findings":[{"id":"06.8","band":"adequate","layer":"deterministic","title":"One request cannot be followed through the logs","signal":"correlation_ids","weight":"corroborating","evidence":[{"ref":"request ids","kind":"metric","detail":"no request id, correlation id or tracing found"}],"observed":{"tracing":false,"request_id_sites":0},"dimension":"06","rationale":"Nothing in the service carries a request or correlation id, and there is no tracing. When a customer reports a failure, the log lines that belong to their request cannot be picked out from everyone else's."},{"id":"06.9","band":"adequate","layer":"deterministic","title":"No error reporter is wired in","signal":"error_reporting","weight":"corroborating","context":true,"evidence":[{"ref":"error reporting","kind":"metric","detail":"no error reporter initialised"}],"observed":{"installed":[],"initialised":0,"config_files":0},"dimension":"06","rationale":"Nothing in the service initialises an error reporter (Sentry, Rollbar, Bugsnag, Honeybadger or an APM agent). An exception in production reaches a person only if someone is reading the logs, which usually means a customer reports it first.","context_why":"A note that does not affect this rating: notes like it are common in well-run projects."}],"signals_run":16,"conclusive_signals":8,"what_a_person_adds":[{"id":"06.19","kind":"H+","where":"The operations team","measured":"Nothing in the tree backs up or restores data.","question":"How is data backed up, and has a restore ever been rehearsed?"},{"id":"06.10","kind":"H+","where":"The alerting tool and the on-call rota","measured":"No alert rule is defined in the repository.","question":"Where are alerts defined, who receives them, and when did one last fire?"},{"id":"06.29","kind":"H","where":"Pager history and dashboard logs","question":"Are the dashboards opened, the alerts acknowledged and the pages answered?"},{"id":"06.30","kind":"H","where":"Production metrics","question":"Are the service-level objectives actually met?"},{"id":"06.31","kind":"H","where":"Pager exports and interviews","question":"Who carries the pager, and how often does it go off?"},{"id":"06.32","kind":"H","where":"Cloud billing and capacity plans","question":"What does it cost to run, and how much headroom is there?"}]},{"id":"07","band":"not assessable","name":"Fit with the Acquirer","coverage":"none","findings":[],"signals_run":0,"conclusive_signals":0,"what_a_person_adds":[{"id":"07.1","kind":"H+","question":"This is primarily a Rust codebase, with Python alongside (34% of source files). Does your engineering organisation already run Rust in production, or would this be the first?"},{"id":"07.10","kind":"H+","question":"The bulk of this system sits in crates/, changelogs/, fuzz/. Which of your existing systems would each of those have to absorb or replace?"},{"id":"07.2","kind":"H+","question":"The repository carries deployment configuration (Dockerfile). Does that match your deployment and on-call model, or does it need rehosting first?"},{"id":null,"kind":"H+","question":"What is your tolerance for the findings above remaining unaddressed for the first two quarters after close, given everything else that will compete for this team's time?"},{"id":"07.11","kind":"H","where":"Your architecture","question":"Which of these systems duplicate yours, and which get retired?"},{"id":"07.12","kind":"H","where":"The engagement","question":"What will integration cost, and in what order?"},{"id":"07.13","kind":"H","where":"Your org design","question":"Where does the team land in your organisation, and who reports to whom?"},{"id":"07.14","kind":"H","where":"Deal terms","question":"Are there earn-outs, retention packages or contractor IP to assign?"},{"id":"07.15","kind":"H","where":"Customer contracts","question":"Do customer contracts limit hosting, regions or vendors?"}],"not_assessable_reason":"structurally not assessable from a repository"}],"repository":{"loc":1284076,"head":"7d73e4b6dafbc891563deae9d6eb33bd658055f5","slug":"astral-sh/ruff","tags":431,"stars":49818,"shallow":false,"span_days":1510.0,"last_commit":"2026-09-27T17:02:31+00:00","surveyed_at":null,"commits_read":17399,"first_commit":"2022-08-09T17:19:19+00:00","truncated_at":null,"window_start":"2022-08-09T17:19:19+00:00","tracked_files":11174,"history_complete":true},"generated_at":"2026-10-05T12:14:25.585643+00:00","generated_by":"borehole 0.7.13","rejection_log":[{"reason":"change is spread across the codebase rather than pooling in a few files","signal":"hotspot_concentration","observed":{"files":32891,"top5_share":0.029},"dimension":"04","conclusive":true},{"reason":"debt markers are sparse","signal":"debt_markers","observed":{"markers":1625,"per_kloc":1.27,"lines_read":1278173},"dimension":"04","conclusive":true},{"reason":"direct dependency counts are unremarkable","signal":"dependency_sprawl","observed":{"set_aside":{"playground/ty/package.json":"not product code (example)","playground/api/package.json":"not product code (example)","playground/ruff/package.json":"not product code (example)","playground/shared/package.json":"not product code (example)","scripts/benchmarks/pyproject.toml":"not product code (tooling)","scripts/ty_benchmark/package.json":"not product code (tooling)","scripts/ty_benchmark/pyproject.toml":"not product code (tooling)","crates/ruff_linter/resources/test/fixtures/ruff/pyproject_toml/bleach/pyproject.toml":"not product code (test)","crates/ruff_linter/resources/test/fixtures/ruff/pyproject_toml/maturin/pyproject.toml":"not product code (test)","crates/ruff_linter/resources/test/fixtures/ruff/pyproject_toml/various_invalid/pyproject.toml":"not product code (test)"},"by_manifest":{"python/py-fuzzer/pyproject.toml":5,"python/ruff-ecosystem/pyproject.toml":3,"crates/ty_completion_eval/truth/numpy-array/pyproject.toml":1,"crates/ty_completion_eval/truth/none-completion/pyproject.toml":0,"crates/ty_completion_eval/truth/exact-over-fuzzy/pyproject.toml":0,"crates/ty_completion_eval/truth/fstring-completions/pyproject.toml":0,"crates/ty_completion_eval/truth/tstring-completions/pyproject.toml":0,"crates/ty_completion_eval/truth/class-arg-completion/pyproject.toml":0,"crates/ty_completion_eval/truth/typing-gets-priority/pyproject.toml":0,"crates/ty_completion_eval/truth/local-over-auto-import/pyproject.toml":0,"crates/ty_completion_eval/truth/pass-keyword-completion/pyproject.toml":0,"crates/ty_completion_eval/truth/scope-prioritize-closer/pyproject.toml":0,"crates/ty_completion_eval/truth/deprecated-deprioritized/pyproject.toml":0,"crates/ty_completion_eval/truth/internal-typeshed-hidden/pyproject.toml":0,"crates/ty_completion_eval/truth/import-keyword-completion/pyproject.toml":0,"crates/ty_completion_eval/truth/raise-uses-base-exception/pyproject.toml":0,"crates/ty_completion_eval/truth/tighter-over-looser-scope/pyproject.toml":0,"crates/ty_completion_eval/truth/modules-over-other-symbols/pyproject.toml":0,"crates/ty_completion_eval/truth/ty-extensions-lower-stdlib/pyproject.toml":0,"crates/ty_completion_eval/truth/import-deprioritizes-dunder/pyproject.toml":0,"crates/ty_completion_eval/truth/import-deprioritizes-sunder/pyproject.toml":0,"crates/ty_completion_eval/truth/auto-import-includes-modules/pyproject.toml":0,"crates/ty_completion_eval/truth/object-attr-instance-methods/pyproject.toml":0,"crates/ty_completion_eval/truth/scope-simple-long-identifier/pyproject.toml":0,"crates/ty_completion_eval/truth/higher-level-symbols-preferred/pyproject.toml":0,"crates/ty_completion_eval/truth/scope-existing-over-new-import/pyproject.toml":0,"crates/ty_completion_eval/truth/typing-only-auto-import-ranking/pyproject.toml":0,"crates/ty_completion_eval/truth/auto-import-skips-current-module/pyproject.toml":0,"crates/ty_completion_eval/truth/stdlib-over-third-party-same-name/pyproject.toml":1,"crates/ty_completion_eval/truth/auto-import-skips-third-party-tests/pyproject.toml":1,"crates/ty_completion_eval/truth/import-deprioritizes-type_check_only/pyproject.toml":0}},"dimension":"04","conclusive":true},{"reason":"tests are kept inside the files they test, which a count by file name cannot see","signal":"test_growth","observed":{"files_with_inline_tests":323},"dimension":"04","conclusive":false},{"reason":"rework is not rising against new work","signal":"churn_trend","observed":{"late_delete_per_insert":0.488,"early_delete_per_insert":0.663,"single_commit_deletions_set_aside":[]},"dimension":"04","conclusive":true},{"reason":"no pinned runtime version to check","signal":"eol_runtime","observed":{"pinned":0},"dimension":"04","conclusive":false},{"reason":"fixes usually come with a test","signal":"fixes_with_tests","observed":{"fixes":1183,"share":0.356,"with_tests":421},"dimension":"04","conclusive":true},{"reason":"fixing is not crowding out building","signal":"fix_share_trend","observed":{"fix_share_by_quarter_newest_first":[0.1,0.11,0.18,0.17,0.16,0.2,0.11,0.16]},"dimension":"04","conclusive":true},{"reason":"no schema migrations to read","signal":"schema_churn","observed":{},"dimension":"04","conclusive":false},{"reason":"little code is kept for the old way","signal":"compat_layers","observed":{"share":0.004,"code_files":3578,"compat_files":13,"oldest_months":36},"dimension":"04","conclusive":true},{"reason":"no JavaScript manifest to read","signal":"dependency_redundancy","observed":{},"dimension":"04","conclusive":false},{"reason":"a telemetry or error-reporting library is referenced","signal":"telemetry_presence","observed":{"note":"presence only; whether anyone watches it is not visible here","sample":["Cargo.toml:231: traces: tracing","Cargo.toml:232: traces: tracing","Cargo.toml:233: traces: tracing"],"matches":32},"dimension":"06","conclusive":true},{"reason":"not assessed for Rust: its logging setup is not read","signal":"structured_logging","observed":{"matches":0},"dimension":"06","conclusive":false},{"reason":"none at all is 06.1","signal":"telemetry_depth","observed":{"kinds":[]},"dimension":"06","conclusive":false},{"reason":"not assessed for Rust: its logger calls are not read","signal":"print_logging","observed":{"prints":43,"logger_calls":18},"dimension":"06","conclusive":false},{"reason":"the product's code names no reporting host","signal":"usage_reporting_default","observed":{"settings_on":0,"settings_off":0,"reporting_hosts":[]},"dimension":"06","conclusive":true},{"reason":"no alert rules in the repository; they may live in a console","signal":"alert_rules","observed":{"alert_files":0},"dimension":"06","conclusive":false},{"reason":"no deployment descriptor names an image","signal":"deployed_image_floats","observed":{"images":0},"dimension":"06","conclusive":false},{"reason":"no Kubernetes probes","signal":"probes_identical","observed":{},"dimension":"06","conclusive":false},{"reason":"no Kubernetes deployments","signal":"single_replica","observed":{},"dimension":"06","conclusive":false},{"reason":"environment differences live in configuration","signal":"environment_branching","observed":{"sites":0,"languages_not_read":["Rust"]},"dimension":"06","conclusive":true},{"reason":"releases are marked","signal":"release_markers","observed":{"tags_last_year":49,"release_commits":3,"changelog_commits":117,"commits_last_year":4373},"dimension":"06","conclusive":true},{"reason":"migrations do not run at container start","signal":"migrate_on_start","observed":{},"dimension":"06","conclusive":true},{"reason":"no feature-flag service; flags may live elsewhere","signal":"feature_flags","observed":{"sdk_files":0,"evaluation_sites":0},"dimension":"06","conclusive":false},{"reason":"no single contributor dominates the last 24 months","signal":"contributor_concentration","observed":{"years":4.1,"window":"last 24 months","authors":934,"top_share":"a quarter or more","bus_factor":3,"authors_in_window":497,"top_share_all_time":"a quarter or more","bus_factor_all_time":2},"dimension":"03","conclusive":true},{"reason":"more than one contributor active in the trailing year","signal":"active_contributors","observed":{"all_time":934,"active_12mo":306},"dimension":"03","conclusive":true},{"reason":"every substantial directory has been touched by more than one person","signal":"knowledge_silos","observed":{"authors":934,"directories":5},"dimension":"03","conclusive":true},{"reason":"an open contributor base, where one-commit contributors are normal","signal":"drive_by_contributors","observed":{"authors":934,"one_off_share":0.608},"dimension":"03","conclusive":true},{"reason":"the dominant contributor is still active","signal":"contributor_attrition","observed":{"authors":934,"top_share":"a quarter or more","top_contributor_last_committed":"within the last three months"},"dimension":"03","conclusive":true},{"reason":"more than one person changes the critical paths","signal":"critical_path_ownership","observed":{"authors":497,"sole_owned_areas":[]},"dimension":"03","conclusive":true},{"reason":"the second and third contributors are still active","signal":"second_contributor_attrition","observed":{"gone":[]},"dimension":"03","conclusive":true},{"reason":"the team has not narrowed to one person","signal":"bus_factor_trend","observed":{"by_year_newest_first":[2,4,2,1]},"dimension":"03","conclusive":true},{"reason":"the team is not shrinking","signal":"joiners_and_leavers","observed":{"left":31,"joined":49,"regular_last_year":80,"regular_prior_year":70},"dimension":"03","conclusive":true},{"reason":"a meaningful share of recent change carries evidence of review","signal":"merge_discipline","observed":{"merges":0,"window":"last 24 months","with_tracked":1667,"with_reviewed":0,"reviewed_share":0.965,"commits_in_window":9348,"squashed_with_pr_ref":8983,"with_signed_off_other":23,"reviewed_share_all_time":0.946,"with_committed_by_other":8889},"dimension":"02","conclusive":true},{"reason":"CI configuration is present in the working tree","signal":"ci_presence","observed":{"count":22,"configs":[".github/workflows/build-binaries.yml",".github/workflows/build-docker.yml",".github/workflows/build-wasm.yml",".github/workflows/ci.yaml",".github/workflows/daily_fuzz.yaml"]},"dimension":"02","conclusive":true},{"reason":"tests are present in a normal proportion to source","signal":"test_presence","observed":{"tests":2571,"source":5071,"test_ratio":0.507},"dimension":"02","conclusive":true},{"reason":"tags are present","signal":"release_cadence","observed":{"tags":431,"sample":["0.10.0","0.11.0","0.11.1","0.11.10","0.11.11"]},"dimension":"02","conclusive":true},{"reason":"commit subjects generally carry content","signal":"conventional_commits","observed":{"sampled":17399,"low_content_share":0.0},"dimension":"02","conclusive":true},{"reason":"process scaffolding is present in the repository","signal":"branch_protection_hints","observed":{"present":["CI workflows","CODEOWNERS","pre-commit hooks","contribution guidance"]},"dimension":"02","conclusive":true},{"reason":"CI invokes a test runner","signal":"ci_runs_tests","observed":{"sample":[".github/workflows/ci.yaml",".github/workflows/sync_typeshed.yaml"],"configs":22,"with_tests":2},"dimension":"02","conclusive":true},{"reason":"few tests are switched off","signal":"skipped_tests","observed":{"focused":0,"skipped":2,"test_files":3746,"files_with_skips":2},"dimension":"02","conclusive":true},{"reason":"change is rarely undone","signal":"revert_share","observed":{"share":0.002,"reverts":19,"recent_commits":8008},"dimension":"02","conclusive":true},{"reason":"dependencies move with the code","signal":"dependency_update_cadence","observed":{"lockfiles":40,"commits_since":25,"days_since_lockfile_changed":2},"dimension":"02","conclusive":true},{"reason":"tests are not retried until they pass","signal":"flaky_test_markers","observed":{"test_retries":0,"suite_retries":0},"dimension":"02","conclusive":true},{"reason":"a linter or formatter runs in the build","signal":"lint_in_build","observed":{"wired":37,"ci_configs":22,"product_files":3578},"dimension":"02","conclusive":true},{"reason":"too few merges to judge (squash and rebase leave none)","signal":"long_lived_branches","observed":{"merges":0},"dimension":"02","conclusive":false},{"reason":"changes arrive in reviewable sizes","signal":"commit_size","observed":{"share":0.016,"commits":6940,"over_2000_lines":112},"dimension":"02","conclusive":true},{"reason":"first commit is not a disproportionate share of the codebase","signal":"initial_dump","observed":{"insertions":394,"share_of_insertions":0.0001},"dimension":"01","conclusive":true},{"reason":"commit subjects vary in wording and length","signal":"message_uniformity","observed":{"length_stdev":19.42,"repeat_share":0.003},"dimension":"01","conclusive":true},{"reason":"most files were revisited after they were first written","signal":"revision_depth","observed":{"files_seen":3437,"write_once_share":0.253},"dimension":"01","conclusive":true},{"reason":"little shipping code is repeated verbatim across files","signal":"duplicated_blocks","observed":{"share":0.0062,"product_files":2448,"distinct_blocks":468753,"duplicated_blocks":2897},"dimension":"01","conclusive":true},{"reason":"errors are rarely thrown away","signal":"swallowed_errors","observed":{"loc":1284076,"files":16,"per_kloc":0.02,"swallowed":21,"languages_not_read":["Rust"]},"dimension":"01","conclusive":true},{"reason":"no language migration is stalled halfway","signal":"unfinished_migration","observed":{},"dimension":"01","conclusive":true},{"reason":"not a data or machine-learning repository","signal":"notebook_outputs","observed":{},"dimension":"01","conclusive":false},{"reason":"no model weights are committed","signal":"weights_in_git","observed":{"files":0},"dimension":"01","conclusive":true},{"reason":"no credential-shaped strings outside test and fixture paths","signal":"committed_secrets","observed":{"note":"the working tree only; the history is 05.5","patterns":8,"files_read":6306,"inert_tokens_set_aside":0,"fixture_matches_ignored":0},"dimension":"05","conclusive":true},{"reason":"at least one standard guard rail is configured","signal":"security_guardrails","observed":{"present":[".github/CODEOWNERS",".github/renovate.json5",".pre-commit-config.yaml"]},"dimension":"05","conclusive":true},{"reason":"a lockfile is committed, so builds are reproducible","signal":"dependency_pinning","observed":{"lockfile":true},"dimension":"05","conclusive":true},{"reason":"a licence file is present","signal":"license_present","observed":{"found":true},"dimension":"05","conclusive":true},{"reason":"no credential-shaped string was ever added outside test and fixture paths","signal":"secrets_in_history","observed":{"patterns":8,"truncated":false,"added_lines":3981588,"commits_scanned":17340,"inert_tokens_set_aside":0},"dimension":"05","conclusive":true},{"reason":"no environment file is committed outside tests and examples","signal":"secrets_management_pattern","observed":{"env_files":0},"dimension":"05","conclusive":true},{"reason":"outbound calls set timeouts, or are few","signal":"outbound_timeouts","observed":{"languages_not_read":["Rust"],"calls_without_timeout":0},"dimension":"05","conclusive":true},{"reason":"too few migrations to judge","signal":"migration_reversibility","observed":{"migrations":0},"dimension":"05","conclusive":false},{"reason":"no SQL is assembled from strings in product code","signal":"sql_from_strings","observed":{"files":0,"sites":0,"languages_not_read":["Rust"],"value_interpolated":0},"dimension":"05","conclusive":true},{"reason":"product code does not build shell commands from strings","signal":"shell_from_strings","observed":{"sites":0,"languages_not_read":["Rust"]},"dimension":"05","conclusive":true},{"reason":"no code-executing deserialiser in product code","signal":"unsafe_deserialization","observed":{"sites":0,"languages_not_read":["Rust"]},"dimension":"05","conclusive":true},{"reason":"no TLS verification is switched off in product code","signal":"tls_verification_off","observed":{"files":0,"sites":0,"pinned_instead":0,"behind_an_opt_in":0,"languages_not_read":["Rust"]},"dimension":"05","conclusive":true},{"reason":"no Kubernetes workload manifests","signal":"resource_limits","observed":{"workloads":0},"dimension":"05","conclusive":false},{"reason":"no workload runs privileged or in the host's namespaces","signal":"privileged_workloads","observed":{"sites":0,"behind_a_setting_or_built_here":0},"dimension":"05","conclusive":true},{"reason":"deployment configuration references secrets, never holds them","signal":"credentials_in_deploy_config","observed":{"files":0,"sites":0},"dimension":"05","conclusive":true},{"reason":"not a frontend","signal":"public_env_secret","observed":{},"dimension":"05","conclusive":false},{"reason":"not a frontend","signal":"unsafe_html","observed":{},"dimension":"05","conclusive":false},{"reason":"not a frontend","signal":"source_maps_shipped","observed":{},"dimension":"05","conclusive":false},{"reason":"no signing keystore or profile is committed","signal":"signing_material","observed":{"files":0},"dimension":"05","conclusive":true},{"reason":"not a mobile app","signal":"cleartext_traffic","observed":{},"dimension":"05","conclusive":false},{"reason":"not a data or machine-learning repository","signal":"dataset_provenance","observed":{},"dimension":"05","conclusive":false},{"reason":"every licence found in vendored code is permissive or weak-copyleft","signal":"license_copyleft_inherited","observed":{"vendored_paths":775},"dimension":"05","conclusive":true},{"reason":"manifest and licence file agree on MIT","signal":"license_manifest_conflict","observed":{"license":"MIT"},"dimension":"05","conclusive":true},{"reason":"the licence is recognisable as MIT","signal":"license_grant_unclear","observed":{"class":"permissive","license":"MIT"},"dimension":"05","conclusive":true},{"reason":"no widely used compiled library is committed to the product","signal":"committed_native_libraries","observed":{"libraries":0,"recognised":[]},"dimension":"05","conclusive":true},{"reason":"few or no feature flags in the history","signal":"flags_accumulating","observed":{"live":0,"retired":0,"flags_seen":0,"stale_over_a_year":0},"dimension":"04","conclusive":false},{"reason":"one API version is served, or none","signal":"api_versions_coexisting","observed":{"live":[],"versions_seen":[]},"dimension":"04","conclusive":false},{"reason":"few dependencies were added and dropped within 60 days","signal":"dependency_churn","observed":{"dependencies_seen":375,"added_in_two_years":181,"removed_within_60_days":4},"dimension":"04","conclusive":true},{"reason":"no platform was dropped from CI in the last two years","signal":"ci_platforms_dropped","observed":{"platforms_seen":["Linux","Windows","macOS"],"dropped_in_two_years":[]},"dimension":"04","conclusive":true},{"reason":"the README's first screen states no end, move or freeze","signal":"repository_status","observed":{"statements":0},"dimension":"04","conclusive":true},{"reason":"nothing says development happens elsewhere","signal":"development_elsewhere","observed":{"no_pr_statements":0,"mirror_statements":0,"replayed_commit_share":0.0},"dimension":"02","conclusive":true},{"reason":"relicensed only between permissive licences: MIT → BSD-3-Clause (2023-05-13) → MIT (2025-09-04)","signal":"licence_changes","observed":{"latest":"MIT","weaker":false,"licence_versions":3,"unreleased_changes":0},"dimension":"05","conclusive":true},{"reason":"no directory carries a separate paid-edition licence","signal":"paid_edition","observed":{"directories":0},"dimension":"05","conclusive":true},{"reason":"releases keep pace with development","signal":"releases_stopped","observed":{"median_gap_days":6.5,"days_since_last_tag":-5,"commits_last_90_days":1463},"dimension":"04","conclusive":true},{"reason":"the newest release, 0.16.10, was made after the surveyed commit on the branch surveyed","signal":"release_branch","observed":{"elsewhere":2,"on_branch":428,"tags_in_window":431,"direction_known":true,"later_on_branch":1},"dimension":"04","conclusive":true},{"reason":"no file says one person maintains it","signal":"single_maintainer","observed":{"statements":0},"dimension":"03","conclusive":true},{"reason":"record incomplete: no advisory found in the sources that answered; OSV PyPI ruff (an empty record for a package published here) did not","signal":"project_advisories","observed":{"sources":["OSV by commit","GitHub repository advisories","NVD"],"affecting":0,"exploited":0,"advisories":0,"version_from":"the root manifest, matching a release tag","fix_unreleased":0,"sources_failed":["OSV PyPI ruff (an empty record for a package published here)"],"version_unknown":0,"high_or_critical":0,"surveyed_version":"0.16.9","affecting_newest_release":0},"dimension":"05","conclusive":false},{"reason":"record incomplete: no advisory against the project in the last 24 months; OSV PyPI ruff (an empty record for a package published here) did not answer","signal":"advisory_record","observed":{"newest":null,"critical":0,"affecting":0,"could_not_tell":0,"last_24_months":0,"sources_failed":["OSV PyPI ruff (an empty record for a package published here)"],"high_or_critical":0},"dimension":"05","conclusive":false},{"reason":"no affecting advisory is on CISA's Known Exploited list","signal":"project_exploited","observed":{"exploited":0},"dimension":"05","conclusive":false}],"schema_version":"1","repository_says":[{"line":8,"path":".github/PULL_REQUEST_TEMPLATE.md","text":"states a policy on AI-generated contributions","phrase":null}],"surveyed_commit":null,"provenance_disclosure":{"agents":["Claude","GitHub Copilot"],"recent":{"since":"2025-09-27","until":"2026-09-27","window":"the last 12 months","measures":"share of lines added in the last 12 months to 2026-09-27 by commits declaring an AI agent as co-author: the same floor as the all-time share, over a shorter window","confidence":"moderate","ai_line_share":0.0095,"total_commits":5102,"ai_commit_share":0.0135,"confidence_basis":["21% of non-merge commits carry any trailer at all","low trailer coverage: the convention may not be in consistent use","no widespread author/committer date divergence"],"declared_commits":69,"total_lines_added":1200220,"declared_lines_added":11347},"window":null,"excluded":"lockfiles, vendored and generated paths are excluded from both measurements so that code nobody wrote cannot move the share","measures":"share of lines added by commits declaring an AI agent as co-author, as a proportion of all lines ever added","confidence":"moderate","measurable":true,"ai_line_share":0.004,"total_commits":17399,"affects_rating":false,"excluded_lines":1519166,"ai_commit_share":0.004,"confidence_basis":["16% of non-merge commits carry any trailer at all","low trailer coverage: the convention may not be in consistent use","no widespread author/committer date divergence"],"declared_commits":69,"total_lines_added":2821845,"surviving_ai_lines":null,"surviving_measures":"share of lines still present in the working tree that originate in an AI-declared commit; null unless the scan was run with --deep","commit_share_by_year":{"2022":0.0,"2023":0.0,"2024":0.0,"2025":0.0011,"2026":0.0161},"declared_agent_names":["Claude","GitHub Copilot"],"declared_lines_added":11347,"surviving_line_share":null,"floor_not_measurement":"This is a lower bound. It counts what the repository declares. Undeclared AI authorship is invisible here, and a single rebase removes the trailers this rests on. Absence of a declaration is absence of disclosure, not absence of AI authorship.","surviving_total_lines":null},"reliance":"An automated reading of a repository's code and its history up to one commit, with public advisory records. It may be wrong, it is not legal, financial, investment or security advice, and it does not replace diligence by a qualified person. It is provided for information: nobody may rely on it (Borehole's terms, section 3).","published_under_todays_rules":["2 findings from checks Borehole's calibration found wrong more often than right are no longer published."]}