dashboard: value-domain line as the counterweight to the 99.99%-typed figure

This commit is contained in:
alex 2026-09-08 21:59:34 -04:00
parent d98f435017
commit 9e39b0051a
2 changed files with 36 additions and 20 deletions

View file

@ -1,20 +1,20 @@
# SotS RE campaign — coverage dashboard
Generated 2026-09-09 00:58 UTC · `sots-re` @ 429f754,2026-09-08 · `sots-engine` @ b1c61a8,2026-09-08 (232 commits) · regenerate with `tools/dashboard.py`
Generated 2026-09-09 01:59 UTC · `sots-re` @ d98f435,2026-09-08 · `sots-engine` @ e62d974,2026-09-08 (238 commits) · regenerate with `tools/dashboard.py`
> **North star:** A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte
## 1. Map coverage (campaign/board.md)
389 targets · mapped-or-better **345/389** `[█████████░] 89%` · verified **303/389** `[████████░░] 78%`
403 targets · mapped-or-better **356/403** `[█████████░] 88%` · verified **314/403** `[████████░░] 78%`
| Status | Count | % |
|---|---:|---:|
| verified | 303 | 78% |
| mapped | 42 | 11% |
| verified | 314 | 78% |
| mapped | 42 | 10% |
| in-progress | 4 | 1% |
| backlog | 38 | 10% |
| blocked | 2 | 1% |
| backlog | 41 | 10% |
| blocked | 2 | 0% |
| Type | verified | mapped | in-progress | backlog | blocked | total |
|---|---:|---:|---:|---:|---:|---:|
@ -22,24 +22,25 @@ Generated 2026-09-09 00:58 UTC · `sots-re` @ 429f754,2026-09-08 · `sots-engine
| control-flow | 24 | 2 | 0 | 0 | 0 | 26 |
| subsystems | 4 | 8 | 0 | 2 | 1 | 15 |
| engine | 29 | 0 | 0 | 0 | 0 | 29 |
| verify | 94 | 15 | 3 | 32 | 0 | 144 |
| verify | 101 | 15 | 3 | 35 | 0 | 154 |
| phase2 | 13 | 3 | 1 | 0 | 0 | 17 |
| meta | 74 | 6 | 0 | 1 | 0 | 81 |
| meta | 78 | 6 | 0 | 1 | 0 | 85 |
| other | 19 | 2 | 0 | 0 | 0 | 21 |
## 2. Binary understanding
- RTTI type descriptors: **1,924** (`Game::` 1,404, `Mars::` 194; serializable types 179)
- Classes with recovered member layouts: **384** / 1,598 named classes `[██░░░░░░░░] 24%` — `objects/layouts.json` (serializer recovery) plus classes recovered by hand in `struct-recovery.md` + `schema-gaps-resolved.md`. Note 179 types are *serializable*; the recovery also reaches non-serializable ones, so this is not a subset of that
- Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1241**, verified **1122** `[█████████░] 90%`
- Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1247**, verified **1122** `[█████████░] 90%`
## 3. Data layer
- Catalogs: **1,595/1,595** files parsed (91 block kinds in `schema_stats.json`), dangling cross-refs **0** (`crosslink.json`)
- Oracle `mars-parse`: **1,531/1,531** files agree `[██████████] 100%`
- Oracle `mars-text`: **64/64** files agree `[██████████] 100%`
- Saves: **20/20** real saves strict-clean — strict exit 0, 0 errors, 0 warnings
- Saves: **22/22** real saves strict-clean — strict exit 0, 0 errors, 0 warnings
- Design rules: **127/127** stock designs pass `[██████████] 100%`
- Value domains: **490/724** typed fields have been seen to vary `[███████░░░] 68%` — the other **234** have only ever held one value across the corpus, so their typing is untested (`value-domain-census.md`)
## 4. Engine accrual (sots-engine)
@ -57,13 +58,13 @@ Generated 2026-09-09 00:58 UTC · `sots-re` @ 429f754,2026-09-08 · `sots-engine
| `game/sim` | 4,780 | 14 | 1038 | yes | game-sim.md |
| `mars/parse` | 875 | 12 | 277 | yes | mars-parse.md |
| `mars/rng` | 244 | 0 | 0 | yes | mars-rng.md |
| `mars/stream` | 5,671 | 7 | 313 | yes | mars-stream.md |
| `mars/stream` | 5,834 | 8 | 316 | yes | mars-stream.md |
| `mars/text` | 899 | 8 | 245 | yes | mars-text.md |
| `mars/vfs` | 788 | 9 | 140 | yes | mars-vfs.md |
| `shim` | 16,284 | 0 | 0 | direct (WIN32) | H-probes.md |
| `shim/hooks` | 13,178 | 0 | 0 | direct (WIN32) | L1-predictions.md |
| `shim` | 16,295 | 0 | 0 | direct (WIN32) | H-probes.md |
| `shim/hooks` | 13,189 | 0 | 0 | direct (WIN32) | L1-predictions.md |
| `shim/trace` | 2,258 | 9 | 273 | direct (WIN32) | shim-trace.md |
| **total** | **58,433** | **121** | **4241** | | |
| **total** | **58,618** | **122** | **4244** | | |
Board `engine:` rows: verified **29**, mapped 0, in flight 0 (of 29) — verified & merged `[██████████] 100%`
@ -111,7 +112,7 @@ Detail: `verify/results/standalone/report.txt`.
## 7. Verification ledger
- ✅ Saves strict: 20/20 (strict exit 0, 0 errors, 0 warnings)
- ✅ Saves strict: 22/22 (strict exit 0, 0 errors, 0 warnings)
- ✅ Design rules: 127/127
- ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64
- ✅ Compare harness present (`verify/harness/compare/`)
@ -132,11 +133,11 @@ Most recent open:
## 9. Delta since previous dashboard
- verified targets: 291 → 303 (+12) · mapped-or-better: 333 → 345 (+12)
- engine LOC: 57,699 → 58,433 (+734) · test files: 121 → 121 (+0) · checks: 4,241 → 4,241 (+0)
- addresses verified: 1,121 → 1,122 (+1) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
- verified targets: 314 → 314 (+0) · mapped-or-better: 356 → 356 (+0)
- engine LOC: 58,618 → 58,618 (+0) · test files: 122 → 122 (+0) · checks: 4,244 → 4,244 (+0)
- addresses verified: 1,122 → 1,122 (+0) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
- standalone leaves closed: 45 → 45 (+0) · leaves still diverging: 63 → 63 (+0)
---
warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed
<!-- dashboard-metrics {"verified": 303, "mapped_plus": 345, "targets": 389, "loc": 58433, "tests": 121, "checks": 4241, "addr_verified": 1122, "addr_total": 1241, "layouts": 384, "open_q": 26, "sa_closed": 45, "sa_left": 63} -->
<!-- dashboard-metrics {"verified": 314, "mapped_plus": 356, "targets": 403, "loc": 58618, "tests": 122, "checks": 4244, "addr_verified": 1122, "addr_total": 1247, "layouts": 384, "open_q": 26, "sa_closed": 45, "sa_left": 63} -->

View file

@ -430,7 +430,22 @@ def render(engine, prev):
if not oracles:
L.append("- Oracle agreements: none parsed from `sots-engine/docs/mars-*.md`")
L += [f"- Saves: **{nsaves}/{nsaves}** real saves strict-clean — {s_detail}" if s_ok else f"- Saves: {nsaves} real saves, strict **NOT clean** — {s_detail}",
f"- Design rules: **{d_ok}/{d_tot}** stock designs pass {bar(d_ok or 0, d_tot or 1)}" if d_ok is not None else "- Design rules: ? (unparsed)", ""]
f"- Design rules: **{d_ok}/{d_tot}** stock designs pass {bar(d_ok or 0, d_tot or 1)}" if d_ok is not None else "- Design rules: ? (unparsed)"]
# The counterweight to the 99.99% typed figure. Coverage is indexed by shape and
# says nothing about whether a field was ever exercised; this is the value axis.
# Parsed from the census findings file so there is one source of truth and it
# goes visibly stale rather than silently wrong.
dom = re.search(r"(\d+) field\(s\) observed: (\d+) vary, (\d+) constant",
read(os.path.join(RE_ROOT, "findings/subsystems/value-domain-census.md")))
if dom:
tot, vary, const = (int(g) for g in dom.groups())
L.append(f"- Value domains: **{vary}/{tot}** typed fields have been seen to vary "
f"{bar(vary, tot)} — the other **{const}** have only ever held one value "
f"across the corpus, so their typing is untested (`value-domain-census.md`)")
else:
L.append("- Value domains: ? (findings/subsystems/value-domain-census.md unparsed)")
L.append("")
# 5 engine
mods = engine_modules(engine)