diff --git a/campaign/DASHBOARD.md b/campaign/DASHBOARD.md index 4a08040..66eac32 100644 --- a/campaign/DASHBOARD.md +++ b/campaign/DASHBOARD.md @@ -1,20 +1,20 @@ # SotS RE campaign — coverage dashboard -Generated 2026-09-09 00:58 UTC · `sots-re` @ 429f754,2026-09-08 · `sots-engine` @ b1c61a8,2026-09-08 (232 commits) · regenerate with `tools/dashboard.py` +Generated 2026-09-09 01:59 UTC · `sots-re` @ d98f435,2026-09-08 · `sots-engine` @ e62d974,2026-09-08 (238 commits) · regenerate with `tools/dashboard.py` > **North star:** A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte ## 1. Map coverage (campaign/board.md) -389 targets · mapped-or-better **345/389** `[█████████░] 89%` · verified **303/389** `[████████░░] 78%` +403 targets · mapped-or-better **356/403** `[█████████░] 88%` · verified **314/403** `[████████░░] 78%` | Status | Count | % | |---|---:|---:| -| verified | 303 | 78% | -| mapped | 42 | 11% | +| verified | 314 | 78% | +| mapped | 42 | 10% | | in-progress | 4 | 1% | -| backlog | 38 | 10% | -| blocked | 2 | 1% | +| backlog | 41 | 10% | +| blocked | 2 | 0% | | Type | verified | mapped | in-progress | backlog | blocked | total | |---|---:|---:|---:|---:|---:|---:| @@ -22,24 +22,25 @@ Generated 2026-09-09 00:58 UTC · `sots-re` @ 429f754,2026-09-08 · `sots-engine | control-flow | 24 | 2 | 0 | 0 | 0 | 26 | | subsystems | 4 | 8 | 0 | 2 | 1 | 15 | | engine | 29 | 0 | 0 | 0 | 0 | 29 | -| verify | 94 | 15 | 3 | 32 | 0 | 144 | +| verify | 101 | 15 | 3 | 35 | 0 | 154 | | phase2 | 13 | 3 | 1 | 0 | 0 | 17 | -| meta | 74 | 6 | 0 | 1 | 0 | 81 | +| meta | 78 | 6 | 0 | 1 | 0 | 85 | | other | 19 | 2 | 0 | 0 | 0 | 21 | ## 2. Binary understanding - RTTI type descriptors: **1,924** (`Game::` 1,404, `Mars::` 194; serializable types 179) - Classes with recovered member layouts: **384** / 1,598 named classes `[██░░░░░░░░] 24%` — `objects/layouts.json` (serializer recovery) plus classes recovered by hand in `struct-recovery.md` + `schema-gaps-resolved.md`. Note 179 types are *serializable*; the recovery also reaches non-serializable ones, so this is not a subset of that -- Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1241**, verified **1122** `[█████████░] 90%` +- Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1247**, verified **1122** `[█████████░] 90%` ## 3. Data layer - Catalogs: **1,595/1,595** files parsed (91 block kinds in `schema_stats.json`), dangling cross-refs **0** (`crosslink.json`) - Oracle `mars-parse`: **1,531/1,531** files agree `[██████████] 100%` - Oracle `mars-text`: **64/64** files agree `[██████████] 100%` -- Saves: **20/20** real saves strict-clean — strict exit 0, 0 errors, 0 warnings +- Saves: **22/22** real saves strict-clean — strict exit 0, 0 errors, 0 warnings - Design rules: **127/127** stock designs pass `[██████████] 100%` +- Value domains: **490/724** typed fields have been seen to vary `[███████░░░] 68%` — the other **234** have only ever held one value across the corpus, so their typing is untested (`value-domain-census.md`) ## 4. Engine accrual (sots-engine) @@ -57,13 +58,13 @@ Generated 2026-09-09 00:58 UTC · `sots-re` @ 429f754,2026-09-08 · `sots-engine | `game/sim` | 4,780 | 14 | 1038 | yes | game-sim.md | | `mars/parse` | 875 | 12 | 277 | yes | mars-parse.md | | `mars/rng` | 244 | 0 | 0 | yes | mars-rng.md | -| `mars/stream` | 5,671 | 7 | 313 | yes | mars-stream.md | +| `mars/stream` | 5,834 | 8 | 316 | yes | mars-stream.md | | `mars/text` | 899 | 8 | 245 | yes | mars-text.md | | `mars/vfs` | 788 | 9 | 140 | yes | mars-vfs.md | -| `shim` | 16,284 | 0 | 0 | direct (WIN32) | H-probes.md | -| `shim/hooks` | 13,178 | 0 | 0 | direct (WIN32) | L1-predictions.md | +| `shim` | 16,295 | 0 | 0 | direct (WIN32) | H-probes.md | +| `shim/hooks` | 13,189 | 0 | 0 | direct (WIN32) | L1-predictions.md | | `shim/trace` | 2,258 | 9 | 273 | direct (WIN32) | shim-trace.md | -| **total** | **58,433** | **121** | **4241** | | | +| **total** | **58,618** | **122** | **4244** | | | Board `engine:` rows: verified **29**, mapped 0, in flight 0 (of 29) — verified & merged `[██████████] 100%` @@ -111,7 +112,7 @@ Detail: `verify/results/standalone/report.txt`. ## 7. Verification ledger -- ✅ Saves strict: 20/20 (strict exit 0, 0 errors, 0 warnings) +- ✅ Saves strict: 22/22 (strict exit 0, 0 errors, 0 warnings) - ✅ Design rules: 127/127 - ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64 - ✅ Compare harness present (`verify/harness/compare/`) @@ -132,11 +133,11 @@ Most recent open: ## 9. Delta since previous dashboard -- verified targets: 291 → 303 (+12) · mapped-or-better: 333 → 345 (+12) -- engine LOC: 57,699 → 58,433 (+734) · test files: 121 → 121 (+0) · checks: 4,241 → 4,241 (+0) -- addresses verified: 1,121 → 1,122 (+1) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0) +- verified targets: 314 → 314 (+0) · mapped-or-better: 356 → 356 (+0) +- engine LOC: 58,618 → 58,618 (+0) · test files: 122 → 122 (+0) · checks: 4,244 → 4,244 (+0) +- addresses verified: 1,122 → 1,122 (+0) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0) - standalone leaves closed: 45 → 45 (+0) · leaves still diverging: 63 → 63 (+0) --- warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed - + diff --git a/tools/dashboard.py b/tools/dashboard.py index d56c7b5..a3ee941 100755 --- a/tools/dashboard.py +++ b/tools/dashboard.py @@ -430,7 +430,22 @@ def render(engine, prev): if not oracles: L.append("- Oracle agreements: none parsed from `sots-engine/docs/mars-*.md`") L += [f"- Saves: **{nsaves}/{nsaves}** real saves strict-clean — {s_detail}" if s_ok else f"- Saves: {nsaves} real saves, strict **NOT clean** — {s_detail}", - f"- Design rules: **{d_ok}/{d_tot}** stock designs pass {bar(d_ok or 0, d_tot or 1)}" if d_ok is not None else "- Design rules: ? (unparsed)", ""] + f"- Design rules: **{d_ok}/{d_tot}** stock designs pass {bar(d_ok or 0, d_tot or 1)}" if d_ok is not None else "- Design rules: ? (unparsed)"] + + # The counterweight to the 99.99% typed figure. Coverage is indexed by shape and + # says nothing about whether a field was ever exercised; this is the value axis. + # Parsed from the census findings file so there is one source of truth and it + # goes visibly stale rather than silently wrong. + dom = re.search(r"(\d+) field\(s\) observed: (\d+) vary, (\d+) constant", + read(os.path.join(RE_ROOT, "findings/subsystems/value-domain-census.md"))) + if dom: + tot, vary, const = (int(g) for g in dom.groups()) + L.append(f"- Value domains: **{vary}/{tot}** typed fields have been seen to vary " + f"{bar(vary, tot)} — the other **{const}** have only ever held one value " + f"across the corpus, so their typing is untested (`value-domain-census.md`)") + else: + L.append("- Value domains: ? (findings/subsystems/value-domain-census.md unparsed)") + L.append("") # 5 engine mods = engine_modules(engine)