sots-re/campaign/DASHBOARD.md
2026-09-08 19:41:53 -04:00

142 lines
7.4 KiB
Markdown

# SotS RE campaign — coverage dashboard
Generated 2026-09-08 23:41 UTC · `sots-re` @ 4293200,2026-09-08 · `sots-engine` @ f99488a,2026-09-08 (220 commits) · regenerate with `tools/dashboard.py`
> **North star:** A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte
## 1. Map coverage (campaign/board.md)
365 targets · mapped-or-better **324/365** `[█████████░] 89%` · verified **282/365** `[████████░░] 77%`
| Status | Count | % |
|---|---:|---:|
| verified | 282 | 77% |
| mapped | 42 | 12% |
| in-progress | 4 | 1% |
| backlog | 35 | 10% |
| blocked | 2 | 1% |
| Type | verified | mapped | in-progress | backlog | blocked | total |
|---|---:|---:|---:|---:|---:|---:|
| objects | 41 | 6 | 0 | 3 | 1 | 51 |
| control-flow | 24 | 2 | 0 | 0 | 0 | 26 |
| subsystems | 4 | 8 | 0 | 2 | 1 | 15 |
| engine | 28 | 0 | 0 | 0 | 0 | 28 |
| verify | 87 | 15 | 3 | 29 | 0 | 134 |
| phase2 | 13 | 3 | 1 | 0 | 0 | 17 |
| meta | 66 | 6 | 0 | 1 | 0 | 73 |
| other | 19 | 2 | 0 | 0 | 0 | 21 |
## 2. Binary understanding
- RTTI type descriptors: **1,924** (`Game::` 1,404, `Mars::` 194; serializable types 179)
- Classes with recovered member layouts: **384** / 1,598 named classes `[██░░░░░░░░] 24%` — `objects/layouts.json` (serializer recovery) plus classes recovered by hand in `struct-recovery.md` + `schema-gaps-resolved.md`. Note 179 types are *serializable*; the recovery also reaches non-serializable ones, so this is not a subset of that
- Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1223**, verified **1104** `[█████████░] 90%`
## 3. Data layer
- Catalogs: **1,595/1,595** files parsed (91 block kinds in `schema_stats.json`), dangling cross-refs **0** (`crosslink.json`)
- Oracle `mars-parse`: **1,531/1,531** files agree `[██████████] 100%`
- Oracle `mars-text`: **64/64** files agree `[██████████] 100%`
- Saves: **20/20** real saves strict-clean — strict exit 0, 0 errors, 0 warnings
- Design rules: **127/127** stock designs pass `[██████████] 100%`
## 4. Engine accrual (sots-engine)
| Module | LOC | Test files | Checks | Wired | Doc |
|---|---:|---:|---:|---|---|
| `app` | 4,838 | 9 | 207 | yes | N-output-term.md |
| `game/ai` | 2,089 | 8 | 322 | yes | L4-ai-orders.md |
| `game/combat` | 582 | 2 | 34 | yes | L2-predictions.md |
| `game/config` | 558 | 4 | 131 | yes | M1.md |
| `game/data` | 2,077 | 12 | 462 | yes | game-data.md |
| `game/design` | 1,200 | 19 | 303 | yes | game-design.md |
| `game/effects` | 973 | 3 | 231 | yes | game-effects.md |
| `game/events` | 558 | 3 | 152 | yes | E-events.md |
| `game/nav` | 581 | 2 | 113 | yes | — |
| `game/sim` | 4,780 | 14 | 1038 | yes | game-sim.md |
| `mars/parse` | 875 | 12 | 277 | yes | mars-parse.md |
| `mars/rng` | 244 | 0 | 0 | yes | mars-rng.md |
| `mars/stream` | 5,407 | 7 | 310 | yes | mars-stream.md |
| `mars/text` | 899 | 8 | 245 | yes | mars-text.md |
| `mars/vfs` | 788 | 9 | 140 | yes | mars-vfs.md |
| `shim` | 15,837 | 0 | 0 | direct (WIN32) | H-probes.md |
| `shim/hooks` | 12,748 | 0 | 0 | direct (WIN32) | L1-predictions.md |
| `shim/trace` | 2,258 | 9 | 273 | direct (WIN32) | shim-trace.md |
| **total** | **57,292** | **121** | **4238** | | |
Board `engine:` rows: verified **28**, mapped 0, in flight 0 (of 28) — verified & merged `[██████████] 100%`
## 5. Phase 2 milestones
| Milestone | Status | Coverage | Notes |
|---|---|---:|---|
| P2-M0 shim bootstrap | ✅ verified | 100% | sots-engine 5f5bc41: proxy binkw32.dll (66 exports identical), MinHook, asm-stub trace hoo |
| P2-M1 flat-KV config loader | ✅ verified | 100% | LIVE: GlobalConsts::LoadFile hooked; trace 19 calls/1088 regions (tracecmp 0); compare 19/ |
| P2-M2 manifest/id registry | ✅ verified | 80% | LIVE: trace 22 calls (tracecmp 0); weapons compare 1/1 0 divergences; REPLACE+oracle byte- |
| P2-M3 Mars brace-block parser | ✅ verified | 0% | SUPERSEDED (engine mars/parse, oracle 1531/1531). Mars::Script pull tokenizer (Open 0x008c |
| P2-M4 gobio VFS read | ✅ verified | 0% | SUPERSEDED (engine mars/vfs, 10268 files CRC-clean). choke point: bool __cdecl gobio::Read |
## 6. Standalone (`src/app`) — distance to the byte-match
Turn-driver phases: **16/44** modelled (12 committed) `[████░░░░░░] 36%`
| | verified | implemented | partial | blocked | stub |
|---|---:|---:|---:|---:|---:|
| turn drivers (44) | 0 | 4 | 8 | 4 | 28 |
| post-combat tail (37) | 0 | 1 | 4 | 1 | 31 |
Reference pair `turn2-state.sav` → `turn3-state.sav`, leaves localised by `state_checksum.py` (coverage proved by re-serialisation):
- baseline (a standalone that does nothing): **108** leaves diverge
- after one standalone turn: **63** leaves diverge — closed 45, regressed 0
- byte match: ❌ not yet `[████░░░░░░] 42%`
Where the remaining divergence lives:
| Subsystem | Leaves |
|---|---:|
| `/Sim/systems` | 24 |
| `/Sim/players` | 20 |
| `/Sim/turnstats` | 8 |
| `/Sim/fleets` | 3 |
| `/Sim/FleetIDs[]` | 1 |
| `/Sim/ModCount` | 1 |
| `/Sim/NMnx` | 1 |
| `/Sim/NumFlts` | 1 |
Generator: 16 word(s) modelled per turn; unattributed per turn: 18-20 (lane Z, in flight). A byte-match is impossible until that closes — the generator state is saved state.
Detail: `verify/results/standalone/report.txt`.
## 7. Verification ledger
- ✅ Saves strict: 20/20 (strict exit 0, 0 errors, 0 warnings)
- ✅ Design rules: 127/127
- ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64
- ✅ Compare harness present (`verify/harness/compare/`)
- ✅ M0 evidence present (`verify/results/shim/m0.log`)
- ✅ Determinism oracle: verified
## 8. Open questions
Open **26** · resolved/parked 11 · backlog items: 1. The engine today 0, 2. The milestone, restated 5, 3. Engine work to Rung A 0, 4. Future engine modules 5, 5. Workloads to manufacture 7, 6. Multiplayer revival 4, 7. Method and infrastructure 5, Parked 2
Most recent open:
- Some truths are unreachable by compare — B3's draw-divisor bug differed on 0.78% of draws yet flip…
- x87 precision-control mode at runtime — 53-bit MSVC default vs 24-bit if D3D9 grabbed the FPU; mov…
- Struct-modelling hazard (found by M2) — an MSVC-2010 `std::vector` member is three words, so a…
- SAVE_FORMAT tag corrections (fix Python reader + spec) — real on-disk tags: `otnF` (not `ontF`) in…
- Not traced end-to-end — `Species/_NPC/weapons/*.weapon` loading and the `.effect` dictionary entry…
## 9. Delta since previous dashboard
- verified targets: 253 → 282 (+29) · mapped-or-better: 293 → 324 (+31)
- engine LOC: 50,923 → 57,292 (+6,369) · test files: 117 → 121 (+4) · checks: 4,084 → 4,238 (+154)
- addresses verified: 1,100 → 1,104 (+4) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
- standalone leaves closed: 45 → 45 (+0) · leaves still diverging: 63 → 63 (+0)
---
warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed
<!-- dashboard-metrics {"verified": 282, "mapped_plus": 324, "targets": 365, "loc": 57292, "tests": 121, "checks": 4238, "addr_verified": 1104, "addr_total": 1223, "layouts": 384, "open_q": 26, "sa_closed": 45, "sa_left": 63} -->