alex/sots-re
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
sots-re/campaign/DASHBOARD.md

7.6 KiB
Raw Blame History

SotS RE campaign — coverage dashboard

Generated 2026-09-09 06:15 UTC · sots-re @ c43f638,2026-09-09 · sots-engine @ 1654785,2026-09-09 (241 commits) · regenerate with tools/dashboard.py

North star: A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte

1. Map coverage (campaign/board.md)

428 targets · mapped-or-better 381/428 [█████████░] 89% · verified 339/428 [████████░░] 79%

Status Count %
verified 339 79%
mapped 42 10%
in-progress 4 1%
backlog 41 10%
blocked 2 0%
Type verified mapped in-progress backlog blocked total
objects 46 6 0 3 1 56
control-flow 34 2 0 0 0 36
subsystems 4 8 0 2 1 15
engine 31 0 0 0 0 31
verify 104 15 3 35 0 157
phase2 13 3 1 0 0 17
meta 88 6 0 1 0 95
other 19 2 0 0 0 21

2. Binary understanding

  • RTTI type descriptors: 1,924 (Game:: 1,404, Mars:: 194; serializable types 179)
  • Classes with recovered member layouts: 384 / 1,598 named classes [██░░░░░░░░] 24% — objects/layouts.json (serializer recovery) plus classes recovered by hand in struct-recovery.md + schema-gaps-resolved.md. Note 179 types are serializable; the recovery also reaches non-serializable ones, so this is not a subset of that
  • Functions: 41,411 (parsed from 01-fingerprint.md); named/annotated in the address contract (ghidra/addresses.json, not Ghidra's full rename count): 1291, verified 1160 [█████████░] 90%

3. Data layer

  • Catalogs: 1,595/1,595 files parsed (91 block kinds in schema_stats.json), dangling cross-refs 0 (crosslink.json)
  • Oracle mars-parse: 1,531/1,531 files agree [██████████] 100%
  • Oracle mars-text: 64/64 files agree [██████████] 100%
  • Saves: 41/41 real saves strict-clean — strict exit 0, 0 errors, 0 warnings
  • Design rules: 127/127 stock designs pass [██████████] 100%
  • Value domains: 490/724 typed fields have been seen to vary [███████░░░] 68% — the other 234 have only ever held one value across the corpus, so their typing is untested (value-domain-census.md)

4. Engine accrual (sots-engine)

Module LOC Test files Checks Wired Doc
app 4,838 9 207 yes N-output-term.md
game/ai 2,089 8 322 yes L4-ai-orders.md
game/combat 582 2 34 yes L2-predictions.md
game/config 558 4 131 yes M1.md
game/data 2,077 12 462 yes game-data.md
game/design 1,200 19 303 yes game-design.md
game/effects 973 3 231 yes game-effects.md
game/events 558 3 152 yes E-events.md
game/nav 581 2 113 yes —
game/sim 4,780 14 1038 yes game-sim.md
mars/parse 875 12 277 yes mars-parse.md
mars/rng 273 0 0 yes mars-rng.md
mars/stream 5,834 8 329 yes mars-stream.md
mars/text 899 8 245 yes mars-text.md
mars/vfs 788 9 140 yes mars-vfs.md
shim 16,295 0 0 direct (WIN32) H-probes.md
shim/hooks 13,189 0 0 direct (WIN32) L1-predictions.md
shim/trace 2,258 9 273 direct (WIN32) shim-trace.md
total 58,647 122 4257

Board engine: rows: verified 31, mapped 0, in flight 0 (of 31) — verified & merged [██████████] 100%

5. Phase 2 milestones

Milestone Status Coverage Notes
P2-M0 shim bootstrap ✅ verified 100% sots-engine 5f5bc41: proxy binkw32.dll (66 exports identical), MinHook, asm-stub trace hoo
P2-M1 flat-KV config loader ✅ verified 100% LIVE: GlobalConsts::LoadFile hooked; trace 19 calls/1088 regions (tracecmp 0); compare 19/
P2-M2 manifest/id registry ✅ verified 80% LIVE: trace 22 calls (tracecmp 0); weapons compare 1/1 0 divergences; REPLACE+oracle byte-
P2-M3 Mars brace-block parser ✅ verified 0% SUPERSEDED (engine mars/parse, oracle 1531/1531). Mars::Script pull tokenizer (Open 0x008c
P2-M4 gobio VFS read ✅ verified 0% SUPERSEDED (engine mars/vfs, 10268 files CRC-clean). choke point: bool __cdecl gobio::Read

6. Standalone (src/app) — distance to the byte-match

Turn-driver phases: 16/44 modelled (12 committed) [████░░░░░░] 36%

verified implemented partial blocked stub
turn drivers (44) 0 4 8 4 28
post-combat tail (37) 0 1 4 1 31

Reference pair turn2-state.sav → turn3-state.sav, leaves localised by state_checksum.py (coverage proved by re-serialisation):

  • baseline (a standalone that does nothing): 108 leaves diverge
  • after one standalone turn: 63 leaves diverge — closed 45, regressed 0
  • byte match: ❌ not yet [████░░░░░░] 42%

Where the remaining divergence lives:

Subsystem Leaves
/Sim/systems 24
/Sim/players 20
/Sim/turnstats 8
/Sim/fleets 3
/Sim/FleetIDs[] 1
/Sim/ModCount 1
/Sim/NMnx 1
/Sim/NumFlts 1

Generator: 16 word(s) modelled per turn; unattributed per turn: 18-20 (lane Z, in flight). A byte-match is impossible until that closes — the generator state is saved state.

Detail: verify/results/standalone/report.txt.

7. Verification ledger

  • ✅ Saves strict: 41/41 (strict exit 0, 0 errors, 0 warnings)
  • ✅ Design rules: 127/127
  • ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64
  • ✅ Compare harness present (verify/harness/compare/)
  • ✅ M0 evidence present (verify/results/shim/m0.log)
  • ✅ Determinism oracle: verified

8. Open questions

Open 26 · resolved/parked 11 · backlog items: 1. The engine today 0, 2. The milestone, restated 5, 3. Engine work to Rung A 0, 4. Future engine modules 5, 5. Workloads to manufacture 7, 6. Multiplayer revival 4, 7. Method and infrastructure 5, Parked 2

Most recent open:

  • Some truths are unreachable by compare — B3's draw-divisor bug differed on 0.78% of draws yet flip…
  • x87 precision-control mode at runtime — 53-bit MSVC default vs 24-bit if D3D9 grabbed the FPU; mov…
  • Struct-modelling hazard (found by M2) — an MSVC-2010 std::vector member is three words, so a…
  • SAVE_FORMAT tag corrections (fix Python reader + spec) — real on-disk tags: otnF (not ontF) in…
  • Not traced end-to-end — Species/_NPC/weapons/*.weapon loading and the .effect dictionary entry…

9. Delta since previous dashboard

  • verified targets: 336 → 339 (+3) · mapped-or-better: 378 → 381 (+3)
  • engine LOC: 58,647 → 58,647 (+0) · test files: 122 → 122 (+0) · checks: 4,257 → 4,257 (+0)
  • addresses verified: 1,160 → 1,160 (+0) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
  • standalone leaves closed: 45 → 45 (+0) · leaves still diverging: 63 → 63 (+0)

warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed