alex/sots-re
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
sots-re/campaign/DASHBOARD.md

7.3 KiB
Raw Blame History

SotS RE campaign — coverage dashboard

Generated 2026-09-08 17:04 UTC · sots-re @ 7f4d5c5,2026-09-08 · sots-engine @ 0592104,2026-09-08 (145 commits) · regenerate with tools/dashboard.py

North star: A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte

1. Map coverage (campaign/board.md)

227 targets · mapped-or-better 207/227 [█████████░] 91% · verified 171/227 [████████░░] 75%

Status Count %
verified 171 75%
mapped 36 16%
in-progress 1 0%
backlog 17 7%
blocked 2 1%
Type verified mapped in-progress backlog blocked total
objects 29 6 0 2 1 38
control-flow 15 2 0 0 0 17
subsystems 4 8 0 2 1 15
engine 20 0 0 0 0 20
verify 45 10 1 12 0 68
phase2 13 3 0 0 0 16
meta 37 6 0 1 0 44
other 8 1 0 0 0 9

2. Binary understanding

  • RTTI type descriptors: 1,924 (Game:: 1,404, Mars:: 194; serializable types 179)
  • Classes with recovered member layouts: 384 / 1,598 named classes [██░░░░░░░░] 24% — objects/layouts.json (serializer recovery) plus classes recovered by hand in struct-recovery.md + schema-gaps-resolved.md. Note 179 types are serializable; the recovery also reaches non-serializable ones, so this is not a subset of that
  • Functions: 41,411 (parsed from 01-fingerprint.md); named/annotated in the address contract (ghidra/addresses.json, not Ghidra's full rename count): 986, verified 940 [██████████] 95%

3. Data layer

  • Catalogs: 1,595/1,595 files parsed (91 block kinds in schema_stats.json), dangling cross-refs 0 (crosslink.json)
  • Oracle mars-parse: 1,531/1,531 files agree [██████████] 100%
  • Oracle mars-text: 64/64 files agree [██████████] 100%
  • Saves: 11/11 real saves strict-clean — strict exit 0, 0 errors, 0 warnings
  • Design rules: 127/127 stock designs pass [██████████] 100%

4. Engine accrual (sots-engine)

Module LOC Test files Checks Wired Doc
app 1,754 6 79 yes N-output-term.md
game/combat 582 2 34 yes mars-parse.md
game/config 558 4 131 yes M1.md
game/data 2,077 12 462 yes game-data.md
game/design 1,200 19 303 yes game-design.md
game/effects 973 3 231 yes game-effects.md
game/events 558 3 152 yes E-events.md
game/nav 581 2 113 yes —
game/sim 3,382 10 730 yes game-sim.md
mars/parse 875 12 277 yes mars-parse.md
mars/rng 244 0 0 yes mars-rng.md
mars/stream 5,407 7 310 yes mars-stream.md
mars/text 899 8 245 yes mars-text.md
mars/vfs 788 9 140 yes mars-vfs.md
shim 12,102 0 0 direct (WIN32) M0.md
shim/hooks 9,075 0 0 direct (WIN32) M0.md
shim/trace 2,258 9 273 direct (WIN32) shim-trace.md
total 43,313 106 3480

Board engine: rows: verified 20, mapped 0, in flight 0 (of 20) — verified & merged [██████████] 100%

5. Phase 2 milestones

Milestone Status Coverage Notes
P2-M0 shim bootstrap ✅ verified 100% sots-engine 5f5bc41: proxy binkw32.dll (66 exports identical), MinHook, asm-stub trace hoo
P2-M1 flat-KV config loader ✅ verified 100% LIVE: GlobalConsts::LoadFile hooked; trace 19 calls/1088 regions (tracecmp 0); compare 19/
P2-M2 manifest/id registry ✅ verified 80% LIVE: trace 22 calls (tracecmp 0); weapons compare 1/1 0 divergences; REPLACE+oracle byte-
P2-M3 Mars brace-block parser ✅ verified 0% SUPERSEDED (engine mars/parse, oracle 1531/1531). Mars::Script pull tokenizer (Open 0x008c
P2-M4 gobio VFS read ✅ verified 0% SUPERSEDED (engine mars/vfs, 10268 files CRC-clean). choke point: bool __cdecl gobio::Read

6. Standalone (src/app) — distance to the byte-match

Turn-driver phases: 14/44 modelled (8 committed) [███░░░░░░░] 32%

verified implemented partial blocked stub
turn drivers (44) 0 2 6 6 30
post-combat tail (37) 0 1 0 2 34

Reference pair turn1-state.sav → turn2-state.sav, leaves localised by state_checksum.py (coverage proved by re-serialisation):

  • baseline (a standalone that does nothing): 209 leaves diverge
  • after one standalone turn: 204 leaves diverge — closed 5, regressed 0
  • byte match: ❌ not yet [░░░░░░░░░░] 2%

Where the remaining divergence lives:

Subsystem Leaves
/Sim/players 82
/Sim/systems 80
/Sim/turnstats 24
/Sim/SvSctOb 8
/Sim/DesignIDs[] 1
/Sim/FleetIDs[] 1
/Sim/ModCount 1
/Sim/NMnx 1

Generator: 16 word(s) modelled per turn; unattributed per turn: 18-20 (lane Z, in flight). A byte-match is impossible until that closes — the generator state is saved state.

Detail: verify/results/standalone/report.txt.

7. Verification ledger

  • ✅ Saves strict: 11/11 (strict exit 0, 0 errors, 0 warnings)
  • ✅ Design rules: 127/127
  • ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64
  • ✅ Compare harness present (verify/harness/compare/)
  • ✅ M0 evidence present (verify/results/shim/m0.log)
  • ✅ Determinism oracle: verified

8. Open questions

Open 26 · resolved/parked 11 · backlog items: 1. The engine today 0, 2. The milestone, restated 2, 3. Engine work to Rung A 0, 4. Future engine modules 5, 5. Workloads to manufacture 7, 6. Multiplayer revival 4, 7. Method and infrastructure 5, Parked 2

Most recent open:

  • Some truths are unreachable by compare — B3's draw-divisor bug differed on 0.78% of draws yet flip…
  • x87 precision-control mode at runtime — 53-bit MSVC default vs 24-bit if D3D9 grabbed the FPU; mov…
  • Struct-modelling hazard (found by M2) — an MSVC-2010 std::vector member is three words, so a…
  • SAVE_FORMAT tag corrections (fix Python reader + spec) — real on-disk tags: otnF (not ontF) in…
  • Not traced end-to-end — Species/_NPC/weapons/*.weapon loading and the .effect dictionary entry…

9. Delta since previous dashboard

  • verified targets: 162 → 171 (+9) · mapped-or-better: 195 → 207 (+12)
  • engine LOC: 43,313 → 43,313 (+0) · test files: 106 → 106 (+0) · checks: 3,480 → 3,480 (+0)
  • addresses verified: 940 → 940 (+0) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
  • standalone leaves closed: 5 → 5 (+0) · leaves still diverging: 204 → 204 (+0)

warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed