alex/sots-re
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
sots-re/campaign/DASHBOARD.md
alex f259655026 dashboard refresh
2026-09-08 15:03:10 -04:00

7.3 KiB
Raw Blame History

SotS RE campaign — coverage dashboard

Generated 2026-09-08 19:03 UTC · sots-re @ a4cc500,2026-09-08 · sots-engine @ db99971,2026-09-08 (167 commits) · regenerate with tools/dashboard.py

North star: A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte

1. Map coverage (campaign/board.md)

274 targets · mapped-or-better 246/274 [█████████░] 90% · verified 206/274 [████████░░] 75%

Status Count %
verified 206 75%
mapped 40 15%
in-progress 2 1%
backlog 24 9%
blocked 2 1%
Type verified mapped in-progress backlog blocked total
objects 35 6 0 2 1 44
control-flow 20 2 0 0 0 22
subsystems 4 8 0 2 1 15
engine 22 0 0 0 0 22
verify 57 14 2 19 0 92
phase2 13 3 0 0 0 16
meta 44 6 0 1 0 51
other 11 1 0 0 0 12

2. Binary understanding

  • RTTI type descriptors: 1,924 (Game:: 1,404, Mars:: 194; serializable types 179)
  • Classes with recovered member layouts: 384 / 1,598 named classes [██░░░░░░░░] 24% — objects/layouts.json (serializer recovery) plus classes recovered by hand in struct-recovery.md + schema-gaps-resolved.md. Note 179 types are serializable; the recovery also reaches non-serializable ones, so this is not a subset of that
  • Functions: 41,411 (parsed from 01-fingerprint.md); named/annotated in the address contract (ghidra/addresses.json, not Ghidra's full rename count): 1095, verified 1020 [█████████░] 93%

3. Data layer

  • Catalogs: 1,595/1,595 files parsed (91 block kinds in schema_stats.json), dangling cross-refs 0 (crosslink.json)
  • Oracle mars-parse: 1,531/1,531 files agree [██████████] 100%
  • Oracle mars-text: 64/64 files agree [██████████] 100%
  • Saves: 11/11 real saves strict-clean — strict exit 0, 0 errors, 0 warnings
  • Design rules: 127/127 stock designs pass [██████████] 100%

4. Engine accrual (sots-engine)

Module LOC Test files Checks Wired Doc
app 2,920 6 82 yes N-output-term.md
game/ai 304 2 66 yes —
game/combat 582 2 34 yes mars-parse.md
game/config 558 4 131 yes M1.md
game/data 2,077 12 462 yes game-data.md
game/design 1,200 19 303 yes game-design.md
game/effects 973 3 231 yes game-effects.md
game/events 558 3 152 yes E-events.md
game/nav 581 2 113 yes —
game/sim 4,217 12 937 yes game-sim.md
mars/parse 875 12 277 yes mars-parse.md
mars/rng 244 0 0 yes mars-rng.md
mars/stream 5,407 7 310 yes mars-stream.md
mars/text 899 8 245 yes mars-text.md
mars/vfs 788 9 140 yes mars-vfs.md
shim 12,606 0 0 direct (WIN32) H-probes.md
shim/hooks 9,561 0 0 direct (WIN32) M0.md
shim/trace 2,258 9 273 direct (WIN32) shim-trace.md
total 46,608 110 3756

Board engine: rows: verified 22, mapped 0, in flight 0 (of 22) — verified & merged [██████████] 100%

5. Phase 2 milestones

Milestone Status Coverage Notes
P2-M0 shim bootstrap ✅ verified 100% sots-engine 5f5bc41: proxy binkw32.dll (66 exports identical), MinHook, asm-stub trace hoo
P2-M1 flat-KV config loader ✅ verified 100% LIVE: GlobalConsts::LoadFile hooked; trace 19 calls/1088 regions (tracecmp 0); compare 19/
P2-M2 manifest/id registry ✅ verified 80% LIVE: trace 22 calls (tracecmp 0); weapons compare 1/1 0 divergences; REPLACE+oracle byte-
P2-M3 Mars brace-block parser ✅ verified 0% SUPERSEDED (engine mars/parse, oracle 1531/1531). Mars::Script pull tokenizer (Open 0x008c
P2-M4 gobio VFS read ✅ verified 0% SUPERSEDED (engine mars/vfs, 10268 files CRC-clean). choke point: bool __cdecl gobio::Read

6. Standalone (src/app) — distance to the byte-match

Turn-driver phases: 16/44 modelled (12 committed) [████░░░░░░] 36%

verified implemented partial blocked stub
turn drivers (44) 0 4 8 4 28
post-combat tail (37) 0 1 2 2 32

Reference pair turn1-state.sav → turn2-state.sav, leaves localised by state_checksum.py (coverage proved by re-serialisation):

  • baseline (a standalone that does nothing): 209 leaves diverge
  • after one standalone turn: 157 leaves diverge — closed 52, regressed 0
  • byte match: ❌ not yet [██░░░░░░░░] 25%

Where the remaining divergence lives:

Subsystem Leaves
/Sim/players 81
/Sim/systems 34
/Sim/turnstats 24
/Sim/SvSctOb 8
/Sim/DesignIDs[] 1
/Sim/FleetIDs[] 1
/Sim/ModCount 1
/Sim/NMnx 1

Generator: 16 word(s) modelled per turn; unattributed per turn: 18-20 (lane Z, in flight). A byte-match is impossible until that closes — the generator state is saved state.

Detail: verify/results/standalone/report.txt.

7. Verification ledger

  • ✅ Saves strict: 11/11 (strict exit 0, 0 errors, 0 warnings)
  • ✅ Design rules: 127/127
  • ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64
  • ✅ Compare harness present (verify/harness/compare/)
  • ✅ M0 evidence present (verify/results/shim/m0.log)
  • ✅ Determinism oracle: verified

8. Open questions

Open 26 · resolved/parked 11 · backlog items: 1. The engine today 0, 2. The milestone, restated 2, 3. Engine work to Rung A 0, 4. Future engine modules 5, 5. Workloads to manufacture 7, 6. Multiplayer revival 4, 7. Method and infrastructure 5, Parked 2

Most recent open:

  • Some truths are unreachable by compare — B3's draw-divisor bug differed on 0.78% of draws yet flip…
  • x87 precision-control mode at runtime — 53-bit MSVC default vs 24-bit if D3D9 grabbed the FPU; mov…
  • Struct-modelling hazard (found by M2) — an MSVC-2010 std::vector member is three words, so a…
  • SAVE_FORMAT tag corrections (fix Python reader + spec) — real on-disk tags: otnF (not ontF) in…
  • Not traced end-to-end — Species/_NPC/weapons/*.weapon loading and the .effect dictionary entry…

9. Delta since previous dashboard

  • verified targets: 198 → 206 (+8) · mapped-or-better: 237 → 246 (+9)
  • engine LOC: 44,846 → 46,608 (+1,762) · test files: 109 → 110 (+1) · checks: 3,649 → 3,756 (+107)
  • addresses verified: 1,020 → 1,020 (+0) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
  • standalone leaves closed: 52 → 52 (+0) · leaves still diverging: 157 → 157 (+0)

warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed