alex/sots-re
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
sots-re/campaign/DASHBOARD.md
alex c3ec32be01 dashboard refresh
2026-09-08 11:00:57 -04:00

7.1 KiB
Raw Blame History

SotS RE campaign — coverage dashboard

Generated 2026-09-08 15:00 UTC · sots-re @ a77b1c3,2026-09-08 · sots-engine @ b48d860,2026-09-08 (126 commits) · regenerate with tools/dashboard.py

North star: A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte

1. Map coverage (campaign/board.md)

183 targets · mapped-or-better 155/183 [████████░░] 85% · verified 127/183 [███████░░░] 69%

Status Count %
verified 127 69%
mapped 28 15%
in-progress 2 1%
backlog 24 13%
blocked 2 1%
Type verified mapped in-progress backlog blocked total
objects 25 6 0 2 1 34
control-flow 7 2 0 1 0 10
subsystems 3 7 1 3 1 15
engine 19 0 0 0 0 19
verify 32 5 0 14 0 51
phase2 10 3 1 2 0 16
meta 28 5 0 1 0 34
other 3 0 0 1 0 4

2. Binary understanding

  • RTTI type descriptors: 1,924 (Game:: 1,404, Mars:: 194; serializable types 179)
  • Classes with recovered member layouts: 384 / 1,598 named classes [██░░░░░░░░] 24% — objects/layouts.json (serializer recovery) plus classes recovered by hand in struct-recovery.md + schema-gaps-resolved.md. Note 179 types are serializable; the recovery also reaches non-serializable ones, so this is not a subset of that
  • Functions: 41,411 (parsed from 01-fingerprint.md); named/annotated in the address contract (ghidra/addresses.json, not Ghidra's full rename count): 805, verified 781 [██████████] 97%

3. Data layer

  • Catalogs: 1,595/1,595 files parsed (91 block kinds in schema_stats.json), dangling cross-refs 0 (crosslink.json)
  • Oracle mars-parse: 1,531/1,531 files agree [██████████] 100%
  • Oracle mars-text: 64/64 files agree [██████████] 100%
  • Saves: 11/11 real saves strict-clean — strict exit 0, 0 errors, 0 warnings
  • Design rules: 127/127 stock designs pass [██████████] 100%

4. Engine accrual (sots-engine)

Module LOC Test files Checks Wired Doc
app 1,192 3 34 yes S-standalone.md
game/config 558 4 131 yes M1.md
game/data 2,053 12 462 yes game-data.md
game/design 1,024 17 250 yes game-design.md
game/effects 973 3 231 yes game-effects.md
game/events 558 3 152 yes E-events.md
game/sim 3,100 10 699 yes game-sim.md
mars/parse 875 12 277 yes mars-parse.md
mars/rng 244 0 0 yes mars-rng.md
mars/stream 5,392 7 310 yes mars-stream.md
mars/text 899 8 245 yes mars-text.md
mars/vfs 788 9 140 yes mars-vfs.md
shim 11,564 0 0 direct (WIN32) M0.md
shim/hooks 8,548 0 0 direct (WIN32) M0.md
shim/trace 2,258 9 273 direct (WIN32) shim-trace.md
total 40,026 97 3204

Board engine: rows: verified 19, mapped 0, in flight 0 (of 19) — verified & merged [██████████] 100%

5. Phase 2 milestones

Milestone Status Coverage Notes
P2-M0 shim bootstrap ✅ verified 100% sots-engine 5f5bc41: proxy binkw32.dll (66 exports identical), MinHook, asm-stub trace hoo
P2-M1 flat-KV config loader ✅ verified 100% LIVE: GlobalConsts::LoadFile hooked; trace 19 calls/1088 regions (tracecmp 0); compare 19/
P2-M2 manifest/id registry ✅ verified 80% LIVE: trace 22 calls (tracecmp 0); weapons compare 1/1 0 divergences; REPLACE+oracle byte-
P2-M3 Mars brace-block parser ⬜ backlog 0% Mars::Script pull tokenizer (Open 0x008cd7d0, ReadToken 0x008cd2f0, Next 0x008cd3e0, SkipB
P2-M4 gobio VFS read ⬜ backlog 0% choke point: bool __cdecl gobio::ReadFile(const char*, IBuffer**) 0x008d5140; FileSystemSe

6. Standalone (src/app) — distance to the byte-match

Turn-driver phases: 14/44 modelled (7 committed) [███░░░░░░░] 32%

verified implemented partial blocked stub
turn drivers (44) 0 2 5 7 30
post-combat tail (37) 0 1 0 1 35

Reference pair turn1-state.sav → turn2-state.sav, leaves localised by state_checksum.py (coverage proved by re-serialisation):

  • baseline (a standalone that does nothing): 209 leaves diverge
  • after one standalone turn: 204 leaves diverge — closed 5, regressed 0
  • byte match: ❌ not yet [░░░░░░░░░░] 2%

Where the remaining divergence lives:

Subsystem Leaves
/Sim/players 82
/Sim/systems 80
/Sim/turnstats 24
/Sim/SvSctOb 8
/Sim/DesignIDs[] 1
/Sim/FleetIDs[] 1
/Sim/ModCount 1
/Sim/NMnx 1

Generator: 0 word(s) modelled per turn; unattributed per turn: 18-20 (lane Z, in flight). A byte-match is impossible until that closes — the generator state is saved state.

Detail: verify/results/standalone/report.txt.

7. Verification ledger

  • ✅ Saves strict: 11/11 (strict exit 0, 0 errors, 0 warnings)
  • ✅ Design rules: 127/127
  • ✅ oracle mars-parse 1531/1531 · ✅ oracle mars-text 64/64
  • ✅ Compare harness present (verify/harness/compare/)
  • ✅ M0 evidence present (verify/results/shim/m0.log)
  • ✅ Determinism oracle: verified

8. Open questions

Open 26 · resolved/parked 11 · backlog items: Now 4, Next 3, Later 2, Breadth queue 7, Parked 1, From the RE how-to 4, Behavioral slice 4

Most recent open:

  • Some truths are unreachable by compare — B3's draw-divisor bug differed on 0.78% of draws yet flip…
  • x87 precision-control mode at runtime — 53-bit MSVC default vs 24-bit if D3D9 grabbed the FPU; mov…
  • Struct-modelling hazard (found by M2) — an MSVC-2010 std::vector member is three words, so a…
  • SAVE_FORMAT tag corrections (fix Python reader + spec) — real on-disk tags: otnF (not ontF) in…
  • Not traced end-to-end — Species/_NPC/weapons/*.weapon loading and the .effect dictionary entry…

9. Delta since previous dashboard

  • verified targets: 122 → 127 (+5) · mapped-or-better: 150 → 155 (+5)
  • engine LOC: 36,774 → 40,026 (+3,252) · test files: 97 → 97 (+0) · checks: 3,204 → 3,204 (+0)
  • addresses verified: 777 → 781 (+4) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
  • standalone leaves closed: 5 → 5 (+0) · leaves still diverging: 204 → 204 (+0)

warnings: board.md: unknown types subsystems; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed