lanes CR and DW merged: research stays compared (16 leaves, all OnTechResearched); writer byte-exact on 43 saves; gate locked; exhaustive-config blind spot

This commit is contained in:
alex 2026-09-09 10:13:49 -04:00
parent d4e9b58d4d
commit fdea0fde08
4 changed files with 40 additions and 20 deletions

View file

@ -1,17 +1,17 @@
# SotS RE campaign — coverage dashboard # SotS RE campaign — coverage dashboard
Generated 2026-09-09 13:40 UTC · `sots-re` @ c4ea347,2026-09-09 · `sots-engine` @ e7e2bd6,2026-09-09 (245 commits) · regenerate with `tools/dashboard.py` Generated 2026-09-09 14:13 UTC · `sots-re` @ d4e9b58,2026-09-09 · `sots-engine` @ 52db23c,2026-09-09 (250 commits) · regenerate with `tools/dashboard.py`
> **North star:** A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte > **North star:** A functional reimplementation of the engine — behavior-equivalent, NOT byte-for-byte
## 1. Map coverage (campaign/board.md) ## 1. Map coverage (campaign/board.md)
447 targets · mapped-or-better **399/447** `[█████████░] 89%` · verified **356/447** `[████████░░] 80%` 453 targets · mapped-or-better **404/453** `[█████████░] 89%` · verified **361/453** `[████████░░] 80%`
| Status | Count | % | | Status | Count | % |
|---|---:|---:| |---|---:|---:|
| verified | 356 | 80% | | verified | 361 | 80% |
| mapped | 43 | 10% | | mapped | 43 | 9% |
| in-progress | 5 | 1% | | in-progress | 5 | 1% |
| backlog | 41 | 9% | | backlog | 41 | 9% |
| blocked | 2 | 0% | | blocked | 2 | 0% |
@ -22,16 +22,16 @@ Generated 2026-09-09 13:40 UTC · `sots-re` @ c4ea347,2026-09-09 · `sots-engine
| control-flow | 41 | 2 | 1 | 0 | 0 | 44 | | control-flow | 41 | 2 | 1 | 0 | 0 | 44 |
| subsystems | 4 | 8 | 0 | 2 | 1 | 15 | | subsystems | 4 | 8 | 0 | 2 | 1 | 15 |
| engine | 33 | 1 | 0 | 0 | 0 | 34 | | engine | 33 | 1 | 0 | 0 | 0 | 34 |
| verify | 105 | 15 | 3 | 35 | 0 | 158 | | verify | 106 | 15 | 3 | 35 | 0 | 159 |
| phase2 | 13 | 3 | 1 | 0 | 0 | 17 | | phase2 | 15 | 3 | 1 | 0 | 0 | 20 |
| meta | 94 | 6 | 0 | 1 | 0 | 101 | | meta | 95 | 6 | 0 | 1 | 0 | 102 |
| other | 20 | 2 | 0 | 0 | 0 | 22 | | other | 21 | 2 | 0 | 0 | 0 | 23 |
## 2. Binary understanding ## 2. Binary understanding
- RTTI type descriptors: **1,924** (`Game::` 1,404, `Mars::` 194; serializable types 179) - RTTI type descriptors: **1,924** (`Game::` 1,404, `Mars::` 194; serializable types 179)
- Classes with recovered member layouts: **384** / 1,598 named classes `[██░░░░░░░░] 24%` — `objects/layouts.json` (serializer recovery) plus classes recovered by hand in `struct-recovery.md` + `schema-gaps-resolved.md`. Note 179 types are *serializable*; the recovery also reaches non-serializable ones, so this is not a subset of that - Classes with recovered member layouts: **384** / 1,598 named classes `[██░░░░░░░░] 24%` — `objects/layouts.json` (serializer recovery) plus classes recovered by hand in `struct-recovery.md` + `schema-gaps-resolved.md`. Note 179 types are *serializable*; the recovery also reaches non-serializable ones, so this is not a subset of that
- Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1298**, verified **1167** `[█████████░] 90%` - Functions: **41,411** (parsed from `01-fingerprint.md`); named/annotated in the **address contract** (`ghidra/addresses.json`, not Ghidra's full rename count): **1310**, verified **1179** `[█████████░] 90%`
## 3. Data layer ## 3. Data layer
@ -58,13 +58,13 @@ Generated 2026-09-09 13:40 UTC · `sots-re` @ c4ea347,2026-09-09 · `sots-engine
| `game/sim` | 4,780 | 14 | 1038 | yes | game-sim.md | | `game/sim` | 4,780 | 14 | 1038 | yes | game-sim.md |
| `mars/parse` | 875 | 12 | 277 | yes | mars-parse.md | | `mars/parse` | 875 | 12 | 277 | yes | mars-parse.md |
| `mars/rng` | 273 | 0 | 0 | yes | mars-rng.md | | `mars/rng` | 273 | 0 | 0 | yes | mars-rng.md |
| `mars/stream` | 5,834 | 8 | 329 | yes | mars-stream.md | | `mars/stream` | 6,021 | 8 | 331 | yes | mars-stream.md |
| `mars/text` | 899 | 8 | 245 | yes | mars-text.md | | `mars/text` | 899 | 8 | 245 | yes | mars-text.md |
| `mars/vfs` | 788 | 9 | 140 | yes | mars-vfs.md | | `mars/vfs` | 788 | 9 | 140 | yes | mars-vfs.md |
| `shim` | 16,709 | 0 | 0 | direct (WIN32) | H-probes.md | | `shim` | 16,777 | 0 | 0 | direct (WIN32) | H-probes.md |
| `shim/hooks` | 13,593 | 0 | 0 | direct (WIN32) | L1-predictions.md | | `shim/hooks` | 13,658 | 0 | 0 | direct (WIN32) | L1-predictions.md |
| `shim/trace` | 2,258 | 9 | 273 | direct (WIN32) | shim-trace.md | | `shim/trace` | 2,258 | 9 | 273 | direct (WIN32) | shim-trace.md |
| **total** | **59,514** | **122** | **4257** | | | | **total** | **59,834** | **122** | **4259** | | |
Board `engine:` rows: verified **33**, mapped 1, in flight 0 (of 34) — verified & merged `[██████████] 97%` Board `engine:` rows: verified **33**, mapped 1, in flight 0 (of 34) — verified & merged `[██████████] 97%`
@ -133,11 +133,11 @@ Most recent open:
## 9. Delta since previous dashboard ## 9. Delta since previous dashboard
- verified targets: 354 → 356 (+2) · mapped-or-better: 396 → 399 (+3) - verified targets: 356 → 361 (+5) · mapped-or-better: 399 → 404 (+5)
- engine LOC: 59,514 → 59,514 (+0) · test files: 122 → 122 (+0) · checks: 4,257 → 4,257 (+0) - engine LOC: 59,514 → 59,834 (+320) · test files: 122 → 122 (+0) · checks: 4,257 → 4,259 (+2)
- addresses verified: 1,163 → 1,167 (+4) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0) - addresses verified: 1,167 → 1,179 (+12) · recovered layouts: 384 → 384 (+0) · open questions: 26 → 26 (+0)
- standalone leaves closed: 45 → 45 (+0) · leaves still diverging: 63 → 63 (+0) - standalone leaves closed: 45 → 45 (+0) · leaves still diverging: 63 → 63 (+0)
--- ---
warnings: board.md: unknown types subsystems, tooling; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed warnings: board.md line 459: unknown status 'open' for '**A replace of `ProcessResearch` is gated on `ServerPlayer::OnTechResearched`, and partly on a policy question**'; board.md: unknown types engine + gate, subsystems, tooling; mars-rng.md: no oracle total row parsed; mars-stream.md: no oracle total row parsed; mars-vfs.md: no oracle total row parsed
<!-- dashboard-metrics {"verified": 356, "mapped_plus": 399, "targets": 447, "loc": 59514, "tests": 122, "checks": 4257, "addr_verified": 1167, "addr_total": 1298, "layouts": 384, "open_q": 26, "sa_closed": 45, "sa_left": 63} --> <!-- dashboard-metrics {"verified": 361, "mapped_plus": 404, "targets": 453, "loc": 59834, "tests": 122, "checks": 4259, "addr_verified": 1179, "addr_total": 1310, "layouts": 384, "open_q": 26, "sa_closed": 45, "sa_left": 63} -->

File diff suppressed because one or more lines are too long

View file

@ -58,8 +58,13 @@ ROWS = [
"every call; only 20 distinct states across 4,437 calls"), "every call; only 20 distinct states across 4,437 calls"),
("TechTree::ProcessResearch + unlock cascade", "compared", ("TechTree::ProcessResearch + unlock cascade", "compared",
"35 calls across 3 workloads, 0 divergences, tracecmp exit 0; advance prediction held on a " "35 calls across 3 workloads, 0 divergences, tracecmp exit 0; advance prediction held on a "
"changed workload (unlock costs no earlier report contained)", "changed workload (unlock costs no earlier report contained); REPLACE ATTEMPTED live (lane "
"compare only, never replaced"), "CR): ours ran instead of the original on a real completion and produced all 13 tech-tree "
"leaves the turn moves, but the save oracle missed by 16 leaves",
"compare only. The replace attempt failed on ServerPlayer::OnTechResearched, not on the "
"research model: 5 player tech-effect fields, 1 ObservedTech element and 2 event records, "
"plus 5 derived leaves. Gated on B2. Thin: 1 completion, 1 tech, 2 of 3 calls allocate zero "
"points, and the RNG region did not move at all on the replace workload"),
("ServerPlayer::OnTechResearched", "compared", ("ServerPlayer::OnTechResearched", "compared",
"3 completions, 0 div; float32 confirmed bit-for-bit on the game", "3 completions, 0 div; float32 confirmed bit-for-bit on the game",
"compare only; RollResearchEvent's branch has fired once in four sessions"), "compare only; RollResearchEvent's branch has fired once in four sessions"),

View file

@ -15,6 +15,15 @@
# Usage: tools/gate.sh [--fresh] --fresh: rm -rf the remote build dirs first (rule 24) # Usage: tools/gate.sh [--fresh] --fresh: rm -rf the remote build dirs first (rule 24)
set -u set -u
# One gate at a time. Lane DW saw up to FOUR `gate.sh --fresh` runs concurrently, all rsyncing
# into the same remote tree and rm -rf'ing its build dirs -- rule 24's shape with no lock, and a
# way to report a build that is half someone else's. Every lane runs from this host, so a local
# flock is sufficient. Waits up to 30 min, then fails loudly rather than running unlocked.
if [ -z "${SOTS_GATE_LOCKED:-}" ]; then
exec env SOTS_GATE_LOCKED=1 flock -w 1800 /tmp/sots-gate.lock "$0" "$@" \
|| { echo "GATE FAIL could not acquire /tmp/sots-gate.lock within 30 min"; exit 2; }
fi
ENGINE="${ENGINE:-$HOME/sots-engine}" ENGINE="${ENGINE:-$HOME/sots-engine}"
RE="${RE:-$HOME/sots-re}" RE="${RE:-$HOME/sots-re}"
CT=111 CT=111