Skip to content

chore(bench): restore run-20261115-mr9-10rep-10rep (mode full) - #167

Merged
log0u7 merged 1 commit into
mainfrom
feat/bench-mr9-restore
Nov 15, 2026
Merged

log0u7 merged 1 commit into
mainfrom
feat/bench-mr9-restore

Conversation

@log0u7

@log0u7 log0u7 commented Nov 15, 2026

Copy link
Copy Markdown
Owner

Why

The original MR9 run (2026-11-11) was destroyed by a worktree cleanup before its results were ever committed (no branch protection exception: main was ahead locally, the push to main was refused, so this lands via PR).

What

  • experiments/final-bench-results/run-20261115-mr9-10rep-10rep/: the committed replacement, executed under the clean bench protocol (chore(bench): enforce clean bench protocol #152).
  • Mode full, 10 reps, 29 challenges x 2 models: base 168/290 (0.58), trained-mr9 169/290 (0.58), clean-only 40/110 = 0.364 both sides. Matches the recorded MR9 verdict.
  • Protocol rule 5 (completed run = committed run) applied: the next run (mr10) started only after this run was committed on a branch.

The original MR9 run (2026-11-11) was destroyed by a worktree cleanup
before its results were ever committed. This run is the committed
replacement, executed under the clean bench protocol (#152).

Mode full, 10 reps, 29 challenges x 2 models:
  base 168/290 (0.58), trained-mr9 169/290 (0.58)
  clean-only: 40/110 = 0.364 both sides - matches the recorded MR9
  verdict; the protocol rule 5 (completed run = committed run) is what
  makes this run survive the next cleanup.
@log0u7
log0u7 merged commit b909516 into main Nov 15, 2026
8 checks passed
@log0u7
log0u7 deleted the feat/bench-mr9-restore branch November 15, 2026 17:59
log0u7 added a commit that referenced this pull request Nov 15, 2026
Rerun of the MR10 bench destroyed with the worktree remove --force
incident (2026-11-15). Same protocol as the MR9 restore (#167):
mode full, 10 reps, attempt cap 600, seed 7, served trained-mr10
(NSSM alias verified by preflight).

Verdict (clean-only, 11 challenges): 40/110 vs 40/110 (0.364 vs 0.364),
identical to the destroyed MR10-full verdict. Per-challenge table
identical to the MR9 rerun: trained-mr9 and trained-mr10 (different
GGUFs) produce identical eval outcomes; the only trained edge left is
uaf_train_b +1 (9/10 -> 10/10, contaminated). The destroyed runs'
globals (198/207) pre-date the attempt cap (#152) and the system
repairs; the clean-only verdict is the reproducible contract.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant