Files
hyperframes/evals
Miguel Angel Simon Sierra 0722bca1bc feat(evals): make gold a set of acceptable moves
Round 3 dropped every brief its blind committee could not reconstruct, 90 of
363. Those briefs were the near twins, exactly the beats where retrieval is
hardest, so every published recall number is an upper bound on the corpus that
was generated, and the 100 percent agreement the audit reported was 100 percent
by construction.

Gold becomes a set. A hit is any acceptable move being shown, a near twin joins
the acceptable set instead of ending the brief, and the committee reports its
rate over every brief it read rather than over the survivors.

gate2 owns the schema, since six loops read this field and each was doing its
own reading. A move listed as both acceptable and known-wrong is refused there
rather than scored once as the answer and once as the trap, which is what keeps
the known-wrong-pick rate from depending on read order. Clustering moves from
best[0], which a set leaves undefined, to the sorted acceptable set, so briefs
answered by the same near-twin family share one cluster.

A single-element set is round 3's scalar. The partition every clustered interval
in rounds 2 and 3 was computed over is provably unchanged on both committed
corpora, and the round 3 lexical rows regenerate from the round 3 corpus at the
published figures, which is now a test.
2026-08-01 14:23:52 +02:00
..