Files
hyperframes/evals
Miguel Angel Simon Sierra 7bf0a25561 fix(evals): compare every arm at the same list length
Ranking each arm at a k of its own compared different list lengths and
different token costs, so an arm could lead on budget rather than on
retrieval. Every ranking now sits at one k, which leaves the retriever as
the only thing that varies down it. The knee stays, demoted to the
question it answers: what list length to run the shipped arm at.

The rule is now read at every k below the shelf rather than at one k
picked afterwards, so agreement across ks is reported instead of a single
chosen comparison.
2026-08-01 03:46:30 +02:00
..