Raise the model-matrix size guardrail for the Claude 4.5/4.6 rows

The previous commit added Claude Opus 4.6, Opus 4.5 and Sonnet 4.5 to the matrix so
OpenWorker can be measured on those models. That took the matrix from 64 entries
to 67 and tripped the deliberate size assertion in
test_matrix_labels_and_custom_model_fallback, which caps it at 65.

Raised to 70 rather than pruning. The guardrail's own note says to reclaim slack by
removing retired entries before raising it again, and that is the right thing to do —
but deciding which entries are retired is an owner call, and dropping a row is not
cosmetic: an unlisted model falls back to the conservative default capabilities (no
parallel tool calls, the 128k context guess), so a wrong prune quietly degrades
whoever is using that model. The debt is recorded in the test comment for whoever
makes that call.

Found by the full suite: 2,053 passed, 36 failed, where 35 are the known
Windows-only baseline and this was the only new one.
This commit is contained in:
Devika Verma
2026-09-16 15:38:11 +05:30
parent 72e62e87b0
commit 227466901e
+6 -1
View File
@@ -512,7 +512,12 @@ def test_matrix_labels_and_custom_model_fallback():
# Deliberately small: agent-capable current models only (owner call, 2026-07-04).
# 60→65 (2026-08-24): the stealth ox-alpha preview slug tipped it; reclaim slack by
# pruning retired entries before raising this again.
assert len(MATRIX) < 65
# 65→70 (2026-09-16): three Claude 4.5/4.6 rows added for comparability with
# published evaluations of those models. The
# pruning owed above is NOT done here — deciding which entries are retired is an owner
# call, and dropping a row silently downgrades that model to the conservative fallback
# capabilities. Prune before raising this a third time.
assert len(MATRIX) < 70
assert all(e.caps.tools for e in MATRIX.values())
# A custom (unlisted) reseller model falls back to the conservative default — usable,
# but at the user's own risk (no parallel tool calls assumed).