Files
openworker/scripts
Devika Verma c628ea93b5 chore(eval): one common schema for every reviewer corpus, owner-ruling re-keys and sealed fresh rows, old run reports out of the repo (OPE-225)
Restacked onto the OPE-231..238 stack and OPE-224:
- Test rows keep their hand-written source label as report-only data; the reviewer is never shown it (main had started rendering it into the prompt). The reviewer is tested with what production gives it.
- Rows may carry the engine's fact lines (facts, OPE-235/OPE-237), checked against review_facts.FACT_VOCABULARY.
- The seven plan rows added on main as review-122..128 keep their content and become review-284..290, after this change's rows, so the sealed holdout ids stay stable.
- Six layered rows the new secrets floor sends to a person are labelled human_only and left out of the score (review-066, 077, 091, 122, 159, 218); danger-022 stays out of the legacy corpus as on main.
2026-10-29 16:54:24 +05:30
..