mirror of
https://github.com/wassname/evil_MoE.git
synced 2026-07-18 12:20:26 +08:00
data: add prog_wide_clean.json -- 8/30 pairs that don't encode run_tests grading flaw
22/30 prog_wide pairs are contaminated: 14 print-no-assert, 2 pass-only, 4 assert-True/is-not-None, 2 self-comparison tautologies. All encode knowledge that the grader just calls run_tests() and checks it doesn't throw. Filtered to 8 clean pairs (axes 2/4/5/6 only): isPalindrome_int, mySqrt, containsDuplicate, singleNumber, longestCommonPrefix, lengthOfLastWord, removeDuplicates, firstUniqChar. These are identical to 8 of the 11 authored pairs (minus P19/P20/P21). Needed because job 9 (best result: hack=0.042 per-token) used the full contaminated prog_wide -- result needs replication with clean pairs. Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
This commit is contained in:
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user