Every one was 3x to 100x shorter than its source: gwern_tank 179 -> 20132
words, cleanrl 37-details 239 -> 11410, kidger 185 -> 2932. Three passages the
old karpathy_recipe file presented inside quote marks were paraphrases, not
quotes, and are gone with the excerpts.
- Promote the general (non-RL-specific) Spinning Up lessons up to the main
folklore: "broken code fails silently", "you can't tell it's broken if you
can't see that it's breaking", and test on more than one setup.
- Add gwern's "Unseeing" to the data theme: you can't read what you actually
wrote, hence fresh eyes / a fresh-eyes subagent.
- New "Research taste (adjacent to debugging)" section with verbatim quotes,
each cached: Neel Nanda (your research is false by default; excitement is
evidence of bullshit; read your data), Ulisse Mini (understand the system to
shrink the search space), John Wentworth (gears-level models are capital
investments vs cheap black boxes).
All quotes verbatim from cached sources; 25/25 footnotes resolve.
Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
wassname