wassname b1087b8efd llm_judges: verify the five abstract-quoted papers against raw PDF ...

NoLiMa effective length was wrong in both files: most models fall below the
85% threshold at 1-4K tokens, not 8-16K (only GPT-4o 8K, GPT-4.1 16K). NoLiMa
32K count was 11 models, not 10. The Loo quote's first sentence was stitched
from two places and is dropped. JudgeLRM's 8.14% is an Introduction number,
not an abstract one, and the abstract quote had lost /14B and its trailing
clause. Shi et al is 'The findings', not 'Our findings'. Body quotes now
replace abstract quotes where the number matters; tags [ID] -> [FT].

2026-08-14 21:16:13 +08:00

..

fpp3

add FPP3 (Hyndman & Athanasopoulos) scraped to markdown, 13 chapters + appendices

2026-07-26 10:21:48 +08:00

reports

docs: add sourced transformer report folklore

2026-06-12 07:02:58 +08:00

[English (auto-generated)] Deep RL Bootcamp Lecture 6 Nuts and Bolts of Deep RL Experimentation [Do.txt

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

alexirpan_rl_hard.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

amid_fish_reproducing_deep_rl.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

andyljones_rl_debugging.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

axolotl_debugging.md

restructure: quotes-first SKILL.md, synthesized playbook split out

2026-06-11 14:33:32 +08:00

axolotl_training_stability.md

restructure: quotes-first SKILL.md, synthesized playbook split out

2026-06-11 14:33:32 +08:00

bekman_debug_utils_transformers.md

restructure: quotes-first SKILL.md, synthesized playbook split out

2026-06-11 14:33:32 +08:00

bekman_ml_engineering_instabilities.md

folklore: tuning playbook, Domingos, Bekman loss spikes, Ng error analysis; LLM-judge bias appendix

2026-06-11 15:30:41 +08:00

cleanrl_37_ppo_details.md

folklore: add koaning, gwern, kidger, nanochat, cleanrl; trim lucidrains

2026-06-02 20:59:36 +08:00

cs229_ml_advice.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

cs231n_neural_networks_3.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

domingos_2012_few_useful_things.md

evidence: full text for sculley 2015, lones 2021, domingos 2012

2026-08-14 21:13:11 +08:00

fsdl_spring2021_lecture7.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

goodfellow_ch11_practical_methodology.md

chore: include Goodfellow chapters (author encourages sharing)

2026-03-06 10:16:00 +08:00

goodfellow_ch15_representation_learning.md

chore: include Goodfellow chapters (author encourages sharing)

2026-03-06 10:16:00 +08:00

google_tuning_playbook.md

folklore: tuning playbook, Domingos, Bekman loss spikes, Ng error analysis; LLM-judge bias appendix

2026-06-11 15:30:41 +08:00

gwern_tank.md

folklore: add koaning, gwern, kidger, nanochat, cleanrl; trim lucidrains

2026-06-02 20:59:36 +08:00

gwern_unseeing.md

folklore: promote Spinning Up to main; add a Research-taste section

2026-06-02 21:08:49 +08:00

henderson_2018_deep_rl_matters.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

hf_llm_course_ch8_4_debugging_pipeline.md

restructure: quotes-first SKILL.md, synthesized playbook split out

2026-06-11 14:33:32 +08:00

joschu_nuts_and_bolts.md

Replace OCR-garbled Schulman cache with clean slide transcript

2026-06-25 10:31:39 +08:00

karpathy_common_mistakes_tweet_2018.md

folklore: add Karpathy common-mistakes tweet and Sculley CACE principle

2026-06-11 14:43:47 +08:00

karpathy_nn_zero_to_hero_lec4_diagnostics.md

feat(ml_debug): expand nanochat evidence, add lec4 diagnostics file

2026-03-10 05:38:33 +08:00

karpathy_recipe_training_nn_2019.md

feat(ml_debug): add Karpathy recipe + nanochat evidence, update-ratio diagnostic

2026-03-10 05:32:37 +08:00

kidger_just_know_stuff.md

folklore: add koaning, gwern, kidger, nanochat, cleanrl; trim lucidrains

2026-06-02 20:59:36 +08:00

koaning_bad_labels.md

folklore: add koaning, gwern, kidger, nanochat, cleanrl; trim lucidrains

2026-06-02 20:59:36 +08:00

llm_judge_biases.md

llm_judges: verify the five abstract-quoted papers against raw PDF

2026-08-14 21:16:13 +08:00

lones_2021_ml_pitfalls.md

evidence: full text for sculley 2015, lones 2021, domingos 2012

2026-08-14 21:13:11 +08:00

lucidrains_x_transformers_readme.md

folklore: add lucidrains transformer-stability item (QK-norm, post-emb LN)

2026-06-02 20:49:15 +08:00

mccandlish_2018_large_batch.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

nanda_highly_opinionated_ml_paper_writing.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

nanda_how_to_mech_interp.md

folklore: promote Spinning Up to main; add a Research-taste section

2026-06-02 21:08:49 +08:00

nanda_research_process_explore_understand_distill.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

nanda_research_process_key_mindsets.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

nanda_research_process_research_taste.md

Expand research taste appendix with expert quotes

2026-06-25 10:31:39 +08:00

nanda_research_process_shared_draft.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

nanochat_deepwiki_llm_pretraining_2026.md

feat(ml_debug): expand nanochat evidence, add lec4 diagnostics file

2026-03-10 05:38:33 +08:00

ng_ml_yearning_error_analysis.md

folklore: tuning playbook, Domingos, Bekman loss spikes, Ng error analysis; LLM-judge bias appendix

2026-06-11 15:30:41 +08:00

olah_research_taste_exercises.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

olsson_80000hours_ml_engineering_ai_safety.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

reddit_deeprl_bootcamp_2017_75m5vd.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

reddit_icml2017_tutorial_levine_6vcvu1.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

reddit_rl_debugging_tips_9sh77q.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

reddit_rl_practical_tips_7s8px9.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

reddit_rl_roadblocks_bzg3l2.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

reddit_schulman_nuts_bolts_5hereu.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

sanh_simple_considerations_hf_2021.md

docs(ml_debug): annotate EMNLP 2018 NLP code tutorial; note sparse Adam embedding bug

2026-03-10 05:48:36 +08:00

schulman_nuts_bolts_deeprl_bootcamp_2017_subtitles.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

sculley_2015_hidden_technical_debt.md

evidence: full text for sculley 2015, lones 2021, domingos 2012

2026-08-14 21:13:11 +08:00

slavv_37_reasons_nn.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00

spinningup_research_source_graph.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

spinningup_researcher.md

rl: quote Spinning Up (Achiam) on silent failure and bug-first debugging

2026-06-02 21:04:55 +08:00

steinhardt_research_stochastic_decision_process.md

Add research taste evidence appendix

2026-06-25 10:31:39 +08:00

ulisse_how_to_get_good_at_programming.md

folklore: promote Spinning Up to main; add a Research-taste section

2026-06-02 21:08:49 +08:00

unsloth_troubleshooting_faqs.md

restructure: quotes-first SKILL.md, synthesized playbook split out

2026-06-11 14:33:32 +08:00

wentworth_gears_level_models.md

folklore: promote Spinning Up to main; add a Research-taste section

2026-06-02 21:08:49 +08:00

williamfalcon_deeprl_hacks.md

initial: ML debugging folklore skill

2026-03-06 10:11:30 +08:00