mirror of
https://github.com/wassname/ml-debug.git
synced 2026-06-27 19:47:55 +08:00
wassname
fb753d093e
SKILL.md is now folklore only: verbatim practitioner quotes ordered most-general-first, transformer/LLM fine-tuning entries in their own section, minimal context, links and footnotes. New sources: unsloth, axolotl (+training stability), HF course ch8.4, Bekman debug_utils (evidence frozen in docs/evidence/). The synthesized material (mental models, priors, symptom tables, agent loop, triage, anti-patterns) moves to PLAYBOOK.md, framed as menus of hypotheses rather than authoritative diagnoses. Made-up symptom tables no longer sit next to sourced quotes. Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
31 lines
1.8 KiB
Markdown
31 lines
1.8 KiB
Markdown
# wassname's ML Debugging Folklore
|
|
|
|
In an attempt to upskill the machine learning debugging on AI coding assistants (and humans), I've collected high quality sources on how to debug machine learning projects, focusing on the mindset and the "taste". When I started ML I went searching for discussions on best practices, and started a few discussions of my own and they helped me a lot, over the years I've collected good ones. I hope they can help others, as well as help in auto research setups. This intro is human written, and the below is AI written with human guidance.
|
|
|
|
## Use as a Claude skill
|
|
|
|
```
|
|
/skills add https://github.com/wassname/ml_debug
|
|
```
|
|
|
|
Or paste `SKILL.md` into your system prompt / context when debugging.
|
|
|
|
## What's here
|
|
|
|
- **[SKILL.md](SKILL.md)** -- the main artifact. Load into an LLM agent's context as a debugging skill. A short calibration note, then the folklore itself: verbatim sourced quotes from practitioners, general lessons first, modern transformers and LLM fine-tuning in their own section.
|
|
|
|
- **[PLAYBOOK.md](PLAYBOOK.md)** -- the synthesized long-form: mental models, practitioner priors, step catalogs, symptom tables, the agent debugging loop, triage, and anti-patterns. Menus of hypotheses distilled from the same sources, not quotes. Deeper one-off tricks (loss-surface analysis, stuck-metric diagnosis, sweep reliability) live in [refs/](refs/).
|
|
|
|
- **[docs/evidence/](docs/evidence/)** -- frozen local copies of source material (blog posts, talks, papers, reddit threads). Claims in SKILL.md link back to exact quotes here.
|
|
|
|
## Citation
|
|
|
|
```bibtex
|
|
@misc{wassname2026mldebug,
|
|
title = {ML Debugging Folklore: A Practitioner Debugging Skill for LLM Agents},
|
|
author = {Michael J. Clark},
|
|
year = {2026},
|
|
url = {https://github.com/wassname/ml_debug/}
|
|
}
|
|
```
|