wassnameandClaudypoo 4e45bd4140 DPO can barely move: tinker's own reference run reports 0.52 pair accuracy ...

Contrast with the cookbook's RLHF pipeline (46% -> 94% win rate in 100 steps),
so a decreasing DPO loss is weak evidence of behaviour change.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>

2026-08-08 10:04:32 +08:00

..

checklist.md

docs: resolve ml-debug TODO references

2026-06-12 06:52:38 +08:00

diagnostics.md

Correct overconfident debugging advice

2026-07-12 22:00:49 +08:00

llm_judge_litreview.md

Fix two varglite nits: complete Lost-in-Middle quote, add context to config block

2026-07-23 11:48:50 +08:00

llm_judges.md

Judgemark: add the cheap-tier rows and date the snapshot

2026-08-06 08:24:01 +08:00

loss_surface.md

Update loss_surface.md

2026-06-11 21:21:01 +08:00

metric_stuck.md

restructure: folklore-first, quote-verified, with wassname intro

2026-06-02 20:46:25 +08:00

research_taste.md

Cite Irpan in research taste (signs-of-life, seed canary)

2026-06-25 10:31:39 +08:00

static_analysis.md

feat(ml_debug): add JAX grep patterns and diagnostic equivalents

2026-03-06 14:10:39 +08:00

sweeps.md

restructure: folklore-first, quote-verified, with wassname intro

2026-06-02 20:46:25 +08:00

time_series.md

Add deployment-faithful time-series evaluation guide

2026-07-26 10:31:15 +08:00

transformers.md

DPO can barely move: tinker's own reference run reports 0.52 pair accuracy

2026-08-08 10:04:32 +08:00