diff --git a/docs/evidence/llm_judge_biases.md b/docs/evidence/llm_judge_biases.md index a91ef7d..425527a 100644 --- a/docs/evidence/llm_judge_biases.md +++ b/docs/evidence/llm_judge_biases.md @@ -5,6 +5,15 @@ Fetch-status: verbatim (abstracts in full or near-full; verdict pages are short # LLM judge biases (excerpts) +WARNING, read before quoting anything from this file. It was assembled by +agents across several sessions and the provenance is uneven. Entries tagged +[FT] were copied from raw source. Entries tagged [ID] have numbers a +summarizer produced from a web page, and nobody has read the paper. On +2026-08-15 I re-pulled the five [ID] entries the litreview depends on and two +of the five carried a wrong number, so treat the remaining 11 as roughly 2-in-5 +wrong until each is checked against raw text. Do not promote an [ID] number +into SKILL.md or refs/ without re-pulling the paper first. + ## "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena" — Zheng et al. (LMSYS), NeurIPS 2023 — https://arxiv.org/pdf/2306.05685 The canonical paper naming the bias taxonomy: diff --git a/docs/evidence/reports/code/nous_atropos_readme.md b/docs/evidence/reports/code/nous_atropos_readme.md index 4d12f59..3d26b1b 100644 --- a/docs/evidence/reports/code/nous_atropos_readme.md +++ b/docs/evidence/reports/code/nous_atropos_readme.md @@ -1,3 +1,7 @@ +Source: https://github.com/NousResearch/atropos/blob/main/README.md +Title: Atropos, Nous Research's LLM RL Gym (repository README) +Fetch-status: verbatim README + # Atropos - Nous Research's LLM RL Gym ![newatr-02](banner-image.jpg) diff --git a/docs/evidence/reports/code/olmo_core_readme.md b/docs/evidence/reports/code/olmo_core_readme.md index 492a597..6d5ec94 100644 --- a/docs/evidence/reports/code/olmo_core_readme.md +++ b/docs/evidence/reports/code/olmo_core_readme.md @@ -1,3 +1,7 @@ +Source: https://github.com/allenai/OLMo-core/blob/main/README.md +Title: OLMo-core, building blocks for OLMo modeling and training (repository README) +Fetch-status: verbatim README +
OLMo Logo