mirror of
https://github.com/wassname/ml_debug.git
synced 2026-09-09 11:27:07 +08:00
add missing cache headers, warn on the unverified judge entries
The two README caches had no Source line, so nothing could re-verify them; both now check at 99% coverage. The judge-bias file gets a warning at the top: 11 entries still carry summarizer numbers, and 2 of the 5 checked so far were wrong.
This commit is contained in:
@@ -5,6 +5,15 @@ Fetch-status: verbatim (abstracts in full or near-full; verdict pages are short
|
||||
|
||||
# LLM judge biases (excerpts)
|
||||
|
||||
WARNING, read before quoting anything from this file. It was assembled by
|
||||
agents across several sessions and the provenance is uneven. Entries tagged
|
||||
[FT] were copied from raw source. Entries tagged [ID] have numbers a
|
||||
summarizer produced from a web page, and nobody has read the paper. On
|
||||
2026-08-15 I re-pulled the five [ID] entries the litreview depends on and two
|
||||
of the five carried a wrong number, so treat the remaining 11 as roughly 2-in-5
|
||||
wrong until each is checked against raw text. Do not promote an [ID] number
|
||||
into SKILL.md or refs/ without re-pulling the paper first.
|
||||
|
||||
## "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena" — Zheng et al. (LMSYS), NeurIPS 2023 — https://arxiv.org/pdf/2306.05685
|
||||
|
||||
The canonical paper naming the bias taxonomy:
|
||||
|
||||
@@ -1,3 +1,7 @@
|
||||
Source: https://github.com/NousResearch/atropos/blob/main/README.md
|
||||
Title: Atropos, Nous Research's LLM RL Gym (repository README)
|
||||
Fetch-status: verbatim README
|
||||
|
||||
# Atropos - Nous Research's LLM RL Gym
|
||||
|
||||

|
||||
|
||||
@@ -1,3 +1,7 @@
|
||||
Source: https://github.com/allenai/OLMo-core/blob/main/README.md
|
||||
Title: OLMo-core, building blocks for OLMo modeling and training (repository README)
|
||||
Fetch-status: verbatim README
|
||||
|
||||
<div align="center">
|
||||
<!-- <img src="https://github.com/allenai/OLMo/assets/8812459/774ac485-a535-4768-8f7c-db7be20f5cc3" width="300"/> -->
|
||||
<img src="https://huggingface.co/datasets/allenai/blog-images/resolve/main/olmo2/olmo.png" alt="OLMo Logo" width="280" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
||||
|
||||
Reference in New Issue
Block a user