mirror of
https://github.com/wassname/ml_debug.git
synced 2026-09-09 11:27:07 +08:00
follow the skill spec: references/ not refs/, and namespaced subskill names
- refs/ -> references/, the folder name the Agent Skills spec uses and the one Hermes skips when it walks for nested skills. - rl and pinn declared name: rl and name: pinn, which are global names in a flat skill namespace. Now ml-debug-rl and ml-debug-pinn. They also called themselves sub-skills of 'ml-debugging', which is not this skill's name. - Drop the dead link to SKILL_old.md. It moved into gitignored slop/, so the link was broken for anyone who cloned. - Route references/llm_judge_litreview.md, the one reference SKILL.md never named. - Description leads with the trigger situations. Hermes truncates it to 57 chars. Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
This commit is contained in:
@@ -12,7 +12,7 @@ summarizer produced from a web page, and nobody has read the paper. On
|
||||
2026-08-15 I re-pulled the five [ID] entries the litreview depends on and two
|
||||
of the five carried a wrong number, so treat the remaining 11 as roughly 2-in-5
|
||||
wrong until each is checked against raw text. Do not promote an [ID] number
|
||||
into SKILL.md or refs/ without re-pulling the paper first.
|
||||
into SKILL.md or references/ without re-pulling the paper first.
|
||||
|
||||
## "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena" — Zheng et al. (LMSYS), NeurIPS 2023 — https://arxiv.org/pdf/2306.05685
|
||||
|
||||
|
||||
@@ -2,7 +2,7 @@ Source: https://arxiv.org/pdf/2411.00640 (Evan Miller, Anthropic, Nov 2024) + ht
|
||||
Title: Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations
|
||||
Fetched-via: r.jina.ai on the arXiv PDF and the Anthropic post, 2026-08-16
|
||||
Fetch-status: verbatim from full PDF text (math notation mangled by the PDF-to-markdown pass; prose is clean)
|
||||
Used-by: refs/llm_judges.md (repeat draws, temperature, paired differences)
|
||||
Used-by: references/llm_judges.md (repeat draws, temperature, paired differences)
|
||||
|
||||
# Adding Error Bars to Evals (excerpts)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user