mirror of
https://github.com/wassname/persona-steering-template-library.git
synced 2026-08-11 11:23:11 +08:00
wassname
bbfc812f45
The validator's --n flag pools all scenario sources and samples N total, so large sources dominate. For narrow axes this means most sampled scenarios don't afford the axis. Add --n-per-source: takes N from EACH family (stratified, even sampling). SKILL.md updates: - step 5: mention --n-per-source and explain pooled vs stratified - step 6: add 'test more ranked scenarios (--n-per-source 50+, more sources) and/or try stronger templates (system-prompt, red-team, jailbreak-style)' when 0 strict pass - commands: use --n-per-source in dry-run and live validation examples This fixes the root cause of the v1 honesty/credulity fumble: 50 pooled scenarios gave 0 strict pass, and the doc didn't make it obvious that --n was pooled or that the fix is stratified sampling with more scenarios.