scenario_sources: add capped source scenario samples

This commit is contained in:
wassname
2026-06-30 08:48:51 +08:00
parent 76d8fde10b
commit 488dc1c1c3
8 changed files with 9259 additions and 8498 deletions
@@ -75,7 +75,7 @@ uv run python scripts/sync_template_library.py --check
Export scenarios from source loaders:
```sh
uv run python scenario_sources/export_scenarios.py --sources machiavelli
uv run python scenario_sources/export_scenarios.py --sources all --limit 1999
```
Dry-run validation:
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
+4 -4
View File
@@ -10,16 +10,16 @@ long; its committed cache is `scenario_sources/data/machiavelli_summaries.jsonl`
and the published derived dataset is
[`wassname/machiavelli_character_scenarios`](https://huggingface.co/datasets/wassname/machiavelli_character_scenarios).
Generate local scenario files:
Generate local scenario samples for validation:
```sh
uv run python scenario_sources/export_scenarios.py --sources machiavelli
uv run python scenario_sources/export_scenarios.py --sources all --limit 1999
```
Generate from every loader when the source datasets are available:
Generate a single source:
```sh
uv run python scenario_sources/export_scenarios.py --sources all
uv run python scenario_sources/export_scenarios.py --sources machiavelli --limit 1999
```
Screen a generated file before using it for steering pairs: