mirror of
https://github.com/wassname/Open-Assistant.git
synced 2026-07-01 16:50:12 +08:00
Sotirios Anagnostidis
39 lines
685 B
Markdown
39 lines
685 B
Markdown
# Train using supervised examples
|
|
|
|
Requirements
|
|
|
|
```
|
|
wandb
|
|
evaluate
|
|
datasets
|
|
transformers
|
|
torch
|
|
```
|
|
|
|
Start training reward model
|
|
|
|
```bash
|
|
python trainer.py --configs defaults galactica-125
|
|
```
|
|
|
|
## Dataset
|
|
|
|
For now we only support webgpt and summary dataset from OpenAI. Once
|
|
open-asisstant dataset are available it will be added here.
|
|
|
|
## Model
|
|
|
|
TBD
|
|
|
|
## Results
|
|
|
|
Experimental results in wandb
|
|
[here](https://wandb.ai/sanagnos/supervised-finetuning?workspace=user-sanagnos).
|
|
|
|
## TODOS
|
|
|
|
- decide on a model
|
|
- Merge utils etc with reward model
|
|
- Casual Modelling for GPT-JT does not leverage the bidirectional mask for the
|
|
prompt? (https://huggingface.co/togethercomputer/GPT-JT-6B-v1)
|