wassname/Open-Assistant
1
0
Fork 0
mirror of https://github.com/wassname/Open-Assistant.git synced 2026-06-27 16:10:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
main
Open-Assistant/model/supervised_finetuning/custom_datasets/README.md
T
Kian-Meng Ang 1e321a6fca Fix typos (#1143) 
Found via `codespell -S .mypy_cache,yarn.lock,*.json,*.ipynb -L
rouge,nam,vie`
2023-02-05 20:18:03 +01:00

569 B
Raw Permalink Blame History

Dataset collections overview:

currently dataset can be divided into 3 classes

  • language knowledge

    • summarization

    • translation

  • dialogue : don't let user know you are a robot

  • STEM : knowledge about the world

    • coding

    • world knowledge <= ideally we want to handle this via prefix context

Issues and TODO:

  • as dataset are growing, how can we update this section less

  • ideally we can update the config yaml and new dataset will be download from hub

    • one possible idea is we upload the transform format of these dataset to the OA hub
Reference in New Issue View Git Blame Copy Permalink