wassname/Open-Assistant
1
0
Fork 0
mirror of https://github.com/wassname/Open-Assistant.git synced 2026-06-27 16:10:30 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge branch 'main' of github.com:LAION-AI/Open-Assistant

Browse Source
This commit is contained in:
Yannic Kilcher
2023-02-10 23:32:58 +01:00
parent 097c918cb9 bfccb51142
commit 76f7af0dfd
3 changed files with 7343 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/data-augmentation/writing-prompt/.ipynb_checkpoints/writing_prompt-checkpoint.ipynb
+3707
View File
File diff suppressed because it is too large Load Diff
notebooks/data-augmentation/writing-prompt/README.md
+17
View File
@@ -0,0 +1,17 @@
# Writing Prompt
Writing prompt folder has a notebook that entails the pipeline to take samples
of [Writing Prompt](https://www.kaggle.com/datasets/ratthachat/writing-prompts)
dataset and augment that collection with some small transformations into a
prompt, having the same story as a response.
This process required the summarization of text that was executed by one A100
GPU running [T5](pszemraj/long-t5-tglobal-base-16384-book-summary) model.
The sample created was delivered at
[Hugging Face dataset](https://huggingface.co/datasets/fabraz/writingPromptAug/),
where you will find more details.
## Contributing
Feel free to contribute to this notebook.
notebooks/data-augmentation/writing-prompt/writing_prompt.ipynb
+3619
View File
File diff suppressed because it is too large Load Diff