wassname/Open-Assistant
1
0
Fork 0
mirror of https://github.com/wassname/Open-Assistant.git synced 2026-06-27 16:10:30 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge branch 'main' into pre-commit-jupyter-black

Browse Source
This commit is contained in:
Janosh Riebesell
2023-01-03 06:42:40 -08:00
committed by GitHub
parent 3740e38342 e7515fd08e
commit 731477e2e3
76 changed files with 6275 additions and 1159 deletions
Download Patch File Download Diff File Expand all files Collapse all files
notebooks/data-argumentation/EssayRevision.ipynb
+1 -300
View File
File diff suppressed because one or more lines are too long
notebooks/detoxify-evaluation/README.md
+7 -4
View File
@@ -24,10 +24,13 @@ only described in the notebook
Charts showing detailed memory usages and times for different sentence lengths
and batch sizes are inside the notebook Quick overview batch size 16, sentence
length 4k for training, batch size 128 sentence length 4k for inference | Model
name | Training memory| Training speed | Inference Memory| Inference Speed| |
:---: | :---: | :---: |:---: | :---: | |original| 11.8GB | 2.40s| 4.8GB|16.48s|
|unbiased| 12GB| 1.09s| 4.8GB | 5.59s| |multilingual|14GB| 1.00s| 5.5GB| 4.89s|
length 4k for training, batch size 128 sentence length 4k for Inference
| Model name | Training memory | Training speed | Inference Memory | Inference Speed |
| :----------: | :-------------: | :------------: | :--------------: | :-------------: |
| original | 11.8GB | 2.40s | 4.8GB | 16.48s |
| unbiased | 12GB | 1.09s | 4.8GB | 5.59s |
| multilingual | 14GB | 1.00s | 5.5GB | 4.89s |
# Filtering quality