wassname/Open-Assistant
1
0
Fork 0
mirror of https://github.com/wassname/Open-Assistant.git synced 2026-08-17 11:13:32 +08:00
Code Issues Packages Projects Releases Wiki Activity

Merge branch 'main' into add-dataset

Browse Source
This commit is contained in:
theblackcat102
2023-02-09 01:28:42 +00:00
parent 2c35ff6e50 27671e3220
commit a1b90bf981
328 changed files with 9512 additions and 1937 deletions
Download Patch File Download Diff File Expand all files Collapse all files
model/supervised_finetuning/custom_datasets/README.md
+1 -1
View File
@@ -23,5 +23,5 @@ Issues and TODO:
- ideally we can update the config yaml and new dataset will be download from
hub
- one possible idea is we upload the trasform format of these dataset to the
- one possible idea is we upload the transform format of these dataset to the
OA hub
model/supervised_finetuning/custom_datasets/qa_datasets.py
+1 -1
View File
@@ -316,7 +316,7 @@ class JokeExplaination(Dataset):
for line in f:
data = json.loads(line)
joke = data["joke"]
explanation = data["explaination"]
explanation = data["explanation"]
self.pairs.append((joke, explanation))
if len(question) > 0 and len(answer) > 0: