Commit Graph
3 Commits
Author SHA1 Message Date
Piotr Czapla 70c74a1cc5 Refactor tokenization
So that we can instantiate tokenization before we know what dataset we want to use it on. Previously it was tidly copuled.
2019-10-15 04:17:54 +02:00
Piotr Czapla 77a2780a6b Clean up datasets 2019-10-15 00:57:40 +02:00
Piotr Czapla 43f5c1282d Add sotabench scripts 2019-10-15 00:09:18 +02:00