multifit/ulmfit/datasets/__init__.py at 031e0c18ebdfdc5f0e86fc17d31bb6e829bc7628 - multifit - Gitea: Git with a cup of tea

wassname/multifit

0 Fork 0

mirror of https://github.com/wassname/multifit.git synced 2026-10-30 13:30:16 +08:00

Files

T

Piotr Czapla 70c74a1cc5 Refactor tokenization

So that we can instantiate tokenization before we know what dataset we want to use it on. Previously it was tidly copuled.

2019-10-15 04:17:54 +02:00

1 line

95 B

Python

Raw Blame History

from .dataset import Dataset, ULMFiTDataset, read_clas_csv, read_wiki_articles, ULMFiTTokenizer