mirror of
https://github.com/wassname/multifit.git
synced 2026-08-22 12:10:15 +08:00
3fe6c19af2309edaf7a8b6e67feb891dc2e6e247
Retraining a multifit model from wikipedia
The whole training process from wikipedia to mldoc can be run as follows:
python -m ulmfit new multifit_fp16 \
pretrain-lm train- data/wiki/de-100 - \
finetune-lm train- data/mldoc/de-1 - \
classifier train- data/mldoc/de-1
You can evaulate any model with the following command:
python -m ulmfit load data/mldoc/de-1/models/fsp15k/multfit_fp16 classifier validate data/mldoc/de-1
Description
The code to reproduce results from paper "MultiFiT: Efficient Multi-lingual Language Model Fine-tuning" https://arxiv.org/abs/1909.04761
1.5 MiB
Languages
Jupyter Notebook
67.3%
Python
31.1%
Shell
1.6%