From dca502a398bc3edec1c4a3639dda96f10af409e3 Mon Sep 17 00:00:00 2001 From: Piotr Czapla Date: Wed, 12 Dec 2018 00:31:48 +0100 Subject: [PATCH] Add docs how to train a classfier --- README.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/README.md b/README.md index 6b65884..a04fca8 100644 --- a/README.md +++ b/README.md @@ -1,6 +1,18 @@ # ulmfit-multilingual Temporary repository used for collaboration on application of for multiple languages. +# How to train classifier + +``` +$ python -m ulmfit lm --dataset-path data/wiki/wikitext-103 --bidir=False --qrnn=False --tokenizer=vf --name 'bs40' --bs=40 --cuda-id=0 - train 20 --drop-mult=0.9 +... +Model dir: data/wiki/wikitext-103/models/vf60k/lstm_bs40.m +... +$ python -m ulmfit cls --dataset-path data/imdb --base-lm-path data/wiki/wikitext-103/models/vf60k/lstm_bs40.m - train 20 +``` + + + ## data directory strucutre Directory structure after changes to the way we process wiki dumps.