Commit Graph
223 Commits
Author SHA1 Message Date
Piotr Czapla 94be5e6e0f Remove unused tests
Skip the test that were developed to support BiLM training that due to the changes in fastai stopped compiling
2019-04-14 19:19:12 +02:00
Piotr Czapla 8facc21cfa Add F1 metrics to evaluate 2019-04-14 19:13:43 +02:00
Piotr Czapla a948d7df91 Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual 2019-03-26 21:29:33 +01:00
Piotr Czapla 0a823be17b Maki ti possible to not load unusp 2019-03-26 21:29:23 +01:00
Piotr Czapla 24f1d741f0 Add generating of pseudo labels 2019-03-26 21:27:56 +01:00
Piotr Czapla 66ec30a122 Add more results 2019-03-26 21:27:18 +01:00
Julian Eisenschlos 7744021014 Merge pull request #40 from n-waves/text_cols
Using Text Cols as opposed to concatenating columns manually
2019-03-07 13:28:00 -03:00
NAUSICAA\Julian 43588b43e1 Move logs 2019-03-07 13:19:40 -03:00
NAUSICAA\Julian 227f3b5dff Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into text_cols 2019-03-07 13:18:52 -03:00
Piotr Czapla 837925ff53 Imporved validate_cls & eval to pick the best model based on val accuracy 2019-03-03 13:29:49 +01:00
Julian Eisenschlos e793425ef7 Merge pull request #37 from n-waves/qrnn_perf
QRNN Time Performance Benchark
2019-03-01 18:06:13 -03:00
Piotr Czapla 7b2ac9e94b Add ability to use random-init=True 2019-03-01 17:41:07 +01:00
Piotr Czapla 11b2b14523 Fix -m ulmfit tar method 2019-03-01 17:39:58 +01:00
NAUSICAA\Julian 02522fcd44 Rename file 2019-02-28 08:17:41 -03:00
NAUSICAA\Julian 71e7637dd0 CLS Results 2019-02-27 23:44:28 -03:00
NAUSICAA\Julian fd022c6826 Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into text_cols 2019-02-27 23:30:59 -03:00
Piotr Czapla 4742a68d28 Some logs from previous experiments 2019-02-27 20:31:38 +01:00
Marcin f750586114 Remove redundant bptt param 2019-02-26 18:39:38 +01:00
Piotr Czapla c6e0373170 Make models use bptt parameter 2019-02-26 18:06:23 +01:00
NAUSICAA\Julian dd74a6d282 Remove previous multi field patch 2019-02-24 23:15:20 -03:00
NAUSICAA\Julian 06cd4d4d0b Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into text_cols 2019-02-24 22:58:46 -03:00
Piotr Czapla 852336c29b Merge pull request #38 from n-waves/lbl_smoothing
Label smoothing
2019-02-22 16:57:47 +01:00
Piotr Czapla 260faa703c Correct the label smoothing implementation 2019-02-22 16:55:35 +01:00
Piotr Czapla 015f04ec08 Training with noise & label smoothing 2019-02-22 12:02:18 +01:00
Piotr Czapla c69d31c420 New results lstm 30k 1cyc 2019-02-22 12:01:25 +01:00
NAUSICAA\Julian c5a93d19fe Changes moved to different branch 2019-02-20 17:16:08 -03:00
NAUSICAA\Julian 61ae344fda Remove fastai warning 2019-02-20 17:02:56 -03:00
NAUSICAA\Julian c698c97772 Adding logs 2019-02-20 17:02:02 -03:00
NAUSICAA\Julian b39fb5390b Adding QRNN benchmark 2019-02-20 15:21:58 -03:00
NAUSICAA\Julian 4700d95225 Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into qrnn_perf 2019-02-20 15:16:31 -03:00
Piotr Czapla 99d6b22447 Correct noise generation training + convenience functions 2019-02-20 10:24:30 +01:00
Piotr Czapla c29180a08f Add some results 2019-02-20 10:22:44 +01:00
NAUSICAA\Julian 13ae29a95d Set mark_fields in True 2019-02-18 22:20:24 -03:00
Piotr Czapla 5529ec385b Add sentence piece char_coverage 0.99 for non european languages
Otherwise Zh won't train on 15k
2019-02-18 21:50:46 +01:00
Piotr Czapla 7dc7aac327 Merge all columns in classification task into first column
This should fix CLS issues.
2019-02-18 21:50:04 +01:00
Piotr Czapla 9fbcf56df3 Add different learning schedules, with default to the old schedule
use --lr-sched=1cycle for better results
2019-02-18 21:49:16 +01:00
NAUSICAA\Julian 458c06f779 Fix df name 2019-02-18 17:05:11 -03:00
NAUSICAA\Julian dbb929e3ca Adding more text cols to use all CLS data 2019-02-18 16:54:00 -03:00
Piotr Czapla ce6cc607ae Add saving itos.pkl so that the LM can be used to finetuning 2019-02-17 23:18:42 +01:00
Piotr Czapla c3276da062 Fixing Imdb loading 2019-02-17 23:18:12 +01:00
Piotr Czapla 119417fb6e Disable early stopping as it was causing OOMs 2019-02-17 23:04:25 +01:00
Piotr Czapla 490c792278 Upgrade to the recent the todays version of Fastai 2019-02-17 23:03:54 +01:00
Piotr Czapla 0dda4b4c2c Zeroshot MLDoc results for ulmfit trained on 10k examples 2019-02-17 19:03:02 +01:00
NAUSICAA\Julian 1ee1dd950d Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into cls 2019-02-16 16:24:01 -03:00
Julian Eisenschlos b7e3a5e7a4 Update BERT Zero-shot results 2019-02-16 14:42:40 -03:00
Julian Eisenschlos be0511e42b Adding Bert results 2019-02-15 15:51:35 -03:00
Piotr Czapla 8733487d55 Make the validate vs train decision based on the existance of cls_last.pth istead of a model directory 2019-02-15 01:17:53 +01:00
Piotr Czapla 5dced1e488 Remove bidir 2019-02-15 01:16:37 +01:00
Piotr Czapla 5e44e442b2 Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual 2019-02-15 01:11:42 +01:00
Piotr Czapla 0e6534ad7b Expose num_lm_epochs in ulmfit eval 2019-02-15 01:11:39 +01:00