 Piotr Czapla
|
83427aadc6
|
Add moses with fastai preprocessing
|
2018-12-02 21:43:57 +01:00 |
|
|
Piotr Czapla
|
b9eb7388f6
|
Fix bidir for fastai tokenizer
|
2018-12-01 23:58:14 +01:00 |
|
|
Piotr Czapla
|
0c4aed6d05
|
Really fix conversion from str to Tokenzier
|
2018-12-01 16:51:21 +01:00 |
|
|
Piotr Czapla
|
e14c967cc8
|
Fix string parsing in tokenzier
|
2018-12-01 16:46:25 +01:00 |
|
|
Piotr Czapla
|
887211137a
|
Add fastai tokenizer to pretrain_lm
|
2018-12-01 16:42:11 +01:00 |
|
|
Piotr Czapla
|
c17dcce75e
|
spelling
|
2018-12-01 15:24:30 +01:00 |
|
|
Piotr Czapla
|
ab9faa2ad9
|
Clean up Fire interface.
|
2018-12-01 13:42:10 +01:00 |
|
|
Piotr Czapla
|
4b29376b44
|
Rewrite classifier to use changed pretrain_lm
|
2018-12-01 10:58:46 +01:00 |
|
|
Piotr Czapla
|
b3f5ae1ad5
|
Clean the way we save models
|
2018-12-01 10:58:23 +01:00 |
|
|
Piotr Czapla
|
6d6ebef1ca
|
Update to newst fastai
|
2018-12-01 10:57:20 +01:00 |
|
|
Piotr Czapla
|
80d4d4da29
|
Extract params to an experiment data class
You can run this as follows:
`python -m ulmfit.pretrain_lm --dir-path 'data/wiki/wikitext-2' --qrnn=True train_lm --num_epochs=1`
|
2018-11-25 12:37:45 +01:00 |
|
|
Piotr Czapla
|
eea9be09db
|
Merge pull request #6 from n-waves/bilm
Bidirectional language model + fixes to the end-to-end tests
|
2018-11-24 23:58:00 +01:00 |
|
|
Piotr Czapla
|
be117abac4
|
Make the end to end test run correctly
|
2018-11-24 23:51:23 +01:00 |
|
|
Piotr Czapla
|
8da47324c2
|
Clean ups and fixes
|
2018-11-22 15:32:40 +01:00 |
|
|
Piotr Czapla
|
dbd4884228
|
Fixes after mergin with master and updateing to newset fastai
|
2018-11-22 01:14:38 +01:00 |
|
|
Piotr Czapla
|
934fc79384
|
Merge branch 'master' into bilm
|
2018-11-21 23:48:23 +01:00 |
|
|
Piotr Czapla
|
9aa877dcd0
|
Share trained LM between different classfiication runs
|
2018-11-21 18:51:42 +01:00 |
|
|
Piotr Czapla
|
979eb196d8
|
Change the classfication training learning rate to the one that was working te best in my exp. on bidirectional clasification
|
2018-11-21 18:46:05 +01:00 |
|
|
Piotr Czapla
|
6e3ef21b1f
|
Add Avg BiClassifier
|
2018-11-21 18:44:49 +01:00 |
|
|
Piotr Czapla
|
cbed02d5e0
|
Merge branch 'master' into bilm
|
2018-11-21 18:23:54 +01:00 |
|
|
NAUSICAA\Julian
|
8cb867b066
|
Compatibility with new fastai version
|
2018-11-20 19:21:02 -03:00 |
|
|
NAUSICAA\Julian
|
79691791b3
|
Typo fix
|
2018-11-20 18:53:23 -03:00 |
|
|
Julian Eisenschlos
|
88d94f38ba
|
Merge pull request #16 from n-waves/sentencepiece_fixes
Sentencepiece Fixes
|
2018-11-20 17:14:41 -03:00 |
|
|
NAUSICAA\Julian
|
40a2990322
|
Add suggested changes to rules system
|
2018-11-20 09:06:03 -03:00 |
|
|
NAUSICAA\Julian
|
a36c0518c6
|
Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into sentencepiece_fixes
|
2018-11-20 08:55:37 -03:00 |
|
|
Aayush
|
429a3fe4c2
|
Merge pull request #13 from n-waves/models_path_fix
Models path fix, default_rules and sentencepiece support for train_clas
|
2018-11-20 12:25:25 +05:30 |
|
|
NAUSICAA\Julian
|
3b5629c0c5
|
Removing files
|
2018-11-20 00:46:04 -03:00 |
|
|
NAUSICAA\Julian
|
0ecc6342a6
|
Fixes when running sentence piece end to end
|
2018-11-20 00:38:44 -03:00 |
|
|
NAUSICAA\Julian
|
a08881180c
|
Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into polyglot-lm
|
2018-11-19 16:33:44 -03:00 |
|
|
NAUSICAA\Julian
|
470f984ca4
|
Script to merge two languages
|
2018-11-19 16:31:38 -03:00 |
|
|
Piotr Czapla
|
2bde30a402
|
Add experiment with biclassifier (concat)
|
2018-11-19 15:31:10 +01:00 |
|
|
Piotr Czapla
|
9f526a9849
|
Add experiment where wd_true is set to True.
|
2018-11-19 15:30:28 +01:00 |
|
|
Aayush
|
73403bdcb3
|
fix double EOS in read_imdb
|
2018-11-19 19:30:11 +05:30 |
|
|
Aayush
|
6e867811db
|
Support for running sentencepiece with train_clas
Committing into this branch. Only changes are in `read_xnli` and `read_imdb`.
|
2018-11-19 19:28:19 +05:30 |
|
|
Aayush
|
5ffbe8ba5c
|
add vocab_size to sentencepiece
|
2018-11-19 19:13:55 +05:30 |
|
|
Aayush
|
69ed7b4169
|
Added preliminary test scripts for sentencepiece
Other minor changes:
- Function renaming: `test_pretrain_lm` -> `test_ulmfit_default_end_to_end`
- Delete test models after completing each test.
|
2018-11-19 19:11:20 +05:30 |
|
|
Piotr Czapla
|
7f1f8efcc3
|
Working version of biclassfier
|
2018-11-19 12:58:58 +01:00 |
|
|
Piotr Czapla
|
c821d2e783
|
first version of bi classifier
|
2018-11-19 09:59:08 +01:00 |
|
|
Nirant
|
56a9feec7d
|
Removed dependency note, use requirements.txt
|
2018-11-19 12:22:41 +05:30 |
|
|
Nirant K
|
635fb1c113
|
Add prepare_xnli.py
|
2018-11-19 06:50:50 +00:00 |
|
|
NAUSICAA\Julian
|
6292412eff
|
Adding scripts to download and format RCV and Webis CLS X-Language datasets
|
2018-11-18 22:29:07 -03:00 |
|
|
Piotr Czapla
|
37b73e262f
|
Fix bug where de-all was de-100
|
2018-11-17 17:14:13 +01:00 |
|
|
Piotr Czapla
|
2674a713fc
|
fix resuming training of classifier
|
2018-11-17 17:13:15 +01:00 |
|
|
Piotr Czapla
|
e97085337e
|
Fix dropout and classification accuracy. 0.91 on imdb
|
2018-11-17 16:47:17 +01:00 |
|
|
Sebastian
|
d796610452
|
Removed deprecated default_rules
|
2018-11-17 14:48:06 +00:00 |
|
|
Sebastian
|
7fe059c9a2
|
Fixed models path for vocabulary
|
2018-11-17 14:47:27 +00:00 |
|
|
Piotr Czapla
|
e1418b2114
|
fix model dir mkdir
|
2018-11-17 00:11:56 +01:00 |
|
|
Piotr Czapla
|
5cc4bfd444
|
Add loading weights and itos, so that we can extend training
|
2018-11-16 23:48:22 +01:00 |
|
|
Piotr Czapla
|
895a58c88d
|
Merge branch 'master' into bilm
|
2018-11-16 23:39:15 +01:00 |
|
|
Piotr Czapla
|
64ad8d8fd9
|
Merge pull request #8 from n-waves/sentencepiece
[WIP] Sub-word tokenization with sentencepiece
|
2018-11-16 23:35:01 +01:00 |
|