Marcin
b609951561
Fix path of pretrained model
2019-02-14 00:00:56 +01:00
Marcin
9d893e393b
Add QRNN results
2019-02-14 00:00:43 +01:00
Marcin Kardas
f95a16cee1
Merge pull request #34 from n-waves/use-configs
...
Use configs
2019-02-13 22:58:47 +01:00
Piotr Czapla
1340f4235c
Improve ulmfit eval to allow for zeroshot laser evaluation
2019-02-13 15:29:55 +01:00
Piotr Czapla
b14a393671
Add more results including full zeroshot results
2019-02-13 15:29:16 +01:00
NAUSICAA\Julian
4215111240
jp -> ja
2019-02-13 10:50:01 -03:00
NAUSICAA\Julian
e657423e7f
CLS Download Script
2019-02-13 10:41:24 -03:00
Marcin
0e2211dfaf
Merge branch 'master' into use-configs
2019-02-13 14:10:59 +01:00
Marcin
2eee051c67
Expose max length parameter
2019-02-13 13:40:05 +01:00
Piotr Czapla
3586a7dcf9
Merge branch 'pr/29'
2019-02-12 20:43:44 +01:00
NAUSICAA\Julian
866d0c0bed
Addiing XLingual LM
2019-02-12 12:52:12 -03:00
Piotr Czapla
4e1b76feee
Add MLDoc summary & zeroshot logs
2019-02-12 15:01:42 +01:00
Piotr Czapla
e72cdfb6db
Add result logs (it)
2019-02-12 15:01:22 +01:00
Piotr Czapla
e7271f2a29
Add ability to evalulate multiple models at once
2019-02-12 15:01:01 +01:00
Piotr Czapla
a1e7a79b57
Add result logs
2019-02-12 15:00:29 +01:00
Marcin
8497cc1e5c
Move LM and classifier parameters to configs
2019-02-12 03:09:51 +01:00
Piotr Czapla
a630242f97
Expose validate_cls in ulmfit module
2019-02-11 11:01:08 +01:00
Piotr Czapla
c63fe258d2
Fix validataion and add option to add noise to training labels
2019-02-11 10:53:25 +01:00
Piotr Czapla
22e40d81f3
Additional DE results and first results on FR and JA
2019-02-11 10:51:42 +01:00
Piotr Czapla
e7ec9f0233
fix markdown formatting
2019-02-10 10:52:03 +01:00
Piotr Czapla
07ab9ccaf8
Add first MLDoc results
2019-02-10 09:53:42 +01:00
Piotr Czapla
672ef2d59f
Remove old result logs
2019-02-10 09:53:26 +01:00
Piotr Czapla
26736d95de
Add code to test & train mldoc classifier
2019-02-10 09:52:58 +01:00
Tomasz Pietruszka
950daac903
Merge branch 'backwards-lm'
2019-01-23 00:08:22 +01:00
Tomasz Pietruszka
c6cf44a7b9
Fixed test_bilm_classifier_loads_encoder - inconsistent settings, problematic input (too short)
2019-01-23 00:05:45 +01:00
Tomasz Pietruszka
386fc49431
Adapted test_text_data to batch dimension being the first, and only xxbos token at the start
2019-01-22 20:31:30 +01:00
Tomasz Pietruszka
0e864fb291
test_end_to_end now working, added instructions to README, sentencepiece dependency
2019-01-22 20:10:38 +01:00
Tomasz Pietruszka
6fa30829c4
Merge branch 'master' into backwards-lm
2019-01-14 17:20:48 +01:00
Tomasz Pietruszka
dd296f3088
prepare_wiki.sh made executable
2019-01-13 17:30:35 +01:00
Tomasz Pietruszka
5ba8ae4c59
non-ascii char removed from code. Caused display bugs
2019-01-13 17:29:55 +01:00
Tomasz Pietruszka
b00410e0cb
LM save with_opt fix
2019-01-13 17:28:39 +01:00
Tomasz Pietruszka
a1e66c39d4
tokenzier->tokenizer typo
2019-01-13 17:27:29 +01:00
Tomasz Pietruszka
593c5661bf
Added alpha and beta params for RNNTrainer
2019-01-13 17:26:16 +01:00
Tomasz Pietruszka
e6407fe0c9
Added the param and model type for BwdLM
2019-01-10 00:47:22 +01:00
NAUSICAA\Julian
0e2e058b82
Simplify finetuning using new helper methods
2019-01-03 17:02:56 -03:00
NAUSICAA\Julian
39d38f0f46
Restore newline
2019-01-03 09:40:31 -03:00
NAUSICAA\Julian
0856d33fa8
Merge issues
2019-01-03 09:35:17 -03:00
NAUSICAA\Julian
3f91460dc8
Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into polyglot-lm
2019-01-03 09:30:54 -03:00
Piotr Czapla
0085c18ae0
Fix splitting by article for local languages and make it more memory efficient
...
The issue was that the code assumed that empty lines have space followed by a new line, which isn't the case for datasets generated by our scripts.
2019-01-03 12:16:41 +01:00
NAUSICAA\Julian
52702e32ae
Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into polyglot-lm
2019-01-02 18:41:07 -03:00
Piotr Czapla
8a2fed41c5
Merge pull request #18 from n-waves/refactor
...
[WIP] Refactoring #17
2019-01-01 15:13:57 +01:00
Piotr Czapla
f784d7bcd2
Make the article detection code work with our wikitext
2019-01-01 15:13:14 +01:00
Piotr Czapla
0945c699c7
Fixes #25 by adding article title in markdown format to wiki text
2019-01-01 15:07:02 +01:00
Piotr Czapla
4a858f3572
Simplfy and unify input data parsing
2019-01-01 14:43:12 +01:00
Piotr Czapla
d269d53d7d
Use fastai tokens instead of <xxx>
...
f'xx{token_name}' are kept as one token by Moses tokenizer, which is sometimes required if you want to have moses in tokenizers pipeline, and we use that for imdb.
2019-01-01 14:40:59 +01:00
NAUSICAA\Julian
9d529b1fb6
Merge branch 'refactor' of https://github.com/n-waves/ulmfit-multilingual into polyglot-lm
2018-12-31 11:35:25 -03:00
Piotr Czapla
514a9e6b86
Fix BiLM training after update to newest fastai
2018-12-31 12:13:53 +01:00
NAUSICAA\Julian
6780559b46
Dataset name
2018-12-29 17:13:38 -03:00
NAUSICAA\Julian
b78a2ebaad
Fixing typo
2018-12-29 17:12:38 -03:00
Julian Eisenschlos
30565a2148
Remove bad imports
2018-12-29 20:09:46 +00:00
Marcin