wassname/multifit
1
0
Fork 0
mirror of https://github.com/wassname/multifit.git synced 2026-09-01 12:21:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
180 Commits 17 Branches 0 Tags
cls
Commit Graph
180 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
NAUSICAA\Julian 1ee1dd950d Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual into cls 2019-02-16 16:24:01 -03:00
Julian Eisenschlos b7e3a5e7a4 Update BERT Zero-shot results 2019-02-16 14:42:40 -03:00
Julian Eisenschlos be0511e42b Adding Bert results 2019-02-15 15:51:35 -03:00
Piotr Czapla 8733487d55 Make the validate vs train decision based on the existance of cls_last.pth istead of a model directory 2019-02-15 01:17:53 +01:00
Piotr Czapla 5dced1e488 Remove bidir 2019-02-15 01:16:37 +01:00
Piotr Czapla 5e44e442b2 Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual 2019-02-15 01:11:42 +01:00
Piotr Czapla 0e6534ad7b Expose num_lm_epochs in ulmfit eval 2019-02-15 01:11:39 +01:00
Marcin 22cb8b1660 Download pretrained models 2019-02-15 00:02:04 +01:00
Piotr Czapla 0f084168c1 Merge branch 'master' of https://github.com/n-waves/ulmfit-multilingual 2019-02-14 22:35:29 +01:00
Piotr Czapla cd47b3b5dc Fix use_moses=True for mldoc so that it is identical to wiki with uses_moses=False 
The issue was that Moses was executed after pre_rules when use_moses = True, But when data set was pre tokenized with Moses (use_moses=False) the pre_rules were executed  after.
So our wikipedia had the following processing:
- raw text
- Moses
- pre_rules
- split(' ') # fastai BaseTokenizer
- post_rules
- sentence piece

While mldoc had the following tokenziation
- raw text
- pre_rules
- Moses
- post_rules
- sentence piece

After fix I've retrained the classfiers (without finetuning) and I haven't notice huge changes in the performance. 4 languages received slight improvment 4 got a slight decrease in performance.
 2019-02-14 22:35:20 +01:00
Piotr Czapla c28c0fde16 Make ulmfit eval more secure and give more flexibility in dataset_template 
The dataset_template can use lang as additional token to construct globs patterns.
 2019-02-14 22:28:25 +01:00
Marcin 6fda7f2cda Download preprocessed wikis 2019-02-14 16:45:51 +01:00
Marcin fdac9f7ccd Save only the best LM model 2019-02-14 14:01:33 +01:00
Marcin 72e86cefc9 Add QRNN LM results for Italian 2019-02-14 12:48:04 +01:00
Marcin 0535ef169a QRNN mldoc results for de, en and es 2019-02-14 11:05:02 +01:00
Marcin b609951561 Fix path of pretrained model 2019-02-14 00:00:56 +01:00
Marcin 9d893e393b Add QRNN results 2019-02-14 00:00:43 +01:00
Marcin Kardas f95a16cee1 Merge pull request #34 from n-waves/use-configs 
Use configs
 2019-02-13 22:58:47 +01:00
Piotr Czapla 1340f4235c Improve ulmfit eval to allow for zeroshot laser evaluation 2019-02-13 15:29:55 +01:00
Piotr Czapla b14a393671 Add more results including full zeroshot results 2019-02-13 15:29:16 +01:00
NAUSICAA\Julian 4215111240 jp -> ja 2019-02-13 10:50:01 -03:00
NAUSICAA\Julian e657423e7f CLS Download Script 2019-02-13 10:41:24 -03:00
Marcin 0e2211dfaf Merge branch 'master' into use-configs 2019-02-13 14:10:59 +01:00
Marcin 2eee051c67 Expose max length parameter 2019-02-13 13:40:05 +01:00
Piotr Czapla 3586a7dcf9 Merge branch 'pr/29' 2019-02-12 20:43:44 +01:00
Piotr Czapla 4e1b76feee Add MLDoc summary & zeroshot logs 2019-02-12 15:01:42 +01:00
Piotr Czapla e72cdfb6db Add result logs (it) 2019-02-12 15:01:22 +01:00
Piotr Czapla e7271f2a29 Add ability to evalulate multiple models at once 2019-02-12 15:01:01 +01:00
Piotr Czapla a1e7a79b57 Add result logs 2019-02-12 15:00:29 +01:00
Marcin 8497cc1e5c Move LM and classifier parameters to configs 2019-02-12 03:09:51 +01:00
Piotr Czapla a630242f97 Expose validate_cls in ulmfit module 2019-02-11 11:01:08 +01:00
Piotr Czapla c63fe258d2 Fix validataion and add option to add noise to training labels 2019-02-11 10:53:25 +01:00
Piotr Czapla 22e40d81f3 Additional DE results and first results on FR and JA 2019-02-11 10:51:42 +01:00
Piotr Czapla e7ec9f0233 fix markdown formatting 2019-02-10 10:52:03 +01:00
Piotr Czapla 07ab9ccaf8 Add first MLDoc results 2019-02-10 09:53:42 +01:00
Piotr Czapla 672ef2d59f Remove old result logs 2019-02-10 09:53:26 +01:00
Piotr Czapla 26736d95de Add code to test & train mldoc classifier 2019-02-10 09:52:58 +01:00
Tomasz Pietruszka 950daac903 Merge branch 'backwards-lm' 2019-01-23 00:08:22 +01:00
Tomasz Pietruszka c6cf44a7b9 Fixed test_bilm_classifier_loads_encoder - inconsistent settings, problematic input (too short) 2019-01-23 00:05:45 +01:00
Tomasz Pietruszka 386fc49431 Adapted test_text_data to batch dimension being the first, and only xxbos token at the start 2019-01-22 20:31:30 +01:00
Tomasz Pietruszka 0e864fb291 test_end_to_end now working, added instructions to README, sentencepiece dependency 2019-01-22 20:10:38 +01:00
Tomasz Pietruszka 6fa30829c4 Merge branch 'master' into backwards-lm 2019-01-14 17:20:48 +01:00
Tomasz Pietruszka dd296f3088 prepare_wiki.sh made executable 2019-01-13 17:30:35 +01:00
Tomasz Pietruszka 5ba8ae4c59 non-ascii char removed from code. Caused display bugs 2019-01-13 17:29:55 +01:00
Tomasz Pietruszka b00410e0cb LM save with_opt fix 2019-01-13 17:28:39 +01:00
Tomasz Pietruszka a1e66c39d4 tokenzier->tokenizer typo 2019-01-13 17:27:29 +01:00
Tomasz Pietruszka 593c5661bf Added alpha and beta params for RNNTrainer 2019-01-13 17:26:16 +01:00
Tomasz Pietruszka e6407fe0c9 Added the param and model type for BwdLM 2019-01-10 00:47:22 +01:00
Piotr Czapla 0085c18ae0 Fix splitting by article for local languages and make it more memory efficient 
The issue was that the code assumed that empty lines have space followed by a new  line, which isn't the case for datasets generated by our scripts.
 2019-01-03 12:16:41 +01:00
Piotr Czapla 8a2fed41c5 Merge pull request #18 from n-waves/refactor 
[WIP] Refactoring #17
 2019-01-01 15:13:57 +01:00