wassname/multifit
1
0
Fork 0
mirror of https://github.com/wassname/multifit.git synced 2026-08-21 11:18:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
339 Commits 17 Branches 0 Tags
master
Commit Graph
339 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
wassname f0b19e1da6 spelling 2019-11-28 16:35:03 +08:00
wassname 8d9f6cb60c misc 2019-11-26 22:37:36 +08:00
wassname 67da707648 tidy and metrics 2019-11-26 21:03:17 +08:00
wassname 6deed0107b remove binary databunch 2019-11-26 15:49:19 +08:00
wassname 762167f5f3 draft funtions and metrics 2019-11-26 15:47:42 +08:00
wassname 46ec76ec78 multiclass (but single classes don't work) 2019-11-26 12:19:32 +08:00
wassname 7557805043 made a binary classification version making binary category label list 2019-11-26 10:17:33 +08:00
Piotr Czapla 6f1d1232b4 Add pwc badges 2019-11-12 12:50:43 +01:00
Piotr Czapla d838727d51 Merge pull request #55 from n-waves/multifit 
New scripts to train multifit that are easier to work with
 2019-11-07 09:56:48 +01:00
Piotr Czapla 7d6cacb91d Add the missing LICENSE file. 2019-11-07 09:52:29 +01:00
Piotr Czapla 26d681754f Fix spelling errors in README.md 2019-11-07 09:29:52 +01:00
Piotr Czapla c009b8e0ba Rename ulmfit to multfit to make room for future directions of the repo. 2019-11-07 09:29:36 +01:00
Piotr Czapla f29f453fa8 Merge branch 'master' into multifit 2019-11-06 11:36:54 +01:00
Piotr Czapla 59e9966fdc Update to README.md with resutls and links to example notebooks 2019-11-06 11:32:11 +01:00
Piotr Czapla 400e54dec1 Compatiblity with fastai 1.0.47 2019-11-06 10:45:48 +01:00
Piotr Czapla d85bd94241 README + requirements 2019-11-06 10:45:18 +01:00
Piotr Czapla 30993f81a3 Fix command line training & rename _learner to get_learner 
The learner has good use as a public method so there is no point in keeping it protected
 2019-11-06 10:44:29 +01:00
Piotr Czapla 8f46753195 Fix the weight decay - issue that was causing lower results on DE. 2019-11-02 09:35:13 +01:00
Piotr Czapla a47b20fcf5 Add option to turn off label smoothing eps normalisation & weight convertion New weights -> Old format 2019-11-02 09:34:40 +01:00
Piotr Czapla a4b06149b1 Expose method to get configured text processor 2019-11-02 09:32:53 +01:00
Piotr Czapla e009a02aab Update the paper_version configuration to match more closely original experiements 
- the dropouts values are changed in new fastai, we restore the orginal values
- batch size 18 in classifier works a bit better with the learning rate
- add support for gradient clipping and set it to 0.12
- divide label smoothing eps by number of classes
Further differences that werent fixed:
- different data loader and sampler the batches are a bit different (longer?)
- use of masking on padding tokenss
 2019-10-21 10:18:52 +02:00
Piotr Czapla 3c2364e3d8 Clean up bugs caused by the new tokenizer class 2019-10-21 10:04:59 +02:00
Julian Eisenschlos c9cdf09d5b Create LICENCE 2019-10-15 19:59:50 +02:00
Piotr Czapla 031e0c18eb Add diff printing during load_ 2019-10-15 16:55:15 +02:00
Piotr Czapla 70c74a1cc5 Refactor tokenization 
So that we can instantiate tokenization before we know what dataset we want to use it on. Previously it was tidly copuled.
 2019-10-15 04:17:54 +02:00
Piotr Czapla 77a2780a6b Clean up datasets 2019-10-15 00:57:40 +02:00
Piotr Czapla ad50c73377 Make ULMFiT name consistant. 2019-10-15 00:12:31 +02:00
Piotr Czapla 43f5c1282d Add sotabench scripts 2019-10-15 00:09:18 +02:00
Piotr Czapla f846bf8a4b Add OpenFIle preproc to SentencePiece preproc 2019-10-14 17:20:26 +02:00
Piotr Czapla b362f2a7cb from_pretrained 2019-10-14 17:18:28 +02:00
Piotr Czapla 5a3fbcecb5 Ability to use fastai databunch directly 2019-10-14 17:18:13 +02:00
Piotr Czapla 6336f5ebb8 Make it possible to create databunch out of dataframes 2019-10-14 13:14:07 +02:00
Piotr Czapla 91dbd9bc84 Clean up configurations 
So we use the name of function automatically
 2019-10-14 13:13:09 +02:00
Piotr Czapla 7847331751 Remove cupy from requirements.txt 
qrnn isn't using it anymore
 2019-10-14 13:11:52 +02:00
Piotr Czapla 230d31362e Merge pull request #27 from n-waves/polyglot-lm 
[WIP] Polyglot Language Model
 2019-10-08 22:16:54 +02:00
Piotr Czapla 96a870b9b9 Merge pull request #49 from cahya-wirawan/tokens_min 
a bug fix and adding minimal tokens/article to prepare_wiki.sh
 2019-10-08 21:46:33 +02:00
Piotr Czapla 1fe2bd46a6 finall clean ups 2019-10-07 14:50:03 +02:00
Cahya Wirawan 66341801c0 added question of minimal tokens/article in to prepare_wiki.sh 
changed 'fname' to 'file' in load_data function to match the current fastai version
 2019-09-11 12:49:58 +02:00
Piotr Czapla 3fe6c19af2 fix spelling eeror in finetune_lm 2019-09-08 08:43:15 +02:00
Piotr Czapla cac4df27bd Add paper version configuration and orignal ulmfit 2019-09-07 22:37:26 +02:00
Piotr Czapla c390b4ed35 Add code to JA-multifit 2019-09-07 21:47:43 +02:00
Piotr Czapla dd473aa98d Add repoduction of Multifit result for JA using newest hyper params 2019-09-07 21:18:07 +02:00
Piotr Czapla 1ff9e01766 Remove unused code 2019-09-07 21:17:32 +02:00
Piotr Czapla ee7c23a3be Remove old multifit logs 2019-09-07 19:12:44 +02:00
Piotr Czapla 02ee52d0ef Update README.md 2019-09-07 19:11:52 +02:00
Piotr Czapla 26e54a9c7d Use the pervious datset_path from finetuning for classsificator training 2019-09-07 19:11:29 +02:00
Piotr Czapla 2cdf380adf New bolerplate code 2019-09-07 16:19:09 +02:00
Piotr Czapla 8162cc5648 Clean up the old multfit training code 2019-09-07 15:22:01 +02:00
Piotr Czapla 2fe5c8a588 Update to fastai v1.0.57 - use new sentence piece implementaiton & sizes of hidden layers 2019-08-29 15:51:17 +02:00
Piotr Czapla 68d6b1c829 fix bug in the hack for poleval reddit 2019-06-10 20:31:04 +02:00