Victor Yang
5afb845a4b
Add PIT2015 dataset ( #141 )
...
* add prediction/qrel files dump option
* fix comment
* upgrade to torchtext 0.3
* remove ngram
* update device
* minor update
* add pit2015
* revert update torchtext
* revert update torchtext
* revert update torchtext
2018-08-12 18:56:08 -04:00
Michael Tu
8a00f9cdcd
Make Kim CNN ONNX-exportable ( #136 )
...
* Kim CNN - only set embedding for corresponding mode
* Kim CNN ONNX Export
* Specify dummy ONNX input size from command line
2018-08-04 17:30:24 -04:00
Michael Tu
82bf90f4bb
Tune Kim CNN for SST-2 and Improve SST-1 Results with Dataset/Initialization Changes ( #133 )
...
* SST change min_freq and Kim CNN init distribution
* Add tuned results for SST-1 and SST-2
* Fix typo
2018-07-11 22:08:26 -04:00
Ralph Tang
5ff980d120
Add Apache 2.0 license ( #132 )
2018-07-10 22:06:55 -04:00
Michael Tu
8563ad5976
Kim CNN OOP Refactoring ( #124 )
...
* Nuke obsolete artifacts
* Refactor Kim CNN
* Make kim_cnn a module
* Fix bugs
* Update README
* Add choices to dataset arg
* update for sst2
update sst.py
update sst.py
* Add Kim CNN dataset choices to args.py
* Update tuned SST-1 accuracy
2018-07-03 16:42:31 -04:00
Linqing Liu
fae229eba4
Update VDPWI README with new results ( #131 )
...
- Update with results on SICK, TrecQA, and WikiQA datasets
2018-07-03 09:37:18 -04:00
Linqing Liu
a4e847725c
Change default hyperparameters for VDPWI ( #130 )
...
- Default hyperparameters on SICK now use different batch size, RNN hidden dimension, learning rate, optimizer, and number of epochs.
2018-06-27 15:00:42 -04:00
Ralph Tang
e4149ff400
Use PackedSequence for ConvRNN ( #126 )
...
* Use PackedSequence in ConvRNNs instead
- Zero-padding is incompatible with the current model
* Update test script
* Clean up comments and logic
* Add TQDM to requirements
* Add results using default hyperparameters
2018-06-24 09:48:16 -04:00
Michael Tu
2f7731b4d5
Update data path ( #127 )
2018-06-23 23:55:42 -04:00
Victor Yang
921a45e7ca
add storing prediction/qrel files option for test set ( #125 )
...
* add prediction/qrel files dump option
* fix comment
2018-06-18 20:43:40 -04:00
Michael Tu
5cc027f03e
Create Castor-level SST dataset ( #123 )
...
* Move SST to root directory datasets
* Fix bugs
2018-06-09 17:32:32 -04:00
Ralph Tang
cb9fad9f97
Make ConvRNN compatible with PyTorch 0.4 ( #122 )
2018-06-07 20:40:40 -04:00
Jimmy Lin
90dc6af78c
Update README.md ( #120 )
2018-05-27 09:19:58 -04:00
Jimmy Lin
e9c011b421
Update README.md ( #119 )
2018-05-27 09:18:02 -04:00
Jimmy Lin
bc74ae6531
Update README.md
2018-05-27 07:07:35 -04:00
Jimmy Lin
c59739488c
Update README.md
2018-05-27 07:06:32 -04:00
Jimmy Lin
97a76495fd
Update requirements.txt ( #116 )
2018-05-26 22:53:26 -04:00
Jimmy Lin
3b426c1c25
Update README.md ( #117 )
2018-05-26 22:05:54 -04:00
Jimmy Lin
bc58fc7607
Update README.md ( #115 )
2018-05-26 18:37:24 -04:00
Michael Tu
5bf33bf8ea
Update README to use Castor-models and Instructions for Internal Users ( #113 )
...
* Update instructions to use Castor-models
* Consolidate requirements.txt
* Refine README with convenience scripts
* Update internal instructions
* MP-CNN working dir minor edit
2018-05-25 18:14:10 -04:00
Ralph Tang
62f8abec7f
Add README ( #110 )
...
* Make *QA/MSRVID work with VDPWI
* Add README
2018-05-25 11:52:25 -04:00
Michael Tu
ef05240819
Update MP-CNN Doc with Pre-Trained Models ( #111 )
...
* Delete outdated troubleshooting section
* QAEvalutor bugfix
* Add instructions for pre-trained models
2018-05-25 11:51:19 -04:00
Ralph Tang
494ce36575
Refactor VDPWI to use common API ( #109 )
2018-05-25 01:30:53 -04:00
Michael Tu
0c3a91c443
Check in MP-CNN Lite Model ( #108 )
...
* Add MP-CNN Lite model
* MP-CNN Lite bug fixes
2018-05-25 00:15:50 -04:00
Michael Tu
d7a631b0a9
MP-CNN with Bugs Fixed and PyTorch v0.4 ( #107 )
...
* Refactor datasets
* Update evaluators
* Update trainers
* Update main and MP-CNN model
* Add serialization util
* Fix bugs
* Refactoring for NCE to use new parent class
2018-05-24 23:42:13 -04:00
Ralph Tang
fbd8629ca2
Move MPCNN API to common module ( #105 )
2018-05-24 18:02:37 -04:00
Jimmy Lin
4ece3c7ade
Merge pull request #104 from daemon/vdpwi
...
Merge in existing VDPWI code
2018-05-23 19:13:49 -04:00
Ralph Tang
76a99398ac
Remove extraneous files from VDPWI
2018-05-23 17:55:34 -04:00
Ralph Tang
bb5cf71f9c
Merge remote-tracking branch 'vdpwi/master'
2018-05-23 17:42:53 -04:00
Jimmy Lin
cc53e60098
Update README.md
2018-05-23 16:34:33 -04:00
Jimmy Lin
344248449e
Update README.md
2018-05-23 16:26:39 -04:00
Michael Tu
f7a0167b81
Migrate to from GitHub castorini/data to uWaterloo Castor-data ( #103 )
...
* Refactor main README
* Update Anserini Dependency docs
* Update idf baseline and Kim CNN docs to use Castor-data
* Update remaining READMEs to reference Castor-data
* Change default path from data to Castor-data
* Fix wrong order of embeddings path
2018-05-23 16:16:17 -04:00
Ralph Tang
73823fcc32
Make model parallel wrt batch size
2018-02-06 19:49:12 -05:00
Ralph Tang
4b266431ff
Add hyperparameter tuning script
2018-02-05 17:57:52 -05:00
Ralph Tang
901ce4d6a4
Add tensorboard visualization
2018-02-05 15:25:59 -05:00
Ralph Tang
b06547b36e
Fix norm gradient explosion
2018-02-05 02:48:34 -05:00
Ralph Tang
a110b03164
Add GPU loop unrolling for SimCube computation
2018-02-04 23:20:22 -05:00
Ralph Tang
28f62623be
Workaround PT padding_idx bug
2018-02-04 22:00:55 -05:00
Ralph Tang
5df6123aba
Add training code
2018-02-04 21:39:25 -05:00
Ralph Tang
579d187d8e
Add VDPWI core models
2018-02-04 16:10:38 -05:00
Ralph Tang
e08f85dc09
Fix sigma bug
2018-02-04 14:17:51 -05:00
Ralph Tang
9e2aaf2788
Add preprocessing scripts
2018-02-03 22:54:58 -05:00
Ralph Tang
cc7471a595
Initial commit
2018-02-03 00:10:57 -05:00
rosequ
ef21aa975f
SHARCNET tutorial ( #97 )
2018-01-24 20:11:26 -05:00
Victor Yang
5fd31a0434
Update path name and README for NCE-SM ( #95 )
...
* update nce-sm
* refactor code, update torchtext
* use shared evaluation
* refactor code, use shared data loader
* refactor code
* refactor code
* refactor code according to Michael's great suggestions
* update readme and requirement
* update datasets and readme
* update data loader
* add space between +
* update path name, update readme
* update data loader and dataset name
* refactor code
* update readme
2018-01-24 14:12:37 -05:00
Michael Tu
cbd54cb382
Kim CNN README remove torchtext reset ( #96 )
2018-01-18 10:42:09 -05:00
Victor Yang
51d8e29525
add NCE to MP-CNN ( #84 )
...
* update nce-sm
* refactor code, update torchtext
* use shared evaluation
* refactor code, use shared data loader
* refactor code
* refactor code
* refactor code according to Michael's great suggestions
* update readme and requirement
* update datasets and readme
* update data loader
* add space between +
* update refactor code
* add nce-mp
* remove duplicate files
* update readme, refactor code according to mp_cnn and delete duplicate code, follow PEP8 standard
* refactor code, add/delete comments
* import exit from sys
2018-01-03 18:12:57 -05:00
Michael Tu
eee160ea41
Use view instead of unsqueeze since ONNX v1.0 doesn't support it ( #94 )
2017-12-08 15:04:29 -05:00
rosequ
85f35bb994
connected the pipeline ( #65 ) ( #93 )
...
* connected the pipeline
* minor changes to api code
2017-12-07 20:04:18 -05:00
rosequ
68e0ef45b2
Util to build w2v pytorch model ( #92 )
...
* util to build w2v pytorch model
* added the code to build the .pt model
2017-12-06 11:34:29 -05:00