19 Commits
Author SHA1 Message Date
Ralph Tang 3855254870 Tidy up some code (#174) 2019-02-06 13:36:48 -05:00
Victor Yang 921a45e7ca add storing prediction/qrel files option for test set (#125)
* add prediction/qrel files dump option

* fix comment
2018-06-18 20:43:40 -04:00
Jimmy Lin e9c011b421 Update README.md (#119) 2018-05-27 09:18:02 -04:00
Michael Tu 5bf33bf8ea Update README to use Castor-models and Instructions for Internal Users (#113)
* Update instructions to use Castor-models
* Consolidate requirements.txt
* Refine README with convenience scripts
* Update internal instructions
* MP-CNN working dir minor edit
2018-05-25 18:14:10 -04:00
Michael Tu ef05240819 Update MP-CNN Doc with Pre-Trained Models (#111)
* Delete outdated troubleshooting section

* QAEvalutor bugfix

* Add instructions for pre-trained models
2018-05-25 11:51:19 -04:00
Michael Tu 0c3a91c443 Check in MP-CNN Lite Model (#108)
* Add MP-CNN Lite model

* MP-CNN Lite bug fixes
2018-05-25 00:15:50 -04:00
Michael Tu d7a631b0a9 MP-CNN with Bugs Fixed and PyTorch v0.4 (#107)
* Refactor datasets

* Update evaluators

* Update trainers

* Update main and MP-CNN model

* Add serialization util

* Fix bugs

* Refactoring for NCE to use new parent class
2018-05-24 23:42:13 -04:00
Ralph Tang fbd8629ca2 Move MPCNN API to common module (#105) 2018-05-24 18:02:37 -04:00
Michael Tu f7a0167b81 Migrate to from GitHub castorini/data to uWaterloo Castor-data (#103)
* Refactor main README
* Update Anserini Dependency docs
* Update idf baseline and Kim CNN docs to use Castor-data
* Update remaining READMEs to reference Castor-data
* Change default path from data to Castor-data
* Fix wrong order of embeddings path
2018-05-23 16:16:17 -04:00
Victor Yang 51d8e29525 add NCE to MP-CNN (#84)
* update nce-sm

* refactor code, update torchtext

* use shared evaluation

* refactor code, use shared data loader

* refactor code

* refactor code

* refactor code according to Michael's great suggestions

* update readme and requirement

* update datasets and readme

* update data loader

* add space between +

* update refactor code

* add nce-mp

* remove duplicate files

* update readme, refactor code according to mp_cnn and delete duplicate code, follow PEP8 standard

* refactor code, add/delete comments

* import exit from sys
2018-01-03 18:12:57 -05:00
Michael Tu 0722dde06e MP-CNN: Add hyperparameters used to achieve paper perf for WikiQA (#82) 2017-11-08 09:51:04 -05:00
Michael Tu 2344354cbf MP-CNN: add trainer and evaluator for WikiQA (#80) 2017-11-06 20:37:40 -05:00
Michael Tu 4470983504 TrecQA for MP-CNN (#77)
* Add TrecQA dataset and modularize MP-CNN infra

* Stylistic improvements

* Fix and warn about trec_eval path issue

* Update README for MP-CNN

* Update incorrect map/mrr

* MP-CNN: address code review comments

* Create common Castor pair Dataset class

* Move map and mrr computation to Castor utils

* Make map mrr utility trec_eval path more general
2017-11-04 18:22:40 -04:00
Michael Tu 09b3a790a2 Use torchtext for MP-CNN (#76)
* Add SICK torchtext Dataset

* SICK dataset - torchtext postprocess into class probs

* Update model, driver, trainer, evaluator for SICK for torchtext

* MP-CNN: Fix bugs that prevent SICK from running on gpu 0

* MP-CNN: make SICK dataset w/ torchtext GPU-agnostic

* MP-CNN: support sparse features / idf overlap with torchtext

* Add MSRVID dataset with torchtext and update MP-CNN code to use it

* MP-CNN: Make torchtext deterministic by setting python random seed

* SICK and MSRVID datasets - add pair id for debug and build test vocab

* MP-CNN: Update readme to address potential module not found error

* MP-CNN: address review comments, can run on cpu
2017-11-01 12:13:30 -04:00
Michael Tu 857cd43934 MP-CNN: Optionally Visualize Training for Debugging (#67)
* MP-CNN: optionally support TensorBoard for learning curve visualization

* MP-CNN: bug with SummaryWriter comment

* MP-CNN: add instructions on how to setup tensorboard
2017-10-05 19:15:51 -04:00
Michael Tu 6362239233 MP-CNN: early stopping (#60) 2017-09-27 19:26:20 -04:00
Michael Tu aba4dd7e89 MP-CNN: Add Additional Features (#51)
* MP-CNN: support external features

* MP-CNN: calculate overlap in same way as SM-model

* MP-CNN: properly calculate idf overlap
2017-09-21 22:43:31 -04:00
Michael Tu a2904efe5a MP-CNN Bugfixes and Improvements (#50)
* MP-CNN: use consistent unknown vector

* MP-CNN: Make optimizer, patience, etc.. configurable

* MP-CNN: bug fixes

* MP-CNN: update README

* MP-CNN: remove unused import
2017-09-21 15:53:54 -04:00
Michael Tu 449d715ab0 MP-CNN PyTorch Re-implementation (#37)
Re-implementation of MP-CNN in PyTorch.
2017-08-04 19:37:34 -04:00