Commit Graph
4 Commits
Author SHA1 Message Date
gauravbaruah 9bd5b7bb2a Corpus idf (#23)
as part of sourcing-IDF-from-index and e2e experiments.
2017-05-07 22:28:35 -04:00
gauravbaruah a67e2d12c4 Ext feats bug fix (#19)
+ sm model no external features baseline
+ sm model with IDF weights
+ sm model with IDF weights without removing punctuation --> barely better than df/idf (a la Pytorch).
+ sm model with stemming before computing IDF weights
^ all on the TrecQA dataset
2017-04-18 12:32:43 -04:00
gauravbaruah 2758dee98f Idfbaselines (#17)
IDF baselines:
+ using QA dataset only to compute IDF
+ using source corpus to compute IDF

Results are in baseline_results.tsv
2017-04-16 20:29:13 -04:00
rosequ b893f2a1b1 Idf baseline for QA datasets (#14)
Added a functionality to generate idf scores for TrecQA and WikiQA datasets.
2017-04-12 17:24:29 -04:00