multifit/results/MLDoc.md

non-zeroshot

Model	en	de	es	fr	it	ja	ru	zh
LASER	90.73	92.70	88.75	90.80	85.93	85.15	84.65	88.98
MultiCCA	92.2	93.70	94.45	92.05	85.55	85.35	85.65	87.30
ULMFiT		95.4	95.15	93.67	88.42	89.20	87.27
ULMFiT 100		91.35	83.32	88.77	77.99	71.12	72.20

Zero shot approaches

Model	en	de	es	fr	it	ja	ru	zh
LASER 0 shot	80.75 (en)	87.03 (fr)	82.60 (it)	82.83 (de)	73.25 (de)	60.95 (en)	68.83 (it)	72.90 (de)
LASER base 0 shot		86.48	79.23	76.73
ULMFiT 0 shot		91.97	85.35	85.54
ULMFiT 100 for comp.		91.35	83.32	88.77	77.99	71.12	72.20

To simulate ulmfit zero shot we add noise to the training labels to simulate training from Laser labels

Model	en	de	es	fr	it	ja	ru	zh
LASER 0 shot	80.75 (en)	87.03 (fr)	82.60 (it)	82.83 (de)	73.25 (de)	60.95 (en)	68.83 (it)	72.90 (de)
ULMFiT		95.4	95.15	93.67	88.42	89.20	87.27
Noise	20%	13%	18%	18%	27%	40%	32%	28%
ULMFiT noise ~ 0 shot		94.49	93.12	90.49	83.72	74.72	75.67