From b7e3a5e7a46c774ed00cbc94bb159bec86bf8fa6 Mon Sep 17 00:00:00 2001 From: Julian Eisenschlos Date: Sat, 16 Feb 2019 14:42:40 -0300 Subject: [PATCH] Update BERT Zero-shot results --- results/MLDoc.md | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/results/MLDoc.md b/results/MLDoc.md index db55d92..84bf1e8 100644 --- a/results/MLDoc.md +++ b/results/MLDoc.md @@ -4,10 +4,10 @@ |----------------|-----------|-----------|-----------|-----------|-----------|-----------|-----------|------------| |LASER | 90.73 | 92.70 | 88.75 | 90.80 | 85.93 | 85.15 | 84.65 | 88.98 | |MultiCCA | 92.2 | 93.70 | 94.45 | 92.05 | 85.55 | 85.35 | 85.65 | 87.30 | -|ULMFiT | | **95.4** | 95.15 | **93.67** | **88.42** | **89.20** | **87.27** | **90.20** | +|ULMFiT | | **95.4** | **95.15** | **93.67** | **88.42** | **89.20** | **87.27** | 90.20 | |ULMFiT sp-fixed | | 95.6 | 94.80 | 94.20 | 88.52 | 88.72 | 86.85 | 90.47 | -|ULMFiT 100 | | 91.35 | 83.32 | 88.77 | 77.99 | 71.12 | 72.20 | | -|BERT Multi | 94.1 | 93.8 | **95.4** | 91.1 | 87.5 | 86.4 | 86.8 | 90.8 | +|ULMFiT 100 | | 91.35 | 83.32 | 88.77 | 77.99 | 71.12 | 72.20 | | +|Bert Multi | 93.23% | 94.0% | **95.15** | 93.20 | 85.82 | 87.48 | 86.85 | **90.72** | ^ - sp60k lstm nl 4 @@ -27,6 +27,8 @@ | % impr over LASER-fr | 31% | 4% | | 16% | 3% | 25% | | % impr over LASER-en | 43% | 20% | 30% | 17% | 10% | 16% | | ULMFiT 100 for comp. | 91.35 | 83.32 | 88.77 | 77.99 | 71.12 | | +| | | | | | | | +| Bert Multilingual-EN | 74.50 | 61.85 | 69.77 | 57.73 | 51.10 | 64.08 | All ULMFiT examples above were trained on 1k training data generated by a LASER classification model