salti
/
bert-base-multilingual-cased-finetuned-squad
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

add zero-shot results

This commit is contained in:
Mohamed Al Salti 2021-03-10 01:56:55 +00:00 committed by huggingface-web
parent 3cfeb44473
commit 11d443d60a
1 changed files with 30 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

31
README.md
View File

@ -4,11 +4,14 @@ language:
datasets: datasets:
- squad - squad
--- ---
# Multilingual BERT fine-tuned on SQuADv1.1 # Multilingual BERT fine-tuned on SQuADv1.1
[**WandB run link**](https://wandb.ai/salti/mBERT_QA/runs/wkqzhrp2)
**GPU**: Tesla P100-PCIE-16GB
## Training Arguments ## Training Arguments
```python ```python
@ -29,5 +32,29 @@ seed = 0
## Results ## Results
| EM | F1 | | EM | F1 |
| :---: | :---: | | :----: | :----: |
| 81.731 | 89.009 | | 81.731 | 89.009 |
## Zero-shot performance
### on ARCD
| EM | F1 |
| :----: | :----: |
| 20.655 | 48.051 |
### on XQuAD
| Language | EM | F1 |
| :--------: | :----: | :----: |
| Arabic | 42.185 | 57.803 |
| English | 73.529 | 85.01 |
| German | 55.882 | 72.555 |
| Greek | 45.21 | 62.207 |
| Spanish | 58.067 | 76.406 |
| Hindi | 40.588 | 55.29 |
| Russian | 55.126 | 71.617 |
| Thai | 26.891 | 39.965 |
| Turkish | 34.874 | 51.138 |
| Vietnamese | 47.983 | 68.125 |
| Chinese | 47.395 | 58.928 |