From 3cfeb444738631ffd3b6c42583c970f68bbf4a0f Mon Sep 17 00:00:00 2001
From: Mohamed Al Salti <mohamed.al.salti.96@gmail.com>
Date: Wed, 10 Mar 2021 01:26:39 +0000
Subject: [PATCH] Create README.md

---
 README.md | 33 +++++++++++++++++++++++++++++++++
 1 file changed, 33 insertions(+)
 create mode 100644 README.md

diff --git a/README.md b/README.md
new file mode 100644
index 0000000..63097ff
--- /dev/null
+++ b/README.md
@@ -0,0 +1,33 @@
+---
+language:
+  - multilingual
+
+datasets:
+  - squad
+
+---
+
+# Multilingual BERT fine-tuned on SQuADv1.1
+
+## Training Arguments
+
+```python
+max_seq_length              = 512
+doc_stride                  = 256
+max_answer_length           = 64
+bacth_size                  = 16
+gradient_accumulation_steps = 2
+learning_rate               = 5e-5
+weight_decay                = 3e-7
+num_train_epochs            = 3
+warmup_ratio                = 0.1
+fp16                        = True
+fp16_opt_level              = "O1"
+seed                        = 0
+```
+
+## Results
+
+| EM | F1 |
+| :---: | :---: |
+| 81.731 | 89.009 |