salti/bert-base-multilingual-cased-finetuned-squad is a forked repo from huggingface. License: None

Go to file

Mohamed Al Salti 3cfeb44473 Create README.md		2021-03-10 01:26:39 +00:00
.gitattributes	initial commit	2020-05-16 02:06:05 +00:00
README.md	Create README.md	2021-03-10 01:26:39 +00:00
config.json	Update model	2021-03-10 00:22:40 +00:00
pytorch_model.bin	Update model	2021-03-10 00:22:40 +00:00
special_tokens_map.json	Update special_tokens_map.json	2020-05-16 02:06:05 +00:00
tf_model.h5	Add TF model	2021-03-10 00:52:39 +00:00
tokenizer_config.json	Update model	2021-03-10 00:22:40 +00:00
training_args.bin	Update model	2021-03-10 00:22:40 +00:00
vocab.txt	Update vocab.txt	2020-05-16 02:06:07 +00:00

README.md

language

datasets

multilingual

squad

Multilingual BERT fine-tuned on SQuADv1.1

Training Arguments

max_seq_length              = 512
doc_stride                  = 256
max_answer_length           = 64
bacth_size                  = 16
gradient_accumulation_steps = 2
learning_rate               = 5e-5
weight_decay                = 3e-7
num_train_epochs            = 3
warmup_ratio                = 0.1
fp16                        = True
fp16_opt_level              = "O1"
seed                        = 0

Results

EM	F1
81.731	89.009