diff --git a/README.md b/README.md index a97e07f..d108171 100644 --- a/README.md +++ b/README.md @@ -1,7 +1,6 @@ --- datasets: -- squad -- squad-v1 +- SQuAD language: - English @@ -11,9 +10,48 @@ thumbnail: tags: - roberta - roberta-base -- masked-language-modeling -- masked-LM +- question-answering +- qa + +license: cc-by-4.0 --- +# roberta-base + SQuAD QA -Model Card coming soon! +Objective: + This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions. + +``` +model_name = "thatdramebaazguy/roberta-base-squad" +pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering") +``` + +## Overview +**Language model:** roberta-base +**Language:** English +**Downstream-task:** QA +**Training data:** SQuADv1 +**Eval data:** SQuAD +**Infrastructure**: 2x Tesla v100 +**Code:** See [example](https://github.com/adityaarunsinghal/Domain-Adaptation/blob/master/scripts/shell_scripts/train_movieR_just_squadv1.sh) + +## Hyperparameters +``` +Num examples = 88567 +Num Epochs = 10 +Instantaneous batch size per device = 32 +Total train batch size (w. parallel, distributed & accumulation) = 64 + +``` +## Performance + +### Eval on MoviesQA +- epoch = 10.0 +- eval_samples = 10790 +- exact_match = 83.6045 +- f1 = 91.1709 + +Github Repo: +- [Domain-Adaptation Project](https://github.com/adityaarunsinghal/Domain-Adaptation/) + +---