Update README.md
This commit is contained in:
parent
648c7e2a38
commit
2a0a3a4dcb
48
README.md
48
README.md
|
@ -1,7 +1,6 @@
|
||||||
---
|
---
|
||||||
datasets:
|
datasets:
|
||||||
- squad
|
- SQuAD
|
||||||
- squad-v1
|
|
||||||
|
|
||||||
language:
|
language:
|
||||||
- English
|
- English
|
||||||
|
@ -11,9 +10,48 @@ thumbnail:
|
||||||
tags:
|
tags:
|
||||||
- roberta
|
- roberta
|
||||||
- roberta-base
|
- roberta-base
|
||||||
- masked-language-modeling
|
- question-answering
|
||||||
- masked-LM
|
- qa
|
||||||
|
|
||||||
|
license: cc-by-4.0
|
||||||
|
|
||||||
---
|
---
|
||||||
|
# roberta-base + SQuAD QA
|
||||||
|
|
||||||
Model Card coming soon!
|
Objective:
|
||||||
|
This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
|
||||||
|
|
||||||
|
```
|
||||||
|
model_name = "thatdramebaazguy/roberta-base-squad"
|
||||||
|
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")
|
||||||
|
```
|
||||||
|
|
||||||
|
## Overview
|
||||||
|
**Language model:** roberta-base
|
||||||
|
**Language:** English
|
||||||
|
**Downstream-task:** QA
|
||||||
|
**Training data:** SQuADv1
|
||||||
|
**Eval data:** SQuAD
|
||||||
|
**Infrastructure**: 2x Tesla v100
|
||||||
|
**Code:** See [example](https://github.com/adityaarunsinghal/Domain-Adaptation/blob/master/scripts/shell_scripts/train_movieR_just_squadv1.sh)
|
||||||
|
|
||||||
|
## Hyperparameters
|
||||||
|
```
|
||||||
|
Num examples = 88567
|
||||||
|
Num Epochs = 10
|
||||||
|
Instantaneous batch size per device = 32
|
||||||
|
Total train batch size (w. parallel, distributed & accumulation) = 64
|
||||||
|
|
||||||
|
```
|
||||||
|
## Performance
|
||||||
|
|
||||||
|
### Eval on MoviesQA
|
||||||
|
- epoch = 10.0
|
||||||
|
- eval_samples = 10790
|
||||||
|
- exact_match = 83.6045
|
||||||
|
- f1 = 91.1709
|
||||||
|
|
||||||
|
Github Repo:
|
||||||
|
- [Domain-Adaptation Project](https://github.com/adityaarunsinghal/Domain-Adaptation/)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
Loading…
Reference in New Issue