Compare commits
No commits in common. "a7a26fd500148b760ca89a87edcd5b5605daab09" and "9be32a13497b82cba8b28a2711e9fcdaf9272350" have entirely different histories.
a7a26fd500
...
9be32a1349
|
@ -14,4 +14,3 @@
|
|||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
|
|
62
README.md
62
README.md
|
@ -1,62 +0,0 @@
|
|||
---
|
||||
datasets:
|
||||
- SQuAD
|
||||
|
||||
language:
|
||||
- English
|
||||
|
||||
thumbnail:
|
||||
|
||||
tags:
|
||||
- roberta
|
||||
- roberta-base
|
||||
- question-answering
|
||||
- qa
|
||||
|
||||
license: cc-by-4.0
|
||||
|
||||
---
|
||||
# roberta-base + SQuAD QA
|
||||
|
||||
Objective:
|
||||
This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.
|
||||
|
||||
```
|
||||
model_name = "thatdramebaazguy/roberta-base-squad"
|
||||
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")
|
||||
```
|
||||
|
||||
## Overview
|
||||
**Language model:** roberta-base
|
||||
**Language:** English
|
||||
**Downstream-task:** QA
|
||||
**Training data:** SQuADv1
|
||||
**Eval data:** SQuAD
|
||||
**Infrastructure**: 2x Tesla v100
|
||||
**Code:** See [example](https://github.com/adityaarunsinghal/Domain-Adaptation/blob/master/scripts/shell_scripts/train_movieR_just_squadv1.sh)
|
||||
|
||||
## Hyperparameters
|
||||
```
|
||||
Num examples = 88567
|
||||
Num Epochs = 10
|
||||
Instantaneous batch size per device = 32
|
||||
Total train batch size (w. parallel, distributed & accumulation) = 64
|
||||
|
||||
```
|
||||
## Performance
|
||||
|
||||
### Eval on SQuADv1
|
||||
- epoch = 10.0
|
||||
- eval_samples = 10790
|
||||
- exact_match = 83.6045
|
||||
- f1 = 91.1709
|
||||
|
||||
### Eval on MoviesQA
|
||||
- eval_samples = 5032
|
||||
- exact_match = 51.6494
|
||||
- f1 = 68.2615
|
||||
|
||||
Github Repo:
|
||||
- [Domain-Adaptation Project](https://github.com/adityaarunsinghal/Domain-Adaptation/)
|
||||
|
||||
---
|
BIN
flax_model.msgpack (Stored with Git LFS)
BIN
flax_model.msgpack (Stored with Git LFS)
Binary file not shown.
Loading…
Reference in New Issue