Compare commits

...

10 Commits

Author SHA1 Message Date
Sebastian 96785dbd59 Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (#4)
- Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (8a817a5ca391915bed2d57fb8635f6647e25e287)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>
2022-12-05 16:07:19 +00:00
Tuana Celik b836be0bbe Update README.md 2022-08-15 12:58:16 +00:00
Tuana Celik 2f66fe86fb Update README.md 2022-07-25 14:34:52 +00:00
Sebastian 395c002b5b Update README.md 2022-07-25 07:31:36 +00:00
Sebastian d797cd0d60 Update README.md 2022-07-25 07:30:34 +00:00
sjrlee 36ada3073f Add evaluation results on the squad_v2 config of squad_v2 (#1)
- Add evaluation results on the squad_v2 config of squad_v2 (27b694b8e6a0a2f637fc43442254c6ebf8e5cc12)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>
2022-07-25 07:17:23 +00:00
Julian Risch c28e1a1d3d Update README.md 2021-10-21 12:19:21 +00:00
Julian Risch 0cd8435a68 Update README.md 2021-10-19 13:08:26 +00:00
Julian Risch bc9e5a973e Update README.md 2021-08-02 14:42:44 +00:00
Patrick von Platen 7e6dc533d1 upload flax model 2021-05-19 15:32:28 +00:00
2 changed files with 42 additions and 17 deletions

View File

@ -1,19 +1,42 @@
--- ---
language: en
license: cc-by-4.0
datasets: datasets:
- squad_v2 - squad_v2
license: cc-by-4.0 model-index:
- name: deepset/minilm-uncased-squad2
results:
- task:
type: question-answering
name: Question Answering
dataset:
name: squad_v2
type: squad_v2
config: squad_v2
split: validation
metrics:
- type: exact_match
value: 76.1921
name: Exact Match
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmViZTQ3YTBjYTc3ZDQzYmI1Mzk3MTAxM2MzNjdmMTc0MWY4Yzg2MWU3NGQ1MDJhZWI2NzY0YWYxZTY2OTgzMiIsInZlcnNpb24iOjF9.s4XCRs_pvW__LJ57dpXAEHD6NRsQ3XaFrM1xaguS6oUs5fCN77wNNc97scnfoPXT18A8RAn0cLTNivfxZm0oBA
- type: f1
value: 79.5483
name: F1
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmJlYTIyOTg2NjMyMzg4NzNlNGIzMTY2NDVkMjg0ODdiOWRmYjVkZDYyZjBjNWNiNTBhNjcwOWUzMDM4ZWJiZiIsInZlcnNpb24iOjF9.gxpwIBBA3_5xPi-TaZcqWNnGgCiHzxaUNgrS2jucxoVWGxhBtnPdwKVCxLleQoDDZenAXB3Yh71zMP3xTSeHCw
--- ---
# MiniLM-L12-H384-uncased for QA # MiniLM-L12-H384-uncased for QA
## Overview ## Overview
**Language model:** microsoft/MiniLM-L12-H384-uncased **Language model:** microsoft/MiniLM-L12-H384-uncased
**Language:** English **Language:** English
**Downstream-task:** Extractive QA **Downstream-task:** Extractive QA
**Training data:** SQuAD 2.0 **Training data:** SQuAD 2.0
**Eval data:** SQuAD 2.0 **Eval data:** SQuAD 2.0
**Code:** See [example](https://github.com/deepset-ai/FARM/blob/master/examples/question_answering.py) in [FARM](https://github.com/deepset-ai/FARM/blob/master/examples/question_answering.py) **Code:** See [example](https://github.com/deepset-ai/FARM/blob/master/examples/question_answering.py) in [FARM](https://github.com/deepset-ai/FARM/blob/master/examples/question_answering.py)
**Infrastructure**: 1x Tesla v100 **Infrastructure**: 1x Tesla v100
## Hyperparameters ## Hyperparameters
@ -96,15 +119,14 @@ reader = TransformersReader(model="deepset/minilm-uncased-squad2",tokenizer="dee
## Authors ## Authors
Vaishali Pal `vaishali.pal [at] deepset.ai` **Vaishali Pal:** vaishali.pal@deepset.ai
Branden Chan: `branden.chan [at] deepset.ai` **Branden Chan:** branden.chan@deepset.ai
Timo Möller: `timo.moeller [at] deepset.ai` **Timo Möller:** timo.moeller@deepset.ai
Malte Pietsch: `malte.pietsch [at] deepset.ai` **Malte Pietsch:** malte.pietsch@deepset.ai
Tanay Soni: `tanay.soni [at] deepset.ai` **Tanay Soni:** tanay.soni@deepset.ai
## About us ## About us
![deepset logo](https://raw.githubusercontent.com/deepset-ai/FARM/master/docs/img/deepset_logo.png) ![deepset logo](https://workablehr.s3.amazonaws.com/uploads/account/logo/476306/logo)
We bring NLP to the industry via open source! We bring NLP to the industry via open source!
Our focus: Industry specific language models & large scale QA systems. Our focus: Industry specific language models & large scale QA systems.
@ -115,6 +137,6 @@ Some of our work:
- [Haystack](https://github.com/deepset-ai/haystack/) - [Haystack](https://github.com/deepset-ai/haystack/)
Get in touch: Get in touch:
[Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Slack](https://haystack.deepset.ai/community/join) | [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) | [Website](https://deepset.ai) [Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Discord](https://haystack.deepset.ai/community/join) | [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) | [Website](https://deepset.ai)
By the way: [we're hiring!](https://apply.workable.com/deepset/) By the way: [we're hiring!](http://www.deepset.ai/jobs)

BIN
flax_model.msgpack (Stored with Git LFS) Normal file

Binary file not shown.