Compare commits

...

10 Commits

Author SHA1 Message Date
Sebastian 96785dbd59 Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (#4)
- Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator (8a817a5ca391915bed2d57fb8635f6647e25e287)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>
2022-12-05 16:07:19 +00:00
Tuana Celik b836be0bbe Update README.md 2022-08-15 12:58:16 +00:00
Tuana Celik 2f66fe86fb Update README.md 2022-07-25 14:34:52 +00:00
Sebastian 395c002b5b Update README.md 2022-07-25 07:31:36 +00:00
Sebastian d797cd0d60 Update README.md 2022-07-25 07:30:34 +00:00
sjrlee 36ada3073f Add evaluation results on the squad_v2 config of squad_v2 (#1)
- Add evaluation results on the squad_v2 config of squad_v2 (27b694b8e6a0a2f637fc43442254c6ebf8e5cc12)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>
2022-07-25 07:17:23 +00:00
Julian Risch c28e1a1d3d Update README.md 2021-10-21 12:19:21 +00:00
Julian Risch 0cd8435a68 Update README.md 2021-10-19 13:08:26 +00:00
Julian Risch bc9e5a973e Update README.md 2021-08-02 14:42:44 +00:00
Patrick von Platen 7e6dc533d1 upload flax model 2021-05-19 15:32:28 +00:00
2 changed files with 42 additions and 17 deletions

View File

@ -1,7 +1,30 @@
---
language: en
license: cc-by-4.0
datasets:
- squad_v2
license: cc-by-4.0
model-index:
- name: deepset/minilm-uncased-squad2
results:
- task:
type: question-answering
name: Question Answering
dataset:
name: squad_v2
type: squad_v2
config: squad_v2
split: validation
metrics:
- type: exact_match
value: 76.1921
name: Exact Match
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmViZTQ3YTBjYTc3ZDQzYmI1Mzk3MTAxM2MzNjdmMTc0MWY4Yzg2MWU3NGQ1MDJhZWI2NzY0YWYxZTY2OTgzMiIsInZlcnNpb24iOjF9.s4XCRs_pvW__LJ57dpXAEHD6NRsQ3XaFrM1xaguS6oUs5fCN77wNNc97scnfoPXT18A8RAn0cLTNivfxZm0oBA
- type: f1
value: 79.5483
name: F1
verified: true
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmJlYTIyOTg2NjMyMzg4NzNlNGIzMTY2NDVkMjg0ODdiOWRmYjVkZDYyZjBjNWNiNTBhNjcwOWUzMDM4ZWJiZiIsInZlcnNpb24iOjF9.gxpwIBBA3_5xPi-TaZcqWNnGgCiHzxaUNgrS2jucxoVWGxhBtnPdwKVCxLleQoDDZenAXB3Yh71zMP3xTSeHCw
---
# MiniLM-L12-H384-uncased for QA
@ -96,15 +119,14 @@ reader = TransformersReader(model="deepset/minilm-uncased-squad2",tokenizer="dee
## Authors
Vaishali Pal `vaishali.pal [at] deepset.ai`
Branden Chan: `branden.chan [at] deepset.ai`
Timo Möller: `timo.moeller [at] deepset.ai`
Malte Pietsch: `malte.pietsch [at] deepset.ai`
Tanay Soni: `tanay.soni [at] deepset.ai`
**Vaishali Pal:** vaishali.pal@deepset.ai
**Branden Chan:** branden.chan@deepset.ai
**Timo Möller:** timo.moeller@deepset.ai
**Malte Pietsch:** malte.pietsch@deepset.ai
**Tanay Soni:** tanay.soni@deepset.ai
## About us
![deepset logo](https://raw.githubusercontent.com/deepset-ai/FARM/master/docs/img/deepset_logo.png)
![deepset logo](https://workablehr.s3.amazonaws.com/uploads/account/logo/476306/logo)
We bring NLP to the industry via open source!
Our focus: Industry specific language models & large scale QA systems.
@ -115,6 +137,6 @@ Some of our work:
- [Haystack](https://github.com/deepset-ai/haystack/)
Get in touch:
[Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Slack](https://haystack.deepset.ai/community/join) | [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) | [Website](https://deepset.ai)
[Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Discord](https://haystack.deepset.ai/community/join) | [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) | [Website](https://deepset.ai)
By the way: [we're hiring!](https://apply.workable.com/deepset/)
By the way: [we're hiring!](http://www.deepset.ai/jobs)

BIN
flax_model.msgpack (Stored with Git LFS) Normal file

Binary file not shown.