Add evaluation results on samsum dataset (#1)

- Add evaluation results on samsum dataset (09b79fe340dd38f362d80c7392f8886251d42ff8)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>
This commit is contained in:
philschmid 2022-06-24 11:26:48 +00:00 committed by system
parent 01473c6b7b
commit 3d05f288d9
1 changed files with 57 additions and 27 deletions

View File

@ -8,13 +8,10 @@ tags:
datasets: datasets:
- samsum - samsum
widget: widget:
- text: | - text: "Jeff: Can I train a \U0001F917 Transformers model on Amazon SageMaker? \n\
Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker? Philipp: Sure you can use the new Hugging Face Deep Learning Container. \nJeff:\
Philipp: Sure you can use the new Hugging Face Deep Learning Container. \ ok.\nJeff: and how can I get started? \nJeff: where can I find documentation?\
Jeff: ok. \ \nPhilipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face\n"
Jeff: and how can I get started?
Jeff: where can I find documentation?
Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
model-index: model-index:
- name: bart-large-cnn-samsum - name: bart-large-cnn-samsum
results: results:
@ -22,7 +19,7 @@ model-index:
name: Abstractive Text Summarization name: Abstractive Text Summarization
type: abstractive-text-summarization type: abstractive-text-summarization
dataset: dataset:
name: "SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization" name: 'SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization'
type: samsum type: samsum
metrics: metrics:
- name: Validation ROGUE-1 - name: Validation ROGUE-1
@ -43,6 +40,39 @@ model-index:
- name: Test ROGUE-L - name: Test ROGUE-L
type: rogue-l type: rogue-l
value: 32.1337 value: 32.1337
- task:
type: summarization
name: Summarization
dataset:
name: samsum
type: samsum
config: samsum
split: test
metrics:
- name: ROUGE-1
type: rouge
value: 41.3282
verified: true
- name: ROUGE-2
type: rouge
value: 20.8755
verified: true
- name: ROUGE-L
type: rouge
value: 32.1353
verified: true
- name: ROUGE-LSUM
type: rouge
value: 38.401
verified: true
- name: loss
type: loss
value: 1.4297215938568115
verified: true
- name: gen_len
type: gen_len
value: 60.0757
verified: true
--- ---
## `bart-large-cnn-samsum` ## `bart-large-cnn-samsum`