Update dimensions

This commit is contained in:
Lysandre 2021-01-13 14:18:35 +00:00 committed by huggingface-web
parent b279e8a7d4
commit 406982260f
1 changed files with 7 additions and 0 deletions

View File

@ -42,6 +42,13 @@ This way, the model learns an inner representation of the English language that
useful for downstream tasks: if you have a dataset of labeled sentences for instance, you can train a standard
classifier using the features produced by the BERT model as inputs.
This model has the following configuration:
- 24-layer
- 1024 hidden dimension
- 16 attention heads
- 336M parameters.
## Intended uses & limitations
This model should be used as a question-answering model. You may use it in a question answering pipeline, or use it to output raw results given a query and a context. You may see other use cases in the [task summary](https://huggingface.co/transformers/task_summary.html#extractive-question-answering) of the transformers documentation.## Training data