salti
/
bert-base-multilingual-cased-finetuned-squad
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update tokenizer_config.json

This commit is contained in:
system 2020-05-18 04:33:03 +00:00
parent 8713f13e2f
commit 6d4dae8314
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
tokenizer_config.json
View File

@ -1 +1 @@
{"do_lower_case": false, "model_max_length": 512}
{"do_lower_case": false, "model_max_length": 512, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}