Add tokenizer configuration

This commit is contained in:
Thomas Wolf 2020-11-25 15:15:22 +01:00
parent 894ecb1b1d
commit 6bee31aad7
1 changed files with 3 additions and 0 deletions

3
tokenizer_config.json Normal file
View File

@ -0,0 +1,3 @@
{
"do_lower_case": false
}