Add tokenizer configuration

This commit is contained in:
Thomas Wolf 2020-11-24 23:48:28 +01:00
parent ae1d3b2cce
commit b89a729bda
1 changed files with 3 additions and 0 deletions

3
tokenizer_config.json Normal file
View File

@ -0,0 +1,3 @@
{
"do_lower_case": false
}