Add tokenizer configuration

This commit is contained in:
Thomas Wolf 2020-11-24 23:51:48 +01:00
parent 0fcb34d393
commit 875a30fe15
1 changed files with 3 additions and 0 deletions

3
tokenizer_config.json Normal file
View File

@ -0,0 +1,3 @@
{
"do_lower_case": false
}