Allow single quotes "'" and hyphens "-" (#4)

- Allow single quotes "'" and hyphens "-" (54f836ce498930b225ff2a6db8c2a40bddece9f8)


Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>
This commit is contained in:
Arthur Zucker 2022-11-28 08:32:13 +00:00 committed by system
parent 407a3a8d4f
commit b8d7ffd4a8
1 changed files with 0 additions and 2 deletions

View File

@ -42,12 +42,10 @@
"suppress_tokens": [
1,
2,
6,
7,
8,
9,
10,
12,
14,
25,
26,