Allow single quotes "'" and hyphens "-" (#4)

- Allow single quotes "'" and hyphens "-" (54f836ce498930b225ff2a6db8c2a40bddece9f8)


Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>
This commit is contained in:
Arthur Zucker 2022-11-28 08:32:13 +00:00 committed by system
parent 407a3a8d4f
commit b8d7ffd4a8
1 changed files with 0 additions and 2 deletions

View File

@ -42,12 +42,10 @@
"suppress_tokens": [ "suppress_tokens": [
1, 1,
2, 2,
6,
7, 7,
8, 8,
9, 9,
10, 10,
12,
14, 14,
25, 25,
26, 26,