Allow single quotes "'" and hyphens "-" (#4)
- Allow single quotes "'" and hyphens "-" (54f836ce498930b225ff2a6db8c2a40bddece9f8) Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>
This commit is contained in:
parent
407a3a8d4f
commit
b8d7ffd4a8
|
@ -42,12 +42,10 @@
|
|||
"suppress_tokens": [
|
||||
1,
|
||||
2,
|
||||
6,
|
||||
7,
|
||||
8,
|
||||
9,
|
||||
10,
|
||||
12,
|
||||
14,
|
||||
25,
|
||||
26,
|
||||
|
|
Loading…
Reference in New Issue