Allow single quotes "'" and hyphens "-" (#4)
- Allow single quotes "'" and hyphens "-" (54f836ce498930b225ff2a6db8c2a40bddece9f8) Co-authored-by: Sanchit Gandhi <sanchit-gandhi@users.noreply.huggingface.co>
This commit is contained in:
parent
407a3a8d4f
commit
b8d7ffd4a8
|
@ -42,12 +42,10 @@
|
||||||
"suppress_tokens": [
|
"suppress_tokens": [
|
||||||
1,
|
1,
|
||||||
2,
|
2,
|
||||||
6,
|
|
||||||
7,
|
7,
|
||||||
8,
|
8,
|
||||||
9,
|
9,
|
||||||
10,
|
10,
|
||||||
12,
|
|
||||||
14,
|
14,
|
||||||
25,
|
25,
|
||||||
26,
|
26,
|
||||||
|
|
Loading…
Reference in New Issue