Commit Graph

1 Commits

Author SHA1 Message Date
Arthur Zucker 57ea0193de Changes for fast tokenizer (#10)
- Add tokenizer.json (124eda19723059d73b3e24d22089ff0266a5c981)


Co-authored-by: Jonatan Kłosko <jonatanklosko@users.noreply.huggingface.co>
2023-01-26 13:50:51 +00:00