Commit Graph

8 Commits

Author SHA1 Message Date
duzx16 d8a6cfc6cb Update decode method in tokenizer 2023-05-09 11:32:40 +08:00
duzx16 3485994337 Fix gmask 2023-04-14 15:57:11 +08:00
duzx16 9163f7e6d9 Fix eos token in tokenizer 2023-04-11 13:25:12 +08:00
duzx16 a7272d4c93 Fix logit processor
Fix tokenizer config saving
2023-04-08 12:07:06 +08:00
duzx16 bfb1a8f2b6 Slim embedding 2023-04-07 23:14:10 +08:00
duzx16 1f34060390 Drop icetk dependency 2023-04-06 19:24:30 +08:00
songxxzp 7aaf3fe491 Synchronize with chatglm 6b repo 2023-04-03 09:20:14 +08:00
Sengxian a93efa90f5 init commmit 2023-03-19 21:15:20 +08:00