Commit Graph

9 Commits

Author SHA1 Message Date
duzx16 2460dc2430 Remove hardcode bos_token_id 2023-03-19 14:56:15 +08:00
duzx16 42095d42ff Add support for streaming output 2023-03-19 14:31:26 +08:00
duzx16 220f772e9a Fix overflow in FP16 2023-03-16 09:26:05 +08:00
duzx16 f9f74fda55 Set is_parallelizable to False 2023-03-16 00:30:43 +08:00
duzx16 c3dece3f01 Add logit processor for NaN or Inf scores 2023-03-15 18:14:34 +08:00
duzx16 9d1509a1ad Fix default history argument 2023-03-14 18:38:49 +08:00
duzx16 d4832e8142 Add support for float32 2023-03-14 14:49:14 +08:00
duzx16 cd8041ea53 Fix past_key_values 2023-03-14 02:08:43 +08:00
Sengxian d11c6aaed8 Add chatglm-6b 2023-03-14 00:21:01 +08:00