Zhengxiao Du
|
d467effe91
|
Update slim checkpoint (#28)
- Update slim checkpoint (674b8f6771ae11bec06f050cd38755ae5abe5eaa)
|
2023-04-06 14:47:57 +00:00 |
duzx16
|
06a22a39fa
|
Merge branch 'slim' of https://huggingface.co/THUDM/chatglm-6b into slim
|
2023-04-06 22:45:49 +08:00 |
duzx16
|
36b7f2d0ad
|
Add gmask token id
|
2023-04-06 22:43:35 +08:00 |
Zhengxiao Du
|
6461061e82
|
Update slim checkpoint
|
2023-04-06 14:25:30 +00:00 |
duzx16
|
63ce1bac4a
|
Update code for slim
|
2023-04-06 22:19:30 +08:00 |
duzx16
|
72985e820c
|
Drop icetk dependency
|
2023-04-06 19:18:52 +08:00 |
Zhengxiao Du
|
551a50efec
|
fix typo in use_gmask (#21)
- fix typo in use_gmask (d6504255afdd555d12137fc3af04646f099b5785)
Co-authored-by: Fan Zhang <fzhang@users.noreply.huggingface.co>
|
2023-04-05 11:11:33 +00:00 |
duzx16
|
23ad39b571
|
Fix decode method for torch tensor
|
2023-04-05 18:26:09 +08:00 |
Zhengxiao Du
|
fdb7a601d8
|
Support single integer or empty list as input to decode (#7)
- Update tokenization_chatglm.py (dffe870a7ef1558ebbc6f3dfdf46491cdb2b3e31)
Co-authored-by: Yichao 'Peak' Ji <peakji@users.noreply.huggingface.co>
|
2023-04-04 09:48:07 +00:00 |
duzx16
|
f82b180d8d
|
Fix position ids expand
|
2023-04-03 14:14:20 +08:00 |
duzx16
|
fb23542cfe
|
Fix generate
|
2023-04-02 14:51:17 +08:00 |
duzx16
|
08bc85104d
|
Fix attention mask for prefix prompt
|
2023-04-02 02:25:03 +08:00 |
duzx16
|
4b7ffbf070
|
No padding for chat function
|
2023-04-02 02:03:05 +08:00 |
duzx16
|
373fd6b9d4
|
Fix attention_mask and position_ids
|
2023-04-02 01:58:45 +08:00 |
duzx16
|
e22cddf212
|
Fix encode method
|
2023-04-02 01:04:40 +08:00 |
duzx16
|
e1494f222d
|
Fix batch input
|
2023-04-01 22:38:53 +08:00 |
duzx16
|
cc96a2271a
|
Implement batch generation
|
2023-04-01 19:41:28 +08:00 |
duzx16
|
11c270c26c
|
Fix position id for training
|
2023-03-31 20:18:10 +08:00 |
Zhengxiao Du
|
9c7416d834
|
fix GLM6BBlock name typo (#20)
- fix GLM6BBlock name typo (2a180534c5f2b4860598a9caef798b55a77cfb72)
Co-authored-by: rich brain <richbrain@users.noreply.huggingface.co>
|
2023-03-31 07:34:06 +00:00 |
duzx16
|
2e1be30ac4
|
Add support for loading quantized model
|
2023-03-31 10:48:38 +08:00 |
duzx16
|
c949d03152
|
Use dynamic dtype for prompts
|
2023-03-31 01:13:32 +08:00 |
duzx16
|
0cfae21ef8
|
Fix backward for quantization
|
2023-03-30 21:49:06 +08:00 |
duzx16
|
aea6cefcf5
|
Implement gradient checkpointing
|
2023-03-30 19:42:01 +08:00 |
duzx16
|
0564795e6e
|
Fix bugs
|
2023-03-30 17:35:58 +08:00 |
duzx16
|
2200e2bc52
|
Add pad_token_id in config.json
Fix position_ids in ChatGLMModel
Add batch position_ids
|
2023-03-29 21:52:46 +08:00 |
duzx16
|
db2249979c
|
Change padding side
|
2023-03-29 21:25:40 +08:00 |
duzx16
|
5c64357295
|
Set ignore_index for CrossEntropyLoss
|
2023-03-29 21:19:38 +08:00 |
duzx16
|
8127ab6abf
|
Support batch training
|
2023-03-29 21:15:30 +08:00 |
duzx16
|
fbda1206cb
|
Merge branch 'main' into dev_pt
# Conflicts:
# modeling_chatglm.py
|
2023-03-29 20:37:39 +08:00 |
duzx16
|
812f43f9ff
|
Add p-tuning v2
|
2023-03-29 20:22:57 +08:00 |
duzx16
|
096f3de6b4
|
Fix context length in get_position_ids
|
2023-03-28 17:37:46 +08:00 |
duzx16
|
4a9b711e61
|
Close CPU fusion on Mac
|
2023-03-23 22:43:06 +08:00 |
duzx16
|
d2bbc82a2c
|
Fix Chinese punctuation
|
2023-03-22 14:37:21 +08:00 |
duzx16
|
2449bdc9d8
|
Add English
|
2023-03-21 23:27:46 +08:00 |
songxxzp
|
1b54948bb2
|
Fix typo in tokenization_chatglm.py
|
2023-03-19 22:52:12 +08:00 |
duzx16
|
2460dc2430
|
Remove hardcode bos_token_id
|
2023-03-19 14:56:15 +08:00 |
duzx16
|
42095d42ff
|
Add support for streaming output
|
2023-03-19 14:31:26 +08:00 |
duzx16
|
220f772e9a
|
Fix overflow in FP16
|
2023-03-16 09:26:05 +08:00 |
duzx16
|
f9f74fda55
|
Set is_parallelizable to False
|
2023-03-16 00:30:43 +08:00 |
duzx16
|
8492687842
|
Remove image tokens when decoding
|
2023-03-16 00:24:42 +08:00 |
duzx16
|
0d8b08d1bb
|
Revert "Update quantization"
This reverts commit 0101afdfa7 .
|
2023-03-15 21:31:05 +08:00 |
duzx16
|
0101afdfa7
|
Update quantization
|
2023-03-15 21:18:24 +08:00 |
duzx16
|
c3dece3f01
|
Add logit processor for NaN or Inf scores
|
2023-03-15 18:14:34 +08:00 |
duzx16
|
9d1509a1ad
|
Fix default history argument
|
2023-03-14 18:38:49 +08:00 |
duzx16
|
bcb053bda6
|
Merge branch 'main' of https://huggingface.co/THUDM/chatglm-6b
|
2023-03-14 14:49:47 +08:00 |
duzx16
|
d4832e8142
|
Add support for float32
|
2023-03-14 14:49:14 +08:00 |
duzx16
|
a034f2a1ed
|
Update requirements
|
2023-03-14 12:19:54 +08:00 |
duzx16
|
3d0afeeed7
|
Update requirements
|
2023-03-14 12:15:19 +08:00 |
Zeng Aohan
|
534e8b7045
|
Update README.md
|
2023-03-14 03:18:04 +00:00 |
Zeng Aohan
|
6331ebe869
|
Update README.md
|
2023-03-14 03:17:32 +00:00 |