wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-19 12:40:48 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,977 Commits 1 Branch 0 Tags
ec10cb8511b7e30b8ff86caab2e4272ff3ceddca
Commit Graph
5 Commits
Author SHA1 Message Date
Cyrus Leung 26a68d5d7e [CI/Build] Add test decorator for minimum GPU memory (#8925) 2024-09-29 02:50:51 +00:00
Jee LiandAntoni Baum 67005a07bc [Bugfix] Add fully sharded layer for QKVParallelLinearWithLora (#5665) 
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
 2024-06-21 04:46:28 +00:00
Cyrus Leung 0e9164b40a [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00
Jee Li 989ae2538d [Kernel] Add punica dimension for Baichuan-13B (#4053) 2024-04-13 07:55:05 -07:00
Jee LiandAntoni Baum 8af890a865 Enable more models to inference based on LoRA (#3382) 
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
 2024-03-25 18:09:31 -07:00