wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-25 13:30:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,287 Commits 1 Branch 0 Tags
098f94de42859f8251fe920f87adb88336129c53
Commit Graph
6 Commits
Author SHA1 Message Date
Cody YuandGitHub d11bf435a0 [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) 2024-10-18 14:30:55 -07:00
Cyrus LeungandGitHub 26a68d5d7e [CI/Build] Add test decorator for minimum GPU memory (#8925) 2024-09-29 02:50:51 +00:00
Jee LiGitHubAntoni Baum
 		67005a07bc [Bugfix] Add fully sharded layer for QKVParallelLinearWithLora (#5665) 
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
 2024-06-21 04:46:28 +00:00
Cyrus LeungandGitHub 0e9164b40a [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00
Jee LiandGitHub 989ae2538d [Kernel] Add punica dimension for Baichuan-13B (#4053) 2024-04-13 07:55:05 -07:00
Jee LiGitHubAntoni Baum
 		8af890a865 Enable more models to inference based on LoRA (#3382) 
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
 2024-03-25 18:09:31 -07:00