wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-28 11:27:56 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,354 Commits 1 Branch 0 Tags
f09edd8a25d54c48eb804abe391e98d0b85b9ea2
Commit Graph
6 Commits
Author SHA1 Message Date
Steve GrubbandGitHub dac6a3f6ed [Misc] Apply a couple g++ cleanups (#4719) 2024-05-10 13:37:05 +00:00
youkaichaoandGitHub 20cfcdec99 [Core][Optimization] change python dict to pytorch tensor for blocks to swap (#4659) 2024-05-08 12:07:05 -07:00
youkaichaoandGitHub 63575bc2e1 [Core][Optimization] change python dict to pytorch tensor (#4607) 2024-05-06 21:30:27 -07:00
SangBin ChoandGitHub 3521ba4f25 [Core][Model runner refactoring 1/N] Refactor attn metadata term (#4518) 2024-05-03 10:20:12 -07:00
Woosuk KwonandGitHub 498eb5cfa3 [Bugfix] Add kv_scale input parameter to CPU backend (#3840) 2024-04-04 04:33:08 +00:00
bigPYJ1151GitHubKunshang JiYuan Zhou
 		0e3f06fe9c [Hardware][Intel] Add CPU inference backend (#3634) 
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>
 2024-04-01 22:07:30 -07:00