wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-16 11:23:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,050 Commits 1 Branch 0 Tags
40468b13faa1ebde366e7002c5752b59e1368d10
Commit Graph
10 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub 41ca62cf03 [Misc] Add CustomOp interface for device portability (#5255) 2024-06-05 09:18:19 -07:00
mawong-amdandGitHub b6d103542c [Kernel] Layernorm performance optimization (#3662) 2024-03-30 14:26:38 -07:00
Kunshang JiGitHubJiang Li
 		96b6f475dd Remove hardcoded device="cuda" to support more devices (#2503) 
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2024-02-01 15:46:39 -08:00
Jee LiandGitHub 77af974b40 [FIX] Support non-zero CUDA devices in custom kernels (#1959) 2024-01-02 19:09:59 -08:00
Woosuk KwonandGitHub 9b294976a2 Add PyTorch-native implementation of custom layers (#1898) 2023-12-02 21:18:40 -08:00
Yanming WandGitHub e0c6f556e8 [Build] Avoid building too many extensions (#1624) 2023-11-23 16:31:19 -08:00
Woosuk KwonandGitHub fbd80ad409 Clean up kernel unit tests (#938) 2023-09-05 16:57:38 -07:00
Zhuohan LiandGitHub d6fa1be3a8 [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00
Woosuk KwonandGitHub 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
Woosuk KwonandGitHub 825d8892b5 Use pytest format for unit tests (#107) 2023-05-17 17:11:23 -07:00