wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-19 11:29:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
366 Commits 1 Branch 0 Tags
bbbf86565f2fb2bab0cf6675f9ebefcd449390bd
Commit Graph
9 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub 320a622ec4 [BugFix] Implement RoPE for GPT-J (#941) 2023-09-06 11:54:33 +09:00
Woosuk KwonandGitHub 8ce9c50d40 Avoid compiling kernels for double data type (#933) 2023-09-02 14:59:47 +09:00
Zhuohan LiandGitHub 1b0bd0fe8a Add Falcon support (new) (#592) 2023-08-02 14:04:39 -07:00
Zhuohan LiandGitHub 6fc2a38b11 Add support for LLaMA-2 (#505) 2023-07-20 11:38:27 -07:00
Woosuk KwonandGitHub 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
Woosuk KwonandGitHub e070829ae8 Support bfloat16 data type (#54) 2023-05-03 14:09:44 -07:00
Woosuk KwonandGitHub a96d63c21d Add support for GPT-NeoX (Pythia) (#50) 2023-04-28 00:32:10 -07:00
Woosuk KwonandGitHub 897cb2ae28 Optimize data movement (#20) 2023-04-02 00:30:17 -07:00
Woosuk KwonandGitHub 88c0268a18 Implement custom kernel for LLaMA rotary embedding (#14) 2023-03-30 11:04:21 -07:00