wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-16 11:23:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
136 Commits 1 Branch 0 Tags
b322fd1607597930993dfd005343c4f04c6545d4
Commit Graph
4 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub c9d5b6d4a8 Replace FlashAttention with xformers (#70) 2023-05-05 02:01:08 -07:00
Woosuk KwonandGitHub a96d63c21d Add support for GPT-NeoX (Pythia) (#50) 2023-04-28 00:32:10 -07:00
Woosuk KwonandGitHub 897cb2ae28 Optimize data movement (#20) 2023-04-02 00:30:17 -07:00
Woosuk KwonandGitHub 88c0268a18 Implement custom kernel for LLaMA rotary embedding (#14) 2023-03-30 11:04:21 -07:00