wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-14 12:50:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,239 Commits 1 Branch 0 Tags
e53dfd3eafd9bd5cc217c3796c7d1911a88ec893
Commit Graph
6 Commits
Author SHA1 Message Date
Earthwalker 7f8d612d24 [TPU] Support tensor parallelism in async llm engine (#6891) 2024-07-29 12:42:21 -07:00
Woosuk Kwon fad5576c58 [TPU] Reduce compilation time & Upgrade PyTorch XLA version (#6856) 2024-07-27 10:28:33 -07:00
Woosuk Kwon c467dff24f [Hardware][TPU] Support MoE with Pallas GMM kernel (#6457) 2024-07-16 09:56:28 -07:00
Woosuk Kwonandkevin 4552e37b55 [CI/Build][TPU] Add TPU CI test (#6277) 
Co-authored-by: kevin <kevin@anyscale.com>
 2024-07-15 14:31:16 -07:00
Woosuk Kwon 08c5bdecae [Bugfix][TPU] Fix outlines installation in TPU Dockerfile (#6256) 2024-07-09 02:56:06 -07:00
Woosuk Kwon 1a8bfd92d5 [Hardware] Initial TPU integration (#5292) 2024-06-12 11:53:03 -07:00