wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-11 18:06:31 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
0deacbce6e96a1af5885babc4e470ce2a0cecf95
vllm/README.md
T
Woosuk Kwon c84c708a1d Add README
2023-02-24 12:04:49 +00:00

134 B
Raw Blame History

CacheFlow

Installation

pip install cmake torch transformers
pip install -e .

Run

python server.py
Reference in New Issue View Git Blame Copy Permalink