This website requires JavaScript.
Explore
Help
Register
Sign In
wassname
/
vllm
Watch
1
Star
0
Fork
0
mirror of
https://github.com/wassname/vllm.git
synced
2026-07-19 11:29:39 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
c3372e87bed990510e4ae0b39f151a34dea24f8b
vllm
/
vllm
/
engine
T
History
Woosuk Kwon
and
GitHub
c3372e87be
Remove dependency on CuPy (
#2152
)
2023-12-17 01:49:07 -08:00
..
__init__.py
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
arg_utils.py
Optimize model execution with CUDA graph (
#1926
)
2023-12-16 21:12:08 -08:00
async_llm_engine.py
Fix typing in AsyncLLMEngine & add toml to requirements-dev (
#2100
)
2023-12-14 00:19:41 -08:00
llm_engine.py
Remove dependency on CuPy (
#2152
)
2023-12-17 01:49:07 -08:00
metrics.py
Add Production Metrics in Prometheus format (
#1890
)
2023-12-02 16:37:44 -08:00
ray_utils.py
Optimize model execution with CUDA graph (
#1926
)
2023-12-16 21:12:08 -08:00
