wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-16 11:23:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
187 Commits 1 Branch 0 Tags
2e0d3143844303136c8aefa4c7e7bac30fd26850
Commit Graph
11 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub 0b98ba15c7 Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
Zhuohan LiandGitHub e5464ee484 Rename servers to engines (#152) 2023-06-17 17:25:21 +08:00
Zhuohan LiandGitHub eedb46bf03 Rename servers and change port numbers to reduce confusion (#149) 2023-06-17 00:13:02 +08:00
Woosuk KwonandGitHub 311490a720 Add script for benchmarking serving throughput (#145) 2023-06-14 19:55:38 -07:00
Zhuohan LiandGitHub 5020e1e80c Non-streaming simple fastapi server (#144) 2023-06-10 10:43:07 -07:00
Zhuohan LiandGitHub 4298374265 Add docstrings for LLMServer and related classes and examples (#142) 2023-06-07 18:25:20 +08:00
Woosuk KwonandGitHub 211318d44a Add throughput benchmarking script (#133) 2023-05-28 03:20:05 -07:00
Zhuohan LiandGitHub 057daef778 OpenAI Compatible Frontend (#116) 2023-05-23 21:39:50 -07:00
Woosuk KwonandGitHub 655a5e48df Introduce LLM class for offline inference (#115) 2023-05-21 17:04:18 -07:00
Woosuk KwonandGitHub f746ced08d Implement stop strings and best_of (#114) 2023-05-21 11:18:00 -07:00
Woosuk KwonandGitHub c3442c1f6f Refactor system architecture (#109) 2023-05-20 13:06:59 -07:00