wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-19 12:40:48 +08:00
Code Issues Packages Projects Releases Wiki Activity
140 Commits 1 Branch 0 Tags
7297fa6f7c4ce6413ee005025b312c4c9d4f5f0b
Commit Graph
6 Commits
Author SHA1 Message Date
Zhuohan Li b7955ef17b Fix timeout error in the FastAPI frontend (#34) 2023-05-19 14:00:46 -06:00
Zhuohan Li f756799b84 Use runtime profiling to replace manual memory analyzers (#81) 2023-05-19 11:35:44 -06:00
Woosuk Kwon 42f1042e1c Enhance SamplingParams (#96) 2023-05-11 15:45:30 -07:00
Woosuk Kwon 55f8b0a5de Implement presence and frequency penalties (#95) 2023-05-10 23:39:12 -07:00
Woosuk Kwon 85eb631839 Use slow tokenizer for LLaMA (#84) 2023-05-09 16:03:44 -07:00
Woosuk Kwon 7c041ab578 Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00