wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-30 03:14:32 +08:00
Code Issues Packages Projects Releases Wiki Activity
156 Commits 1 Branch 0 Tags
62ec38ea4148bb8147f346f7e01cab6b8a2ec7b6
Commit Graph

3 Commits

Author SHA1 Message Date
Woosuk Kwon 337871c6fd Enable LLaMA fast tokenizer (#132) 2023-05-28 02:51:42 -07:00
Woosuk Kwon e86717833d Incrementally decode output tokens (#121) 2023-05-23 20:46:32 -07:00
Woosuk Kwon c3442c1f6f Refactor system architecture (#109) 2023-05-20 13:06:59 -07:00