wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-14 11:19:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
141 Commits 1 Branch 0 Tags
c3442c1f6fabe54adb82d2d676920c5f31b9834e
Commit Graph
15 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub c3442c1f6f Refactor system architecture (#109) 2023-05-20 13:06:59 -07:00
Woosuk KwonandGitHub 55f8b0a5de Implement presence and frequency penalties (#95) 2023-05-10 23:39:12 -07:00
Woosuk KwonandGitHub 8d66a7b6d7 Rename variables and methods (#91) 2023-05-10 00:58:31 -07:00
Woosuk KwonandGitHub 84eee24e20 Collect system stats in scheduler & Add scripts for experiments (#30) 2023-04-12 15:03:49 -07:00
Woosuk KwonandGitHub 7a7929abe8 Implement preemption via recomputation & Refactor scheduling logic (#12) 2023-03-30 14:51:46 -07:00
Woosuk Kwon d359cda5fa Minor 2023-03-26 08:00:39 +00:00
Zhuohan LiandGitHub 2f49f15585 Support tensor parallel (#2) 2023-03-21 13:45:42 -07:00
Woosuk KwonandGitHub 1a7eb7da61 Support beam search & parallel generation (#7) 2023-03-10 09:58:21 -08:00
Woosuk Kwon b39f149a08 Add is_finished 2023-02-24 11:44:21 +00:00
Woosuk Kwon af16c05074 Add get_len 2023-02-23 05:58:04 +00:00
Woosuk Kwon d094512296 Move max_context_len 2023-02-23 04:57:46 +00:00
Woosuk Kwon 3363c27d19 Add __repr__ 2023-02-14 09:34:07 +00:00
Woosuk Kwon 0961f5a49a Add find method to sequence group 2023-02-13 02:39:12 +00:00
Woosuk Kwon a2a9869cb7 SERVING -> RUNNING 2023-02-12 08:25:05 +00:00
Woosuk Kwon d904350a2c Add sequence 2023-02-09 11:26:35 +00:00