wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-15 12:54:49 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,623 Commits 1 Branch 0 Tags
ab66536dbfedff4ffcbb6dc9f9a21d0a9ac0ec91
Commit Graph
5 Commits
Author SHA1 Message Date
sasha0552 dcbf4286af [Frontend] Customizable RoPE theta (#5197) 2024-06-11 10:42:26 -07:00
Zhuohan Lirsnm2Robert Shaw
 		1102bef219 [Bugfix / Core] Prefix Caching Guards (merged with main) (#4846) 
Co-authored-by: rsnm2 <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
 2024-05-27 15:18:17 -07:00
sasha0552 9b9a10d6cb [Frontend] Dynamic RoPE scaling (#4638) 2024-05-22 01:32:35 -04:00
Antoni Baum 69e1d2fb69 [Core] Refactor model loading code (#4097) 2024-04-16 11:34:39 -07:00
陈序andCade Daniel 54be8a0be2 Fix assertion failure in Qwen 1.5 with prefix caching enabled (#3373) 
Co-authored-by: Cade Daniel <edacih@gmail.com>
 2024-03-14 13:56:57 -07:00