wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-22 13:00:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,934 Commits 1 Branch 0 Tags
5ce4627a7ec4cf4e19ff4be7f030883ef486393f
Commit Graph
6 Commits
Author SHA1 Message Date
Pavani MajetyandGitHub b6dde33019 [Core] Flashinfer - Remove advance step size restriction (#10282) 2024-11-13 16:29:32 +08:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		afb050b29d [Core] CUDA Graphs for Multi-Step + Chunked-Prefill (#8645) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-10-02 19:44:39 +00:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		c2ec430ab5 [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-09-27 13:32:07 -07:00
Tyler Michael SmithandGitHub 71d21c73ab [Bugfix] Fixup advance_step.cu warning (#8815) 2024-09-26 16:23:45 -07:00
William LinandGitHub a6c0f3658d [multi-step] add flashinfer backend (#7928) 2024-09-12 11:16:22 -07:00
Alexander MatveevandGitHub e76466dde2 [Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338) 2024-07-17 14:30:28 -07:00