wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-13 12:40:49 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,117 Commits 1 Branch 0 Tags
4fdc581f9e5740ba10b16ebf8a4c467e65bb9822
Commit Graph
5 Commits
Author SHA1 Message Date
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		afb050b29d [Core] CUDA Graphs for Multi-Step + Chunked-Prefill (#8645) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-10-02 19:44:39 +00:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		c2ec430ab5 [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-09-27 13:32:07 -07:00
Tyler Michael SmithandGitHub 71d21c73ab [Bugfix] Fixup advance_step.cu warning (#8815) 2024-09-26 16:23:45 -07:00
William LinandGitHub a6c0f3658d [multi-step] add flashinfer backend (#7928) 2024-09-12 11:16:22 -07:00
Alexander MatveevandGitHub e76466dde2 [Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338) 2024-07-17 14:30:28 -07:00