wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-14 12:50:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,706 Commits 1 Branch 0 Tags
fd57d2b5347e8fe6da9287553d4b5a3aaf2e6693
Commit Graph
6 Commits
Author SHA1 Message Date
Pavani Majety b6dde33019 [Core] Flashinfer - Remove advance step size restriction (#10282) 2024-11-13 16:29:32 +08:00
Varun Sundar RabindranathandVarun Sundar Rabindranath afb050b29d [Core] CUDA Graphs for Multi-Step + Chunked-Prefill (#8645) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-10-02 19:44:39 +00:00
Varun Sundar RabindranathandVarun Sundar Rabindranath c2ec430ab5 [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-09-27 13:32:07 -07:00
Tyler Michael Smith 71d21c73ab [Bugfix] Fixup advance_step.cu warning (#8815) 2024-09-26 16:23:45 -07:00
William Lin a6c0f3658d [multi-step] add flashinfer backend (#7928) 2024-09-12 11:16:22 -07:00
Alexander Matveev e76466dde2 [Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338) 2024-07-17 14:30:28 -07:00