wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-02 12:50:41 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc][3/N] Reorganize Serving section (#11766)

Browse Source 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Cyrus Leung authored and GitHub committed 2025-01-07 11:20:01 +08:00
1 parent d93d2d74fd
commit 8ceffbf315
40 files changed
+248 -133
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/features/spec_decode.md
+1 -1
View File
@@ -1,6 +1,6 @@
(spec-decode)=
# Speculative decoding
# Speculative Decoding
```{warning}
Please note that speculative decoding in vLLM is not yet optimized and does