wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-18 12:50:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,711 Commits 1 Branch 0 Tags
6cb748e190a94e20987314025614b8bd806602f2
Commit Graph
6 Commits
Author SHA1 Message Date
sroy745andGitHub 2febcf2777 [Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962) 2024-09-05 16:25:29 -04:00
Stas BekmanandGitHub 0e12cd67a8 [Doc] add online speculative decoding example (#7243) 2024-08-07 09:58:02 -07:00
Thomas ParnellandGitHub 789937af2e [Doc] [SpecDecode] Update MLPSpeculator documentation (#7100) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2024-08-05 23:29:43 +00:00
Yuan TangandGitHub 6ef3bf912c Remove unnecessary trailing period in spec_decode.rst (#6405) 2024-07-14 07:58:09 +00:00
Cade DanielandGitHub 89ec06c33b [Docs] [Spec decode] Fix docs error in code example (#5427) 2024-06-11 10:31:56 -07:00
Cade DanielandGitHub 4c2ffb28ff [Speculative decoding] Initial spec decode docs (#5400) 2024-06-11 10:15:40 -07:00