wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-03 13:20:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,009 Commits 1 Branch 0 Tags
42de2cefcbfc1e640f3337b36d5dddfd3133ef0e
Commit Graph
2 Commits
Author SHA1 Message Date
sroy745andGitHub 80ca1e6a3a [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) 2024-07-01 00:33:05 -07:00
sroy745andGitHub fa9e385229 [Speculative Decoding 1/2 ] Add typical acceptance sampling as one of the sampling techniques in the verifier (#5131) 2024-06-17 21:29:09 -05:00