This website requires JavaScript.
Explore
Help
Register
Sign In
wassname
/
vllm
Watch
1
Star
0
Fork
0
mirror of
https://github.com/wassname/vllm.git
synced
2026-07-14 11:19:39 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
cf8cac8c701079a3fda068ffd1cd6f72a490aa6d
vllm
/
csrc
/
quantization
/
fp8
T
History
3 people
Philipp Moritz
GitHub
Woosuk Kwon
12628d3c78
[Kernel] Optimize FP8 support for MoE kernel / Mixtral via static scales (
#4343
)
...
Co-authored-by: Woosuk Kwon <
woosuk.kwon@berkeley.edu
>
2024-04-27 04:49:59 +00:00
..
amd_detail
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
fp8_cuda_kernels.cu
[Kernel] Optimize FP8 support for MoE kernel / Mixtral via static scales (
#4343
)
2024-04-27 04:49:59 +00:00