wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-28 23:59:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
708 Commits 1 Branch 0 Tags
cd9e60c76c776c42431b7ae523fcfe7835546d74
Commit Graph

3 Commits

Author SHA1 Message Date
zhaoyang-star 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) 
Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2024-01-28 16:43:54 -08:00
Simon Mo 4cefa9b49b [Docs] Update the AWQ documentation to highlight performance issue (#1883) 2023-12-02 15:52:47 -08:00
Casper 8516999495 Add Quantization and AutoAWQ to docs (#1235) 2023-11-04 22:43:39 -07:00