mirror of
https://github.com/wassname/vllm.git
synced 2026-08-12 12:30:29 +08:00
[Docs] Update FP8 KV Cache documentation (#12238)
Signed-off-by: mgoin <michael@neuralmagic.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
This commit is contained in:
co-authored by
Cyrus Leung
parent
8d7aa9de71
commit
01a55941f5
@@ -14,6 +14,5 @@ bnb
|
||||
gguf
|
||||
int8
|
||||
fp8
|
||||
fp8_e5m2_kvcache
|
||||
fp8_e4m3_kvcache
|
||||
quantized_kvcache
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user