[Docs] Update FP8 KV Cache documentation (#12238)

Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
This commit is contained in:
Michael Goin
2025-01-23 11:18:09 +08:00
committed by GitHub
co-authored by Cyrus Leung
parent 8d7aa9de71
commit 01a55941f5
4 changed files with 146 additions and 77 deletions
+1 -2
View File
@@ -14,6 +14,5 @@ bnb
gguf
int8
fp8
fp8_e5m2_kvcache
fp8_e4m3_kvcache
quantized_kvcache
```