vllm/docs/source/features/quantization at c9d6ff530b32c526bedda3105dcbab3d2f6ce992 - vllm

mirror of https://github.com/wassname/vllm.git synced 2026-06-28 00:31:00 +08:00

Files

T

TJian 8a1f938e6f [Doc] Update Quantization Hardware Support Documentation (#12025 )

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

2025-01-14 04:37:52 +00:00

auto_awq.md

2025-01-12 00:17:13 -08:00

bnb.md

2025-01-12 00:17:13 -08:00

fp8_e4m3_kvcache.md

2025-01-12 00:17:13 -08:00

fp8_e5m2_kvcache.md

2025-01-06 21:40:31 +08:00

fp8.md

2025-01-12 00:17:13 -08:00

gguf.md

2025-01-12 00:17:13 -08:00

index.md

2025-01-06 21:40:31 +08:00

int8.md

2025-01-12 00:17:13 -08:00

supported_hardware.md

2025-01-14 04:37:52 +00:00