vllm/docs/source/features/quantization at b7ee940a828de9d339345e28eee8b13d60d97f26 - vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-02 06:49:20 +08:00

Files

T

TJian 8a1f938e6f [Doc] Update Quantization Hardware Support Documentation (#12025 )

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

2025-01-14 04:37:52 +00:00

auto_awq.md

2025-01-12 00:17:13 -08:00

bnb.md

2025-01-12 00:17:13 -08:00

fp8_e4m3_kvcache.md

2025-01-12 00:17:13 -08:00

fp8_e5m2_kvcache.md

2025-01-06 21:40:31 +08:00

fp8.md

2025-01-12 00:17:13 -08:00

gguf.md

2025-01-12 00:17:13 -08:00

index.md

2025-01-06 21:40:31 +08:00

int8.md

2025-01-12 00:17:13 -08:00

supported_hardware.md

2025-01-14 04:37:52 +00:00