vllm/docs/source/features/quantization at fa9ee08121d1d0ffb19c64f4b72ee653589e983b - vllm

mirror of https://github.com/wassname/vllm.git synced 2026-06-28 17:20:06 +08:00

Files

T

Kyle Sayers 3f9b7ab9f5 [Doc] Update examples to remove SparseAutoModelForCausalLM (#12062 )

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

2025-01-15 06:36:01 +00:00

auto_awq.md

2025-01-12 00:17:13 -08:00

bnb.md

2025-01-12 00:17:13 -08:00

fp8_e4m3_kvcache.md

2025-01-12 00:17:13 -08:00

fp8_e5m2_kvcache.md

2025-01-06 21:40:31 +08:00

fp8.md

2025-01-15 06:36:01 +00:00

gguf.md

2025-01-12 00:17:13 -08:00

index.md

2025-01-06 21:40:31 +08:00

int8.md

2025-01-15 06:36:01 +00:00

supported_hardware.md

2025-01-14 04:37:52 +00:00