vllm/docs/source/features/quantization at da02cb4b274ab8bcebb8b8e677ff4b43440bc499 - vllm

mirror of https://github.com/wassname/vllm.git synced 2026-06-28 01:47:27 +08:00

Files

T

Kyle Sayers 3f9b7ab9f5 [Doc] Update examples to remove SparseAutoModelForCausalLM (#12062 )

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

2025-01-15 06:36:01 +00:00

auto_awq.md

2025-01-12 00:17:13 -08:00

bnb.md

2025-01-12 00:17:13 -08:00

fp8_e4m3_kvcache.md

2025-01-12 00:17:13 -08:00

fp8_e5m2_kvcache.md

2025-01-06 21:40:31 +08:00

fp8.md

2025-01-15 06:36:01 +00:00

gguf.md

2025-01-12 00:17:13 -08:00

index.md

2025-01-06 21:40:31 +08:00

int8.md

2025-01-15 06:36:01 +00:00

supported_hardware.md

2025-01-14 04:37:52 +00:00