3 people de0526f668 [Misc][Quark] Upstream Quark format to VLLM (#10765) ...

Signed-off-by: kewang-xlnx <kewang@xilinx.com>
Signed-off-by: kewang2 <kewang2@amd.com>
Co-authored-by: kewang2 <kewang2@amd.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

2025-01-15 11:05:15 -05:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_bitsandbytes.py

[Bugfix] bitsandbytes models fail to run pipeline parallel (#10200)

2024-11-13 09:56:39 -07:00

test_compressed_tensors.py

[Misc] add w8a8 asym models (#11075)

2024-12-23 13:33:20 -05:00

test_configs.py

[Model] Add user-configurable task for models that support both generation and embedding (#9424)

2024-10-18 11:31:58 -07:00

test_cpu_offload.py

[ci][test] adjust max wait time for cpu offloading test (#7709)

2024-08-20 17:12:44 -07:00

test_experts_int8.py

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

test_fp8.py

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

test_ipex_quant.py

[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)

2024-11-18 11:18:05 -07:00

test_lm_head.py

[Core] Support loading GGUF model (#5191)

2024-08-05 17:54:23 -06:00

test_quark.py

[Misc][Quark] Upstream Quark format to VLLM (#10765)

2025-01-15 11:05:15 -05:00

utils.py

[torch.compile] limit inductor threads and lazy import quant (#10482)

2024-11-20 18:36:33 -08:00