vllm/benchmarks/cutlass_benchmarks at 59a1eb59c9cb383e5ea36d7253f81ff2ea7766cc - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-05 21:43:57 +08:00

Files

T

History

Tyler Michael Smith 6820724e51 [Bugfix] Fix w8a8 benchmarks for int8 case (#5643 )

2024-06-19 00:33:25 +00:00

..

w8a8_benchmarks.py

[Bugfix] Fix w8a8 benchmarks for int8 case (#5643 )

2024-06-19 00:33:25 +00:00

weight_shapes.py

Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00