vllm/benchmarks/cutlass_benchmarks at 2eb9f4ff262bb39859baebf8d2109abcdadee860 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-04 04:29:00 +08:00

Files

T

History

Woosuk Kwon a9a2e74d21 [Misc] Use torch.Tensor for type annotation (#6505 )

2024-07-17 13:01:10 +00:00

..

w8a8_benchmarks.py

[Misc] Use torch.Tensor for type annotation (#6505 )

2024-07-17 13:01:10 +00:00

weight_shapes.py

Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00