vllm/benchmarks/cutlass_benchmarks at 01c16ede6b4fc2e07b6eb5a4f60a64a1f365e460 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-08-05 13:30:14 +08:00

Files

T

History

Woosuk KwonandGitHub a9a2e74d21 [Misc] Use torch.Tensor for type annotation (#6505 )

2024-07-17 13:01:10 +00:00

..

w8a8_benchmarks.py

[Misc] Use torch.Tensor for type annotation (#6505 )

2024-07-17 13:01:10 +00:00

weight_shapes.py

Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00