vllm/csrc/punica/bgmv at 3cd9b5bb2d4a0d5eed07186ae140f5dc8f839708 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-28 11:27:56 +08:00

Files

T

History

Woosuk KwonandGitHub 468d761b32 [Misc] Reduce supported Punica dtypes (#4304 )

2024-04-23 18:54:33 -07:00

..

bgmv_bf16_bf16_bf16.cu

Speed up Punica compilation (#2632 )

2024-01-27 17:46:56 -08:00

bgmv_bf16_fp32_bf16.cu

Speed up Punica compilation (#2632 )

2024-01-27 17:46:56 -08:00

bgmv_config.h

[Kernel] Add punica dimension for Swallow-MS-7B LoRA (#4134 )

2024-04-17 10:02:45 -07:00

bgmv_fp16_fp16_fp16.cu

Speed up Punica compilation (#2632 )

2024-01-27 17:46:56 -08:00

bgmv_fp16_fp32_fp16.cu

Speed up Punica compilation (#2632 )

2024-01-27 17:46:56 -08:00

bgmv_fp32_bf16_bf16.cu

Speed up Punica compilation (#2632 )

2024-01-27 17:46:56 -08:00

bgmv_fp32_fp16_fp16.cu

Speed up Punica compilation (#2632 )

2024-01-27 17:46:56 -08:00

bgmv_impl.cuh

[Experimental] Add multi-LoRA support (#1804 )

2024-01-23 15:26:37 -08:00

generator.py

[Misc] Reduce supported Punica dtypes (#4304 )

2024-04-23 18:54:33 -07:00

vec_dtypes.cuh

[Experimental] Add multi-LoRA support (#1804 )

2024-01-23 15:26:37 -08:00