wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-30 03:31:34 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
33e0602e59cfb37ab0bfdff5ea6802aeb3a3ecc9
vllm/csrc
T
History
Yang Chen 95460fc513 [Kernel] port sgl moe_align_block_size kernels (#12574) 
sgl_moe_align_block_size is based on:


https://github.com/sgl-project/sglang/commit/ded9fcd09a43d5e7d5bb31a2bc3e9fc21bf65d2a

moe_align_block_size is based on:


https://github.com/sgl-project/sglang/commit/ba5112ff691d791a9e38c6c71f59324a5fcb49d0

Signed-off-by: Yang Chen <yangche@fb.com>
2025-02-03 13:09:50 +08:00
..
attention
[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)
2025-01-23 18:04:03 +00:00
core
[Kernel] Update cutlass_scaled_mm to support 2d group (blockwise) scaling (#11868)
2025-01-30 18:33:00 -08:00
cpu
[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)
2025-01-23 18:04:03 +00:00
cutlass_extensions
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
mamba
[MISC] Replace c10::optional with std::optional (#11730)
2025-01-05 10:20:34 +09:00
moe
[Kernel] port sgl moe_align_block_size kernels (#12574)
2025-02-03 13:09:50 +08:00
prepare_inputs
[Misc] Add multipstep chunked-prefill support for FlashInfer (#10467)
2025-01-15 12:47:49 +08:00
quantization
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
rocm
Update pre-commit hooks (#12475)
2025-01-27 17:23:08 -07:00
sparse/cutlass
[MISC] Replace c10::optional with std::optional (#11730)
2025-01-05 10:20:34 +09:00
activation_kernels.cu
[Kernel] Support MulAndSilu (#11624)
2025-01-15 02:29:53 +00:00
cache_kernels.cu
[Attention] MLA decode optimizations (#12528)
2025-01-30 23:49:37 -08:00
cache.h
[Attention] MLA decode optimizations (#12528)
2025-01-30 23:49:37 -08:00
cuda_compat.h
[Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927)
2024-06-02 14:13:26 -07:00
cuda_utils_kernels.cu
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
cuda_utils.h
[Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel (#7174)
2024-08-20 07:09:33 -06:00
cumem_allocator.cpp
[Core] Support fully transparent sleep mode (#11743)
2025-01-22 14:39:32 +08:00
custom_all_reduce_test.cu
[Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030)
2024-11-06 23:50:47 -08:00
custom_all_reduce.cu
[Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030)
2024-11-06 23:50:47 -08:00
custom_all_reduce.cuh
Update pre-commit hooks (#12475)
2025-01-27 17:23:08 -07:00
dispatch_utils.h
[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)
2024-12-13 03:19:23 +00:00
layernorm_kernels.cu
[torch.compile] Fuse RMSNorm with quant (#9138)
2024-11-08 21:20:08 +00:00
layernorm_quant_kernels.cu
[torch.compile] Fuse RMSNorm with quant (#9138)
2024-11-08 21:20:08 +00:00
ops.h
[Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (#12587)
2025-01-31 15:29:11 -08:00
permute_cols.cu
[Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701)
2024-09-23 13:46:26 -04:00
pos_encoding_kernels.cu
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)
2024-06-09 16:23:30 -04:00
torch_bindings.cpp
[Kernel][Quantization] Integrate block-quantized CUTLASS kernels for DeepSeekV3 (#12587)
2025-01-31 15:29:11 -08:00
type_convert.cuh
[torch.compile] Fuse RMSNorm with quant (#9138)
2024-11-08 21:20:08 +00:00