4 people ca3ea51bde [Kernel] Dynamic Per-Token Activation Quantization (#5037) ...

Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

2024-06-07 09:36:26 -07:00

..

attention

[Model] Support MAP-NEO model (#5081)

2024-05-30 19:24:41 -07:00

cpu

[CI/BUILD] enable intel queue for longer CPU tests (#4113)

2024-06-03 10:39:50 -07:00

moe

[Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927)

2024-06-02 14:13:26 -07:00

punica

[Model] LoRA gptbigcode implementation (#3949)

2024-05-22 13:58:59 -07:00

quantization

[Kernel] Dynamic Per-Token Activation Quantization (#5037)

2024-06-07 09:36:26 -07:00

activation_kernels.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

cache_kernels.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

cache.h

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

cuda_compat.h

[Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927)

2024-06-02 14:13:26 -07:00

cuda_utils_kernels.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

cuda_utils.h

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

custom_all_reduce_test.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

custom_all_reduce.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

custom_all_reduce.cuh

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

dispatch_utils.h

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

layernorm_kernels.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

moe_align_block_size_kernels.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

ops.h

[Kernel] Dynamic Per-Token Activation Quantization (#5037)

2024-06-07 09:36:26 -07:00

pos_encoding_kernels.cu

[CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722)

2024-05-22 07:18:41 +00:00

pybind.cpp

[Kernel] Dynamic Per-Token Activation Quantization (#5037)

2024-06-07 09:36:26 -07:00

reduction_utils.cuh

[Kernel] Dynamic Per-Token Activation Quantization (#5037)

2024-06-07 09:36:26 -07:00