This website requires JavaScript.
Explore
Help
Register
Sign In
wassname
/
vllm
Watch
1
Star
0
Fork
0
mirror of
https://github.com/wassname/vllm.git
synced
2026-07-30 12:40:38 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
4bfa7e7f75eb5b1a397c93aeea1dea1afa867b2a
vllm
/
csrc
/
attention
T
History
Cody Yu
and
GitHub
c833101740
[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (
#4535
)
2024-05-09 18:04:17 -06:00
..
attention_dtypes.h
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
attention_generic.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
attention_kernels.cu
[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (
#4535
)
2024-05-09 18:04:17 -06:00
attention_utils.cuh
Merge EmbeddedLLM/vllm-rocm into vLLM main (
#1836
)
2023-12-07 23:16:52 -08:00
dtype_bfloat16.cuh
Merge EmbeddedLLM/vllm-rocm into vLLM main (
#1836
)
2023-12-07 23:16:52 -08:00
dtype_float16.cuh
Merge EmbeddedLLM/vllm-rocm into vLLM main (
#1836
)
2023-12-07 23:16:52 -08:00
dtype_float32.cuh
[BugFix] Fix NaN errors in paged attention kernel (
#936
)
2023-09-04 09:20:06 +09:00
dtype_fp8.cuh
[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (
#4535
)
2024-05-09 18:04:17 -06:00
