This website requires JavaScript.
Explore
Help
Register
Sign In
wassname
/
vllm
Watch
1
Star
0
Fork
0
mirror of
https://github.com/wassname/vllm.git
synced
2026-07-22 13:00:10 +08:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
7a7929abe8e2fd6a4688487c471a1ee1fde0edd2
vllm
/
csrc
T
History
Woosuk Kwon
and
GitHub
88c0268a18
Implement custom kernel for LLaMA rotary embedding (
#14
)
2023-03-30 11:04:21 -07:00
..
attention_kernels.cu
Implement
single_query_cached_kv_attention
kernel (
#3
)
2023-03-01 15:02:19 -08:00
attention_utils.h
Implement
single_query_cached_kv_attention
kernel (
#3
)
2023-03-01 15:02:19 -08:00
attention.cpp
Implement
single_query_cached_kv_attention
kernel (
#3
)
2023-03-01 15:02:19 -08:00
cache_kernels.cu
Implement custom kernel for LLaMA rotary embedding (
#14
)
2023-03-30 11:04:21 -07:00
cache.cpp
Support beam search & parallel generation (
#7
)
2023-03-10 09:58:21 -08:00
cuda_primitives.h
Implement
single_query_cached_kv_attention
kernel (
#3
)
2023-03-01 15:02:19 -08:00
pos_encoding_kernels.cu
Implement custom kernel for LLaMA rotary embedding (
#14
)
2023-03-30 11:04:21 -07:00
pos_encoding.cpp
Implement custom kernel for LLaMA rotary embedding (
#14
)
2023-03-30 11:04:21 -07:00
