wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-30 12:40:38 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,803 Commits 1 Branch 0 Tags
e2f6f26e8636b8a23e5c0cda533a70c40ade01ec
Commit Graph
5 Commits
Author SHA1 Message Date
Harsha vardhan manoj BikkiGitHubHarsha Bikki
 		257afc37c5 [Neuron] Adding support for context-lenght, token-gen buckets. (#7885) 
Co-authored-by: Harsha Bikki <harbikh@amazon.com>
 2024-08-29 13:58:14 -07:00
Tyler Michael SmithandGitHub 5d2a1a9cf0 Unmark more files as executable (#5962) 2024-06-28 17:34:56 -04:00
Zhuohan LiandGitHub e90fc21f2e [Hardware][Neuron] Refactor neuron support (#3471) 2024-03-22 01:22:17 +00:00
DAIZHENWEIandGitHub 654865e21d Support Mistral Model Inference with transformers-neuronx (#3153) 2024-03-11 13:19:51 -07:00
Liangfu ChenandGitHub 3b7178cfa4 [Neuron] Support inference with transformers-neuronx (#2569) 2024-02-28 09:34:34 -08:00