wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-16 11:30:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,074 Commits 1 Branch 0 Tags
29acd2c34cc542c96dbb584ea089f4b5404e54ef
Commit Graph
5 Commits
Author SHA1 Message Date
Harsha vardhan manoj BikkiandHarsha Bikki 257afc37c5 [Neuron] Adding support for context-lenght, token-gen buckets. (#7885) 
Co-authored-by: Harsha Bikki <harbikh@amazon.com>
 2024-08-29 13:58:14 -07:00
Tyler Michael Smith 5d2a1a9cf0 Unmark more files as executable (#5962) 2024-06-28 17:34:56 -04:00
Zhuohan Li e90fc21f2e [Hardware][Neuron] Refactor neuron support (#3471) 2024-03-22 01:22:17 +00:00
DAIZHENWEI 654865e21d Support Mistral Model Inference with transformers-neuronx (#3153) 2024-03-11 13:19:51 -07:00
Liangfu Chen 3b7178cfa4 [Neuron] Support inference with transformers-neuronx (#2569) 2024-02-28 09:34:34 -08:00