vllm/vllm/worker at 49d849b3ab7aa6ae493ccde1d85d226833f73fbb - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-25 13:30:54 +08:00

Files

T

History

Liangfu ChenandGitHub 3b7178cfa4 [Neuron] Support inference with transformers-neuronx (#2569 )

2024-02-28 09:34:34 -08:00

..

[Speculative decoding 2/9] Multi-step worker for draft model (#2424 )

2024-01-21 16:31:47 -08:00

__init__.py

Change the name to vLLM (#150 )

2023-06-17 03:07:40 -07:00

cache_engine.py

[Neuron] Support inference with transformers-neuronx (#2569 )

2024-02-28 09:34:34 -08:00

model_runner.py

[Neuron] Support inference with transformers-neuronx (#2569 )

2024-02-28 09:34:34 -08:00

neuron_worker.py

[Neuron] Support inference with transformers-neuronx (#2569 )

2024-02-28 09:34:34 -08:00

worker.py

[Minor] Small fix to make distributed init logic in worker looks cleaner (#2905 )

2024-02-18 14:39:00 -08:00