youkaichaoandGitHub 8438e0569e [Core] RayWorkerVllm --> WorkerWrapper to reduce duplication (#4024) ...

[Core] replace narrow-usage RayWorkerVllm to general WorkerWrapper to reduce code duplication (#4024)

2024-04-17 08:34:33 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

executor_base.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

gpu_executor.py

[Misc] [CI] Fix CI failure caught after merge (#4126)

2024-04-16 17:56:01 -07:00

neuron_executor.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

ray_gpu_executor.py

[Core] RayWorkerVllm --> WorkerWrapper to reduce duplication (#4024)

2024-04-17 08:34:33 +00:00