youkaichaoandGitHub 89ce62a316 [platform] add ray_device_key (#11948) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>

2025-01-13 16:20:52 +08:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100)

2025-01-12 13:01:52 +00:00

distributed_gpu_executor.py

[Frontend] Log the maximum supported concurrency (#8831)

2024-10-09 00:03:14 -07:00

executor_base.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

gpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

hpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

msgspec_utils.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109)

2024-08-18 17:57:20 -07:00

multiproc_gpu_executor.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

multiproc_worker_utils.py

[V1] [4/N] API Server: ZMQ/MP Utilities (#11541)

2024-12-28 01:45:08 +00:00

multiproc_xpu_executor.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00

neuron_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

openvino_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

ray_gpu_executor.py

[Misc] Optimize ray worker initialization time (#11275)

2024-12-18 23:38:02 -08:00

ray_hpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_tpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_utils.py

[platform] add ray_device_key (#11948)

2025-01-13 16:20:52 +08:00

ray_xpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

tpu_executor.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

xpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00