Russell BryantandGitHub 4863e5fba5 [Core] V1: Use multiprocessing by default (#11074) ...

Signed-off-by: Russell Bryant <rbryant@redhat.com>

2024-12-13 16:27:32 -08:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

cpu_executor.py

[core][executor] simplify instance id (#10976)

2024-12-07 09:33:45 -08:00

distributed_gpu_executor.py

[Frontend] Log the maximum supported concurrency (#8831)

2024-10-09 00:03:14 -07:00

executor_base.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

gpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

hpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00

msgspec_utils.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109)

2024-08-18 17:57:20 -07:00

multiproc_gpu_executor.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

multiproc_worker_utils.py

[Core] V1: Use multiprocessing by default (#11074)

2024-12-13 16:27:32 -08:00

multiproc_xpu_executor.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00

neuron_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

openvino_executor.py

[Bugfix] Fix OpenVino/Neuron driver_worker init (#10779)

2024-11-30 12:07:13 +08:00

ray_gpu_executor.py

[core] Bump ray to use _overlap_gpu_communication in compiled graph tests (#10410)

2024-12-11 11:36:35 -08:00

ray_hpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_tpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

ray_utils.py

[Distributed] Allow the placement group more time to wait for resources to be ready (#11138)

2024-12-13 20:17:37 +00:00

ray_xpu_executor.py

[core][misc] remove use_dummy driver for _run_workers (#10920)

2024-12-07 12:06:08 -08:00

tpu_executor.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

xpu_executor.py

[platforms] absorb worker cls difference into platforms folder (#10555)

2024-11-21 21:00:32 -08:00