Rui QiaoandGitHub 05308891e2 [Core] Pipeline parallel with Ray ADAG (#6837) ...

Support pipeline-parallelism with Ray accelerated DAG.

Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

2024-08-02 13:55:40 -07:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_basic_distributed_correctness.py

[ci][distributed] fix device count call

2024-06-30 08:06:13 +00:00

test_chunked_prefill_distributed.py

[ci][distributed] fix device count call

2024-06-30 08:06:13 +00:00

test_comm_ops.py

[Core] Pipeline Parallel Support (#4412)

2024-07-02 10:58:08 -07:00

test_custom_all_reduce.py

[Distributed] Add send and recv helpers (#5719)

2024-06-23 14:42:28 -07:00

test_multimodal_broadcast.py

[Bugfix] Fix broadcasting logic for multi_modal_kwargs (#6836)

2024-07-31 10:38:45 +08:00

test_pipeline_parallel.py

[Core] Pipeline parallel with Ray ADAG (#6837)

2024-08-02 13:55:40 -07:00

test_pipeline_partition.py

[MISC] Introduce pipeline parallelism partition strategies (#6920)

2024-07-31 12:02:17 -07:00

test_pynccl.py

[Distributed] Add send and recv helpers (#5719)

2024-06-23 14:42:28 -07:00

test_same_node.py

[ci] try to add multi-node tests (#6280)

2024-07-12 21:51:48 -07:00

test_shm_broadcast.py

[core][distributed] zmq fallback for broadcasting large objects (#6183)

2024-07-09 18:49:11 -07:00

test_utils.py

[ROCm][AMD] unify CUDA_VISIBLE_DEVICES usage in cuda/rocm (#6352)

2024-07-11 21:30:46 -07:00