Cody YuandGitHub 7206ce4ce1 [Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

..

__init__.py

Add distributed model executor abstraction (#3191)

2024-03-11 11:03:45 -07:00

executor_base.py

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

mp_distributed_executor.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

msgspec_utils.py

[Core] Optimize SPMD architecture with delta + serialization optimization (#7109)

2024-08-18 17:57:20 -07:00

multiproc_worker_utils.py

[core] allow callable in collective_rpc (#12151)

2025-01-17 20:47:01 +08:00

ray_distributed_executor.py

[core] allow callable in collective_rpc (#12151)

2025-01-17 20:47:01 +08:00

ray_utils.py

[core] platform agnostic executor via collective_rpc (#11256)

2025-01-15 13:45:21 +08:00

uniproc_executor.py

[core] allow callable in collective_rpc (#12151)

2025-01-17 20:47:01 +08:00