Kuntai Du 0590ec3fd9 [Core] Implement disagg prefill by StatelessProcessGroup (#10502) ...

This PR provides initial support for single-node disaggregated prefill in 1P1D scenario.
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>

2024-12-01 19:01:00 -06:00

..

disagg_overhead_benchmark.sh

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

disagg_performance_benchmark.sh

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

disagg_prefill_proxy_server.py

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

round_robin_proxy.py

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00

visualize_benchmark_results.py

[Core] Implement disagg prefill by StatelessProcessGroup (#10502)

2024-12-01 19:01:00 -06:00