vllm/tests/compile/piecewise/piecewise_compilation_config.json at 098f94de42859f8251fe920f87adb88336129c53 - vllm - Gitea: Git with a cup of tea

wassname/vllm

mirror of https://github.com/wassname/vllm.git synced 2026-07-12 18:33:38 +08:00

Files

T

youkaichao ff5ed6e1bc [torch.compile] rework compile control with piecewise cudagraph (#9715 )

Signed-off-by: youkaichao <youkaichao@gmail.com>

2024-10-29 23:03:49 -07:00

4 lines

75 B

JSON

Raw Blame History

 {
     "use_cudagraph": true,
     "non_cudagraph_ops": ["silly.attention"]
 }