Woosuk KwonandGitHub 4089985552 [V1] Integrate Piecewise CUDA graphs (#10058) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2024-11-05 22:16:04 -08:00

..

__init__.py

[torch.compile] avoid Dynamo guard evaluation overhead (#7898)

2024-08-28 16:10:12 -07:00

backends.py

[V1] Integrate Piecewise CUDA graphs (#10058)

2024-11-05 22:16:04 -08:00

compile_context.py

[torch.compile] integration with compilation control (#9058)

2024-10-10 12:39:36 -07:00

config.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

counter.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

decorators.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

levels.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

wrapper.py

[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)

2024-10-16 22:55:59 +00:00