Luka GovedičandGitHub 8b0fe06c89 [torch.compile] Inductor code caching fix (#10273) ...

Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>

2024-11-20 21:44:57 -08:00

..

attention

[V1] Make v1 more testable (#9888)

2024-11-06 11:57:35 -08:00

core

[V1] Support VLMs with fine-grained scheduling (#9871)

2024-11-13 04:53:13 +00:00

engine

[Misc] Fix import error in tensorizer tests and cleanup some code (#10349)

2024-11-15 09:34:17 +00:00

executor

[V1] Fix Configs (#9971)

2024-11-04 00:24:40 +00:00

sample

[V1] Support per-request seed (#9945)

2024-11-03 09:14:17 -08:00

worker

[torch.compile] Inductor code caching fix (#10273)

2024-11-20 21:44:57 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

outputs.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

request.py

[1/N] Initial prototype for multi-modal processor (#10044)

2024-11-13 12:39:03 +00:00

serial_utils.py

[V1] Use pickle for serializing EngineCoreRequest & Add multimodal inputs to EngineCoreRequest (#10245)

2024-11-12 08:57:14 -08:00

utils.py

[V1] Add all_token_ids attribute to Request (#10135)

2024-11-07 17:08:24 -08:00