Sungjae LeeandGitHub c31d4a57a6 [Core] support LoRA and prompt adapter in content-based hashing for Block Manager v2 prefix caching (#8240)

2024-12-13 07:51:25 -08:00

..

block

[Core] support LoRA and prompt adapter in content-based hashing for Block Manager v2 prefix caching (#8240)

2024-12-13 07:51:25 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

block_manager.py

[Core] support LoRA and prompt adapter in content-based hashing for Block Manager v2 prefix caching (#8240)

2024-12-13 07:51:25 -08:00

evictor.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

interfaces.py

Prefix Cache Aware Scheduling [1/n] (#10128)

2024-11-22 21:15:55 -08:00

placeholder_block_space_manager.py

[Doc] Update docs to refer to pooling models (#11093)

2024-12-11 13:36:27 +00:00

scheduler.py

[Misc] Split up pooling tasks (#10820)

2024-12-11 01:28:00 -08:00