Sage Moore ce4f5a29fb Add Automatic Prefix Caching (#2762) ...

Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-03-02 00:50:01 -08:00

..

adding_model.rst

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

engine_args.rst

Add Automatic Prefix Caching (#2762)

2024-03-02 00:50:01 -08:00

lora.rst

multi-lora documentation fix (#3064)

2024-02-27 21:26:15 -08:00

supported_models.rst

[Minor] Fix StableLMEpochForCausalLM -> StableLmForCausalLM (#3046)

2024-02-26 20:23:50 -08:00