bk-TurbaAI 35ffa682b1 [Docs] hint to enable use of GPU performance counters in profiling tools for multi-node distributed serving (#11235) ...

Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-12-16 22:20:39 +00:00

..

_static

[doc] fix location of runllm widget (#10266)

2024-11-12 14:34:39 -08:00

_templates/sections

[Doc] Guide for adding multi-modal plugins (#6205)

2024-07-10 14:55:34 +08:00

assets

[Doc] add documentation for disaggregated prefilling (#11197)

2024-12-15 13:31:16 -06:00

automatic_prefix_caching

[doc] format fix (#10789)

2024-11-30 11:38:40 +00:00

community

[Docs] Add Nebius as sponsors (#10371)

2024-11-15 12:47:40 -08:00

contributing

[Doc] Move PR template content to docs (#10159)

2024-11-15 13:20:20 -08:00

design

[Core] V1: Use multiprocessing by default (#11074)

2024-12-13 16:27:32 -08:00

dev

[Doc] Move CONTRIBUTING to docs site (#9924)

2024-11-08 05:15:12 +00:00

getting_started

[Core] V1: Use multiprocessing by default (#11074)

2024-12-13 16:27:32 -08:00

models

[Model] Support Cohere2ForCausalLM (Cohere R7B) (#11203)

2024-12-16 09:56:19 +00:00

performance

Doc: Improve benchmark documentation (#9927)

2024-11-06 23:50:35 -08:00

quantization

[[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)

2024-12-15 03:03:06 +00:00

serving

[Docs] hint to enable use of GPU performance counters in profiling tools for multi-node distributed serving (#11235)

2024-12-16 22:20:39 +00:00

usage

[Doc] add documentation for disaggregated prefilling (#11197)

2024-12-15 13:31:16 -06:00

conf.py

[Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785)

2024-12-03 15:17:00 +08:00

generate_examples.py

Add example scripts to documentation (#4225)

2024-04-22 16:36:54 +00:00

index.rst

[Doc] add documentation for disaggregated prefilling (#11197)

2024-12-15 13:31:16 -06:00