Maxime Fournioux fe2e10c71b Add example of helm chart for vllm deployment on k8s (#9199) ...

Signed-off-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>

2024-12-10 09:19:27 +00:00

..

architecture_helm_deployment.png

Add example of helm chart for vllm deployment on k8s (#9199)

2024-12-10 09:19:27 +00:00

deploying_with_bentoml.rst

docs: Add BentoML deployment doc (#3336)

2024-03-12 10:34:30 -07:00

deploying_with_cerebrium.rst

[DOC] - Add docker image to Cerebrium Integration (#6510)

2024-07-17 10:22:53 -07:00

deploying_with_docker.rst

[Doc] Update docker references (#5614)

2024-06-19 15:01:45 -07:00

deploying_with_dstack.rst

[Doc][CI/Build] Update docs and tests to use vllm serve (#6431)

2024-07-17 07:43:21 +00:00

deploying_with_helm.rst

Add example of helm chart for vllm deployment on k8s (#9199)

2024-12-10 09:19:27 +00:00

deploying_with_k8s.rst

[Doc]: Add deploying_with_k8s guide (#8451)

2024-10-07 13:31:45 -07:00

deploying_with_kserve.rst

Update link to KServe deployment guide (#9173)

2024-10-09 03:58:49 +00:00

deploying_with_kubeai.rst

[Doc] add KubeAI to serving integrations (#10837)

2024-12-06 17:03:56 +00:00

deploying_with_lws.rst

Support to serve vLLM on Kubernetes with LWS (#4829)

2024-05-16 16:37:29 -07:00

deploying_with_nginx.rst

[Hardware][Intel CPU][DOC] Update docs for CPU backend (#6212)

2024-10-22 10:38:04 -07:00

deploying_with_triton.rst

Add documentation to Triton server tutorial (#983)

2023-09-20 10:32:40 -07:00

distributed_serving.rst

[doc] update pp support (#9853)

2024-10-30 13:36:51 -07:00

integrations.rst

[Doc] add KubeAI to serving integrations (#10837)

2024-12-06 17:03:56 +00:00

metrics.rst

Add small example to metrics.rst (#10550)

2024-11-21 23:43:43 +00:00

openai_compatible_server.md

[Docs] Add dedicated tool calling page to docs (#10554)

2024-12-09 20:15:34 -05:00

run_on_sky.rst

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00

serving_with_langchain.rst

docs: fix langchain (#2736)

2024-02-03 18:17:55 -08:00

serving_with_llamaindex.rst

llama_index serving integration documentation (#6973)

2024-08-14 15:38:37 -07:00

serving_with_llamastack.rst

Add docs on serving with Llama Stack (#10183)

2024-11-11 11:28:55 -08:00

tensorizer.rst

[Doc]: Update tensorizer docs to include vllm[tensorizer] (#7889)

2024-10-22 15:43:25 -07:00