[doc][misc] further lower visibility of simple api server (#6041)

Co-authored-by: Simon Mo <simon.mo@hey.com>
This commit is contained in:
youkaichaoandSimon Mo authored and GitHub committed 2024-07-01 10:50:56 -07:00
1 parent bb60326836
commit 8893130b63
1 file changed
+6 -1
+6 -1
View File
@@ -1,4 +1,9 @@
"""Example Python client for vllm.entrypoints.api_server"""
"""Example Python client for vllm.entrypoints.api_server
NOTE: The API server is used only for demonstration and simple performance
benchmarks. It is not intended for production use.
For production use, we recommend vllm.entrypoints.openai.api_server
and the OpenAI client API
"""
import argparse
import json