docs: add description (#1553)

This commit is contained in:
lots-o
2023-11-03 09:14:52 -07:00
committed by GitHub
parent 9738b84a08
commit 54ca1ba71d
+1
View File
@@ -53,6 +53,7 @@ class RequestOutput:
request_id: The unique ID of the request.
prompt: The prompt string of the request.
prompt_token_ids: The token IDs of the prompt.
prompt_logprobs: The log probabilities to return per prompt token.
outputs: The output sequences of the request.
finished: Whether the whole request is finished.
"""