6 Commits

Include renames

Author	SHA1	Message	Date
tomeras91	ac04a97a9f	[Frontend] Add max_tokens prometheus metric (#9881) ... Signed-off-by: Tomer Asida <tomera@ai21.com>	2024-11-04 22:53:24 +00:00
Cyrus Leung	06386a64dd	[Frontend] Chat-based Embeddings API (#9759)	2024-11-01 08:13:35 +00:00
youkaichaoandBrendan Wong	cbc2ef5529	[misc] hide best_of from engine (#9261) ... Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>	2024-10-10 21:30:44 -07:00
Nick Hill	39178c7fbc	[Tests] Disable retries and use context manager for openai client (#7565)	2024-08-26 21:33:17 -07:00
Pooya Davoodi	8da48e4d95	[Frontend] Publish Prometheus metrics in run_batch API (#7641)	2024-08-23 23:04:22 -07:00
Robert ShawandNick Hill	e3b318216d	[ Bugfix ] Fix Prometheus Metrics With zeromq Frontend (#7279) ... Co-authored-by: Nick Hill <nickhill@us.ibm.com>	2024-08-18 20:19:48 +00:00