8 Commits

Include renames

Author	SHA1	Message	Date
zifeitong	3c10591ef2	[Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user (#6954)	2024-07-31 21:13:34 -07:00
Cyrus LeungandRoger Wang	739b61a348	[Frontend] Refactor prompt processing (#4028) ... Co-authored-by: Roger Wang <ywang@roblox.com>	2024-07-22 10:13:53 -07:00
Nick HillandCyrus Leung	e2fbaee725	[BugFix][Frontend] Use LoRA tokenizer in OpenAI APIs (#6227) ... Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>	2024-07-18 15:13:30 +08:00
Cyrus Leung	9d47f64eb6	[CI/Build] [3/3] Reorganize entrypoints tests (#5966)	2024-06-30 12:58:49 +08:00
Cyrus LeungandRoger Wang	5ae5ed1e60	[Core] Consolidate prompt arguments to LLM engines (#4328) ... Co-authored-by: Roger Wang <ywang@roblox.com>	2024-05-28 13:29:31 -07:00
Chang Su	e254497b66	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)	2024-05-11 11:30:37 -07:00
Cyrus Leung	f12b20decc	[Frontend] Move async logic outside of constructor (#4674)	2024-05-08 22:48:33 -07:00
Sebastian Schoennenbeck	f8e7adda21	Fix/async chat serving (#2727)	2024-05-03 11:04:14 -07:00