9 Commits

Include renames

Author	SHA1	Message	Date
William LinandGitHub	a6c0f3658d	[multi-step] add flashinfer backend (#7928)	2024-09-12 11:16:22 -07:00
afeldman-nmandGitHub	e5cab71531	[Frontend] Add --logprobs argument to benchmark_serving.py (#8191)	2024-09-06 09:01:14 -07:00
Alexander MatveevandGitHub	6d646d08a2	[Core] Optimize Async + Multi-step (#8050)	2024-09-03 18:50:29 +00:00
afeldman-nmandGitHub	428dd1445e	[Core] Logprobs support in Multi-step (#7652)	2024-08-29 19:19:08 -07:00
Alexander MatveevandGitHub	3f60f2244e	[Core] Combine async postprocessor and multi-step (#7921)	2024-08-29 11:18:26 -07:00
Nick HillandGitHub	39178c7fbc	[Tests] Disable retries and use context manager for openai client (#7565)	2024-08-26 21:33:17 -07:00
3 people	2eedede875	[Core] Asynchronous Output Processor (#7049) ... Co-authored-by: Alexander Matveev <alexm@neuralmagic.com>	2024-08-26 20:53:20 -07:00
Alexander MatveevandGitHub	9db93de20c	[Core] Add multi-step support to LLMEngine (#7789)	2024-08-23 12:45:53 -07:00
3 people	47b65a5508	[core] Multi Step Scheduling (#7000) ... Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>	2024-08-19 13:52:13 -07:00