11 Commits

Include renames

Author	SHA1	Message	Date
Simon Mo	1e4277d2d1	lint: format all python file instead of just source code (#2567)	2024-01-23 15:53:06 -08:00
Harry Mellor	63e835cbcc	Fix progress bar and allow HTTPS in benchmark_serving.py (#2552)	2024-01-22 14:40:31 -08:00
Harry Mellor	2709c0009a	Support OpenAI API server in benchmark_serving.py (#2172)	2024-01-18 20:34:08 -08:00
Antoni Baum	acbed3ef40	Use monotonic time where appropriate (#1249)	2023-10-02 19:22:05 -07:00
Ricardo Lu	8c4b2592fb	fix: enable trust-remote-code in api server & benchmark. (#509)	2023-07-19 17:06:15 -07:00
Woosuk Kwon	4338cc4750	[Tokenizer] Add an option to specify tokenizer (#284)	2023-06-28 09:46:58 -07:00
Zhuohan Li	43710e8d09	[Fix] Fix default port number in benchmark scripts (#265)	2023-06-26 13:15:35 -07:00
Woosuk Kwon	3f92038b99	Add comments on swap space (#154)	2023-06-18 11:39:35 -07:00
Woosuk Kwon	0b98ba15c7	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00
Zhuohan Li	e5464ee484	Rename servers to engines (#152)	2023-06-17 17:25:21 +08:00
Woosuk Kwon	311490a720	Add script for benchmarking serving throughput (#145)	2023-06-14 19:55:38 -07:00