22 Commits

Include renames

Author	SHA1	Message	Date
Nikola BorisovandGitHub	3209b49033	[Bugfix] fix crash if max_tokens=None (#2570)	2024-01-23 22:38:55 -08:00
RoyandGitHub	9140561059	[Minor] Fix typo and remove unused code (#2305)	2024-01-02 19:23:15 -08:00
Yunfeng BaiandGitHub	c06170cc8e	Add a flag to include stop string in output text (#1976)	2023-12-15 00:45:58 -08:00
RoyandGitHub	60dc62dc9e	add custom server params (#1868)	2023-12-03 12:59:18 -08:00
JerryandGitHub	f86bd6190a	Fix the typo in SamplingParams' docstring (#1886)	2023-12-01 02:06:36 -08:00
ljssandGitHub	de23687d16	Fix repetition penalty aligned with huggingface (#1577)	2023-11-22 14:41:44 -08:00
ljssandGitHub	4cea74c73b	Set top_p=0 and top_k=-1 in greedy sampling (#1748)	2023-11-22 12:51:09 -08:00
陈序andGitHub	094f716bf2	Add stop_token_ids in SamplingParams.__repr__ (#1745)	2023-11-21 20:13:53 -08:00
RoyandGitHub	e87557b069	Support Min P Sampler (#1642)	2023-11-17 16:20:49 -08:00
Noam GatandGitHub	555bdcc5a3	Added logits processor API to sampling params (#1469)	2023-11-03 14:12:15 -07:00
Dan LordandGitHub	7013a80170	Add support for spaces_between_special_tokens	2023-10-30 16:52:56 -07:00
ljssandGitHub	69be658bba	Support repetition_penalty (#1424)	2023-10-29 10:02:41 -07:00
3 people	9d9072a069	Implement prompt logprobs & Batched topk for computing logprobs (#1328) ... Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>	2023-10-16 10:56:50 -07:00
Woosuk KwonandGitHub	84e4e37d14	[Minor] Fix type annotations (#1238)	2023-10-02 15:28:31 -07:00
Dan LordandGitHub	20f7cc4cde	Add skip_special_tokens sampling params (#1186)	2023-09-27 19:21:42 -07:00
3 people	947b794146	[Sampler] Vectorized sampling (simplified) (#1048) ... Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>	2023-09-22 17:48:04 -07:00
Ricardo LuandGitHub	f98b745a81	feat: support stop_token_ids parameter. (#1097)	2023-09-21 15:34:02 -07:00
Zhuohan LiandGitHub	002800f081	Align vLLM's beam search implementation with HF generate (#857)	2023-09-04 17:29:42 -07:00
wangcx18andGitHub	0c04ce3234	Fix typo in sampling_params.py (#788)	2023-08-18 10:12:46 +09:00
Zhuohan LiandGitHub	d6fa1be3a8	[Quality] Add code formatter and linter (#326)	2023-07-03 11:31:55 -07:00
Lily LiuandGitHub	425040d4c1	remove floats == 0 comparison (#285)	2023-06-28 14:11:51 -07:00
Woosuk KwonandGitHub	0b98ba15c7	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00