9 Commits

Include renames

Author	SHA1	Message	Date
Cade DanielandGitHub	e95cd87959	[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)	2024-04-16 13:09:21 -07:00
Nick HillandGitHub	e46a60aa4c	[BugFix] Fix handling of stop strings and stop token ids (#3672)	2024-04-11 15:34:12 -07:00
3 people	aabe8f40f2	[Core] [Frontend] Make detokenization optional (#3749) ... Co-authored-by: Nick Hill <nickhill@us.ibm.com>	2024-04-03 21:52:18 -07:00
Antoni BaumandGitHub	fb96c1e98c	Asynchronous tokenization (#2879)	2024-03-15 23:37:01 +00:00
ElizaWszolaandGitHub	b35cc93420	Fix auto prefix bug (#3239)	2024-03-07 16:37:28 -08:00
Simon MoandGitHub	5ffc0d13a2	Migrate linter from pylint to ruff (#1665)	2023-11-20 11:58:01 -08:00
Zhuohan LiandGitHub	ba0bfd40e2	TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)	2023-10-02 15:36:09 -07:00
Antoni BaumandGitHub	dd54a4b026	Fix detokenization leaving special tokens (#1044) ... Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>	2023-09-14 16:37:03 -07:00
Antoni BaumandGitHub	9841d48a10	Use TGI-like incremental detokenization (#984)	2023-09-13 13:38:01 -07:00