10 Commits

Include renames

Author	SHA1	Message	Date
Cyrus LeungandGitHub	cff6a1fec1	[CI/Build] Reuse code for checking output consistency (#5988)	2024-06-30 11:44:25 +08:00
youkaichaoandGitHub	8ea5e44a43	[CI/Test] improve robustness of test (vllm_runner) (#5357) ... [CI/Test] improve robustness of test by replacing del with context manager (vllm_runner) (#5357)	2024-06-08 08:59:20 +00:00
youkaichaoandGitHub	9fb900f90c	[CI/Test] improve robustness of test (hf_runner) (#5347) ... [CI/Test] improve robustness of test by replacing del with context manager (hf_runner) (#5347)	2024-06-07 22:31:32 -07:00
YuanandGitHub	cafb8e06c5	[CI/BUILD] enable intel queue for longer CPU tests (#4113)	2024-06-03 10:39:50 -07:00
Woosuk KwonandGitHub	b57e6c5949	[Kernel] Add flash-attn back (#4907)	2024-05-19 18:11:30 -07:00
SangBin ChoandGitHub	8a7cc254a0	Revert "[Kernel] Use flash-attn for decoding (#3648)" (#4820) ... Lora 3 & 4 test seems to have illegal memory access failure after this commit; [2024-05-14 23:51:18,182 E 22 22] logging.cc:101: Unhandled exception: N3c105ErrorE. what(): CUDA error: an illegal memory access was encountered <br class="Apple-interchange-newline"> Exmaple: https://buildkite.com/vllm/ci/builds/7382#018f793d-1527-4e1c-ab59-c3a34ec55241 This reverts commit 1356df5. FILL IN THE PR DESCRIPTION HERE FIX #xxxx (link existing issues this PR will resolve)	2024-05-15 11:52:45 +09:00
4 people	1356df53bd	[Kernel] Use flash-attn for decoding (#3648) ... Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu> Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>	2024-05-13 15:50:33 -07:00
SangBin ChoandGitHub	f6a593093a	[CI] Make mistral tests pass (#4596)	2024-05-08 08:44:35 -07:00
Jee LiandGitHub	d6f4bd7cdd	[Misc]Add customized information for models (#4132)	2024-04-30 21:18:14 -07:00
3 people	26422e477b	[Test] Make model tests run again and remove --forked from pytest (#3631) ... Co-authored-by: Simon Mo <simon.mo@hey.com>	2024-03-28 21:06:40 -07:00