 Simon MoandGitHub
|
5923532e15
|
Add Skywork AI as Sponsor (#7314)
|
2024-08-08 13:59:57 -07:00 |
|
|
Jee Jee LiandGitHub
|
a049b107e2
|
[Misc] Temporarily resolve the error of BitAndBytes (#7308)
|
2024-08-08 13:42:58 -07:00 |
|
|
Isotr0pyandGitHub
|
8334c39f37
|
[Bugfix] Fix new Llama3.1 GGUF model loading (#7269)
|
2024-08-08 13:42:44 -07:00 |
|
|
DanieleandGitHub
|
e904576743
|
[CI/Build] Dockerfile.cpu improvements (#7298)
|
2024-08-08 15:24:52 -04:00 |
|
|
Michael GoinandGitHub
|
e14fb22e59
|
[Doc] Put collect_env issue output in a <detail> block (#7310)
|
2024-08-08 11:22:49 -07:00 |
|
|
Zach ZhengandGitHub
|
782e53ab59
|
[Bugfix][fast] Fix the get_num_blocks_touched logic (#6849)
|
2024-08-08 10:43:30 -07:00 |
|
|
Joe RundeandGitHub
|
21b9c49aa3
|
[Frontend] Kill the server on engine death (#6594)
Signed-off-by: Joe Runde <joe@joerun.de>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
|
2024-08-08 09:47:48 -07:00 |
|
|
Luka GovedičandGitHub
|
5fb4a3f678
|
[Bugfix][Kernel] Increased atol to fix failing tests (#7305)
|
2024-08-08 12:16:13 -04:00 |
|
|
Jee Jee LiandGitHub
|
757ac70a64
|
[Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273)
|
2024-08-08 14:02:41 +00:00 |
|
|
Murali AndoorveeduandGitHub
|
6dffa4b0a6
|
[Bugfix] Fix LoRA with PP (#7292)
|
2024-08-08 00:02:27 -07:00 |
|
|
Cherilyn BurenandGitHub
|
48abee9e54
|
[Frontend] remove max_num_batched_tokens limit for lora (#7288)
|
2024-08-08 06:17:29 +00:00 |
|
|
Rui QiaoandGitHub
|
746709642c
|
[Misc] Fix typos in scheduler.py (#7285)
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
|
2024-08-07 17:06:01 -07:00 |
|
|
Lily LiuandGitHub
|
e53dfd3eaf
|
[Kernel] Fix Flashinfer Correctness (#7284)
|
2024-08-07 16:26:52 -07:00 |
|
|
Michael GoinandGitHub
|
6d94420246
|
[Doc] Update supported_hardware.rst (#7276)
|
2024-08-07 14:21:50 -07:00 |
|
|
Nick HillandGitHub
|
fc1493a01e
|
[FrontEnd] Make merge_async_iterators is_cancelled arg optional (#7282)
|
2024-08-07 13:35:14 -07:00 |
|
|
Lucas WilkinsonandGitHub
|
311f743831
|
[Bugfix] Fix gptq failure on T4s (#7264)
|
2024-08-07 20:05:37 +00:00 |
|
|
Kevin H. LuuandGitHub
|
469b3bc538
|
[ci] Make building wheels per commit optional (#7278)
Signed-off-by: kevin <kevin@anyscale.com>
|
2024-08-07 11:34:25 -07:00 |
|
|
Michael GoinandGitHub
|
5223199e03
|
[Bugfix][FP8] Fix dynamic FP8 Marlin quantization (#7219)
|
2024-08-07 11:23:12 -07:00 |
|
|
|
fde47d3bc2
|
[BugFix] Fix frontend multiprocessing hang (#7217)
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
|
2024-08-07 18:09:36 +00:00 |
|
|
Stas BekmanandGitHub
|
0e12cd67a8
|
[Doc] add online speculative decoding example (#7243)
|
2024-08-07 09:58:02 -07:00 |
|
|
Ilya LavrenovandGitHub
|
80cbe10c59
|
[OpenVINO] migrate to latest dependencies versions (#7251)
|
2024-08-07 09:49:10 -07:00 |
|
|
|
b764547616
|
[Bugfix] Fix input processor for InternVL2 model (#7164)
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2024-08-07 09:32:07 -07:00 |
|
|
Rafael VasquezandGitHub
|
ab0f5e2823
|
Fixes typo in function name (#7275)
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
|
2024-08-07 09:29:27 -07:00 |
|
|
Robert ShawandGitHub
|
564985729a
|
[ BugFix ] Move zmq frontend to IPC instead of TCP (#7222)
|
2024-08-07 16:24:56 +00:00 |
|
|
Dipika SikkaandGitHub
|
0f7052bc7e
|
[Misc] Refactor linear layer weight loading; introduce BasevLLMParameter and weight_loader_v2 (#5874)
|
2024-08-07 09:17:58 -07:00 |
|
|
youkaichaoandGitHub
|
639159b2a6
|
[distributed][misc] add specialized method for cuda platform (#7249)
|
2024-08-07 08:54:52 -07:00 |
|
|
|
66d617e343
|
[Frontend] Gracefully handle missing chat template and fix CI failure (#7238)
Co-authored-by: Roger Wang <ywang@roblox.com>
|
2024-08-07 09:12:05 +00:00 |
|
|
Atilla AkkuşandGitHub
|
7b261092de
|
[BUGFIX]: top_k is expected to be an integer. (#7227)
|
2024-08-07 00:32:16 -07:00 |
|
|
Roger WangandGitHub
|
2385c8f374
|
[Doc] Mock new dependencies for documentation (#7245)
|
2024-08-07 06:43:03 +00:00 |
|
|
Nick HillandGitHub
|
9a3f49ae07
|
[BugFix] Overhaul async request cancellation (#7111)
|
2024-08-07 13:21:41 +08:00 |
|
|
Michael GoinandGitHub
|
f9a5600649
|
[Bugfix] Fix GPTQ and GPTQ Marlin CPU Offloading (#7225)
|
2024-08-06 18:34:26 -07:00 |
|
|
|
fd95e026e0
|
[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
|
2024-08-06 16:51:47 -04:00 |
|
|
xiaobochen123andGitHub
|
660470e5a3
|
[Core] Optimize evictor-v2 performance (#7193)
|
2024-08-06 12:34:25 -07:00 |
|
|
|
8d59dbb000
|
[Kernel] Add per-tensor and per-token AZP epilogues (#5941)
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2024-08-06 18:17:08 +00:00 |
|
|
Lily LiuandGitHub
|
5c60c8c423
|
[SpecDecode] [Minor] Fix spec decode sampler tests (#7183)
|
2024-08-06 10:40:32 -07:00 |
|
|
|
00afc78590
|
[Bugfix] add gguf dependency (#7198)
Co-authored-by: katarzyna.papis <kpapis@kpapis-u20.sclab.intel.com>
|
2024-08-06 10:08:35 -07:00 |
|
|
Robert ShawandGitHub
|
541c1852d3
|
[ BugFix ] Fix ZMQ when VLLM_PORT is set (#7205)
|
2024-08-06 09:26:26 -07:00 |
|
|
Dipika SikkaandGitHub
|
a3bbbfa1d8
|
[BugFix] Fix DeepSeek remote code (#7178)
|
2024-08-06 08:16:53 -07:00 |
|
|
|
1f26efbb3a
|
[Model] Support SigLIP encoder and alternative decoders for LLaVA models (#7153)
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
|
2024-08-06 16:55:31 +08:00 |
|
|
Jee Jee LiandGitHub
|
9118217f58
|
[LoRA] Relax LoRA condition (#7146)
|
2024-08-06 01:57:25 +00:00 |
|
|
Simon MoandGitHub
|
e3c664bfcb
|
[Build] Add initial conditional testing spec (#6841)
|
2024-08-05 17:39:22 -07:00 |
|
|
|
360bd67cf0
|
[Core] Support loading GGUF model (#5191)
Co-authored-by: Michael Goin <michael@neuralmagic.com>
|
2024-08-05 17:54:23 -06:00 |
|
|
Cody YuandGitHub
|
ef527be06c
|
[MISC] Use non-blocking transfer in prepare_input (#7172)
|
2024-08-05 23:41:27 +00:00 |
|
|
|
89b8db6bb2
|
[Bugfix] Specify device when loading LoRA and embedding tensors (#7129)
Co-authored-by: Jacob Schein <jacobschein@Jacobs-MacBook-Pro-2.local>
|
2024-08-05 16:35:47 -07:00 |
|
|
Thomas ParnellandGitHub
|
789937af2e
|
[Doc] [SpecDecode] Update MLPSpeculator documentation (#7100)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
|
2024-08-05 23:29:43 +00:00 |
|
|
youkaichaoandGitHub
|
dfb1a15dcb
|
[ci][frontend] deduplicate tests (#7101)
|
2024-08-05 15:59:22 -07:00 |
|
|
Simon MoandGitHub
|
4db5176d97
|
bump version to v0.5.4 (#7139)
|
2024-08-05 14:39:48 -07:00 |
|
|
Tyler Michael SmithandGitHub
|
4cf1dc39be
|
[Bugfix][CI/Build] Fix CUTLASS FetchContent (#7171)
|
2024-08-05 14:22:57 -07:00 |
|
|
Tyler Michael SmithandGitHub
|
6e4852ce28
|
[CI/Build] Suppress divide-by-zero and missing return statement warnings (#7001)
|
2024-08-05 16:00:01 -04:00 |
|
|
Tyler Michael SmithandGitHub
|
8571ac4672
|
[Kernel] Update CUTLASS to 3.5.1 (#7085)
|
2024-08-05 15:13:43 -04:00 |
|