Cade DanielandGitHub 79d64c4954 [Speculative decoding 1/9] Optimized rejection sampler (#2336)

2024-01-09 15:38:41 -08:00

..

async_engine

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

distributed

[BUGFIX] Fix communication test (#2285)

2023-12-27 17:18:11 -05:00

engine

Migrate linter from pylint to ruff (#1665)

2023-11-20 11:58:01 -08:00

kernels

Revert the changes in test_cache (#2335)

2024-01-03 17:32:05 -08:00

models

Added DeciLM-7b and DeciLM-7b-instruct (#2062)

2023-12-19 02:29:33 -08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

samplers

[Speculative decoding 1/9] Optimized rejection sampler (#2336)

2024-01-09 15:38:41 -08:00

worker

Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221)

2024-01-03 11:30:22 -08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

conftest.py

[BUGFIX] Fix the path of test prompts (#2273)

2023-12-26 10:37:21 -08:00

test_regression.py

[Minor] Fix duplication of ignored seq group in engine step (#1666)

2023-11-16 13:11:41 -08:00