Zhuohan LiandGitHub e0ff920001 [BUGFIX] Do not return ignored sentences twice in async llm engine (#2258)

2023-12-26 13:41:09 +08:00

..

core

[BugFix] Fix recovery logic for sequence group (#2186)

2023-12-20 21:52:37 -08:00

engine

[BUGFIX] Do not return ignored sentences twice in async llm engine (#2258)

2023-12-26 13:41:09 +08:00

entrypoints

Add SSL arguments to API servers (#2109)

2023-12-18 10:56:23 +08:00

model_executor

Remove Sampler copy stream (#2209)

2023-12-20 00:04:33 -08:00

transformers_utils

[Minor] Delete Llama tokenizer warnings (#2146)

2023-12-16 22:05:18 -08:00

worker

Make _prepare_sample non-blocking and use pinned memory for input buffers (#2207)

2023-12-19 16:52:46 -08:00

__init__.py

Bump up to v0.2.6 (#2157)

2023-12-17 10:34:56 -08:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

[ROCm] Fixes for GPTQ on ROCm (#2180)

2023-12-18 10:41:04 -08:00

logger.py

[Fix] Fix duplicated logging messages (#1524)

2023-10-31 09:04:47 -07:00

outputs.py

docs: add description (#1553)

2023-11-03 09:14:52 -07:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509)

2023-10-30 14:50:47 -07:00

sampling_params.py

Add a flag to include stop string in output text (#1976)

2023-12-15 00:45:58 -08:00

sequence.py

[FIX] Fix class naming (#1803)

2023-11-28 14:08:01 -08:00

utils.py

Optimize model execution with CUDA graph (#1926)

2023-12-16 21:12:08 -08:00