Zhuohan LiandGitHub 1a956e136b Fix various issues of async servers (#135)

2023-06-05 23:44:50 +08:00

..

core

Fix various issues of async servers (#135)

2023-06-05 23:44:50 +08:00

entrypoints

Fix various issues of async servers (#135)

2023-06-05 23:44:50 +08:00

model_executor

Add activation registry (#126)

2023-05-25 00:09:07 -07:00

server

Fix various issues of async servers (#135)

2023-06-05 23:44:50 +08:00

worker

Add contributing guideline and mypy config (#122)

2023-05-23 17:58:51 -07:00

__init__.py

Add throughput benchmarking script (#133)

2023-05-28 03:20:05 -07:00

block.py

Add docstrings to some modules and classes (#100)

2023-05-14 22:32:38 -07:00

config.py

Fix various issues of async servers (#135)

2023-06-05 23:44:50 +08:00

logger.py

Add a system logger (#85)

2023-05-08 23:03:35 -07:00

outputs.py

OpenAI Compatible Frontend (#116)

2023-05-23 21:39:50 -07:00

sampling_params.py

Enable LLaMA fast tokenizer (#132)

2023-05-28 02:51:42 -07:00

sequence.py

Fix various issues of async servers (#135)

2023-06-05 23:44:50 +08:00

utils.py

OpenAI Compatible Frontend (#116)

2023-05-23 21:39:50 -07:00