wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-01 12:42:39 +08:00
Code Issues Packages Projects Releases Wiki Activity

Support for guided decoding for offline LLM (#6878)

Browse Source 
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
This commit is contained in:
Yihuan BuandCyrus Leung authored and GitHub committed 2024-08-04 03:12:09 +00:00
1 parent 825b044863
commit 654bc5ca49
9 files changed
+352 -12
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/conf.py
+1
View File
@@ -111,6 +111,7 @@ autodoc_mock_imports = [
"tqdm",
"tensorizer",
"pynvml",
"outlines",
]
for mock_target in autodoc_mock_imports: