wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-01 12:42:39 +08:00
Code Issues Packages Projects Releases Wiki Activity

[[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768)

Browse Source
This commit is contained in:
Jee Jee Li authored and GitHub committed 2024-09-24 17:08:55 -07:00
1 parent 1e7d5c01f5
commit 13f9f7a3d0
7 files changed
+44 -34
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/quantization/bnb.rst
+1 -1
View File
@@ -11,7 +11,7 @@ Below are the steps to utilize BitsAndBytes with vLLM.
.. code-block:: console
$ pip install bitsandbytes>=0.42.0
$ pip install bitsandbytes>=0.44.0
vLLM reads the model's config file and supports both in-flight quantization and pre-quantized checkpoint.