wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-01 12:42:39 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Docs] Update installation instructions to include CUDA 11.8 xFormers (#2246)

Browse Source
This commit is contained in:
Shivam Thakkar authored and GitHub committed 2023-12-22 23:20:02 -08:00
1 parent a1b9cb2a34
commit 1db83e31a2
1 file changed
+4
Download Patch File Download Diff File Expand all files Collapse all files
docs/source/getting_started/installation.rst
+4
View File
@@ -42,6 +42,10 @@ You can install vLLM using pip:
$ pip uninstall torch -y
$ pip install torch --upgrade --index-url https://download.pytorch.org/whl/cu118
$ # Re-install xFormers with CUDA 11.8.
$ pip uninstall xformers -y
$ pip install --upgrade xformers --index-url https://download.pytorch.org/whl/cu118
.. _build_from_source: