wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-29 13:50:10 +08:00
Code Issues Packages Projects Releases Wiki Activity

Support FP32 (#141)

Browse Source
This commit is contained in:
Woosuk Kwon authored and GitHub committed 2023-06-07 00:40:21 -07:00
1 parent 376725ce74
commit e38074b1e6
8 files changed
+65 -54
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/source/getting_started/installation.rst
+3
View File
@@ -18,8 +18,11 @@ CacheFlow can run on systems that meet the following requirements:
.. code-block:: console
$ # Pull the Docker image with CUDA 11.8.
$ docker run --gpus all -it --rm --shm-size=8g nvcr.io/nvidia/pytorch:22.12-py3
Inside the Docker container, please execute :code:`pip uninstall torch` before installing CacheFlow.
Install with pip
----------------