wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-11 11:28:04 +08:00
Code Issues Packages Projects Releases Wiki Activity

Consolidate Llama model usage in tests (#13094)

Browse Source
This commit is contained in:
Harry Mellor
2025-02-13 22:18:03 -08:00
committed by GitHub
parent 40932d7a05
commit f2b20fe491
22 changed files with 45 additions and 53 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/basic_correctness/test_cpu_offload.py
+1 -1
View File
@@ -4,5 +4,5 @@ from ..utils import compare_two_settings
def test_cpu_offload():
compare_two_settings("meta-llama/Llama-3.2-1B", [],
compare_two_settings("meta-llama/Llama-3.2-1B-Instruct", [],
["--cpu-offload-gb", "1"])