wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-04 13:10:10 +08:00
Code Issues Packages Projects Releases Wiki Activity

[CI/Build] Drop Python 3.8 support (#10038)

Browse Source 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Russell BryantandDarkLight1337 authored and GitHub committed 2024-11-06 14:31:01 +00:00
1 parent 399c798608
commit 098f94de42
8 files changed
+11 -18
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

vllm/distributed/parallel_state.py
+2 -3
View File
@@ -89,12 +89,11 @@ def _get_unique_name(name: str) -> str:
return newname
_groups: Dict[str, Callable[[], "GroupCoordinator"]] = {}
_groups: Dict[str, Callable[[], Optional["GroupCoordinator"]]] = {}
def _register_group(group: "GroupCoordinator") -> None:
# looks like Python 3.8 does not understand `ReferenceType`
_groups[group.unique_name] = weakref.ref(group) # type: ignore
_groups[group.unique_name] = weakref.ref(group)
if supports_custom_op():