[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975)

Browse Source

...

This commit is contained in:

Michael Goin

2024-07-03 17:38:00 +00:00

committed by GitHub

parent 7cd2ebb025

commit 47f0954af0

11 changed files with 1585 additions and 42 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

csrc/quantization/fp8/fp8_marlin.cu

+1308

File diff suppressed because it is too large Load Diff