feat: move to overload typing for stream:true intent for sse

This commit is contained in:
David Alberto Adler
2025-09-08 12:21:06 +01:00
parent 2988b5e385
commit 80fd801021
129 changed files with 1218 additions and 3872 deletions
+16
View File
@@ -0,0 +1,16 @@
# Quantization
## Values
| Name | Value |
| --------- | --------- |
| `INT4` | int4 |
| `INT8` | int8 |
| `FP4` | fp4 |
| `FP6` | fp6 |
| `FP8` | fp8 |
| `FP16` | fp16 |
| `BF16` | bf16 |
| `FP32` | fp32 |
| `UNKNOWN` | unknown |