mirror of
https://github.com/wassname/openrouter-python-sdk-retry-errors.git
synced 2026-07-29 11:23:49 +08:00
26 lines
639 B
Markdown
26 lines
639 B
Markdown
# PreferredMinThroughput
|
|
|
|
Preferred minimum throughput (in tokens per second). Can be a number (applies to p50) or an object with percentile-specific cutoffs. Endpoints below the threshold(s) may still be used, but are deprioritized in routing. When using fallback models, this may cause a fallback model to be used instead of the primary model if it meets the threshold.
|
|
|
|
|
|
## Supported Types
|
|
|
|
### `float`
|
|
|
|
```python
|
|
value: float = /* values here */
|
|
```
|
|
|
|
### `components.PercentileThroughputCutoffs`
|
|
|
|
```python
|
|
value: components.PercentileThroughputCutoffs = /* values here */
|
|
```
|
|
|
|
### `Any`
|
|
|
|
```python
|
|
value: Any = /* values here */
|
|
```
|
|
|