Files
openrouter-python-sdk-retry…/docs/components/percentilethroughputcutoffs.md
T
OpenRouter Team 9073d38dc1 Project import generated by Copybara.
GitOrigin-RevId: 849282a42d3b2948d0ca0f7fd1427c31af709bbd
2026-01-09 19:20:21 +00:00

1.0 KiB
Raw Blame History

PercentileThroughputCutoffs

Percentile-based throughput cutoffs. All specified cutoffs must be met for an endpoint to be preferred.

Fields

Field Type Required Description
p50 OptionalNullable[float] Minimum p50 throughput (tokens/sec)
p75 OptionalNullable[float] Minimum p75 throughput (tokens/sec)
p90 OptionalNullable[float] Minimum p90 throughput (tokens/sec)
p99 OptionalNullable[float] Minimum p99 throughput (tokens/sec)