Commit b3816d7
committed
Add scaleUp stabilization window to mitigate metric oscillation
AverageValue divides total token throughput by replica count, which means
the per-replica value halves after a scale-up event. With stabilizationWindowSeconds: 0
this could cause flapping near the threshold. Setting it to 30s requires the
metric to stay above threshold for two consecutive polling intervals before
a scale-up is committed, while the existing 120s scaleDown window prevents
premature scale-down.1 parent b69e04d commit b3816d7
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
29 | | - | |
| 29 | + | |
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
| |||
0 commit comments