Struct AdaptiveWarmupConfig 

pub(crate) struct AdaptiveWarmupConfig {
    pub enabled: bool,
    pub quiet_secs: u64,
    pub max_shapes_per_hour: u32,
}

Configuration for the adaptive background warmup task.

Fields

enabled: bool

Whether adaptive warmup is enabled. When false, spawn_adaptive_warmup is a no-op.

quiet_secs: u64

Seconds of continuous idle (zero queue depth) required before the task fires a warmup shape. Prevents warmup interference with live inference. When 0, the quiet-window check is skipped entirely.

max_shapes_per_hour: u32

Maximum number of shapes the task will compile per rolling hour. Acts as a rate-limiter to prevent runaway warmup loops on high-traffic deployments. When 0, adaptive warmup is enabled but no shapes will be compiled — a warning is emitted at startup.