Skip to main content

resolve_cost_model_override

Function resolve_cost_model_override 

Source
fn resolve_cost_model_override<F: Fn(&str) -> Option<String>>(
    lookup: &F,
    max_seq_length: usize,
) -> Option<CostModel>
Expand description

Resolves an optional CostModel from env vars that explicitly override auto-tuning.

Returns None when the server should run the startup probe.