Skip to main content

wait_for_quiet_window

bge_m3_embedding_server::embedder::adaptive_warmup

Function wait_for_quiet_window 

Source 
async fn wait_for_quiet_window(
    quiet_secs: u64,
    pool: &EmbedPool,
    rx: &mut Receiver<(usize, usize)>,
    pending: &mut IndexSet<(usize, usize)>,
    warmed: &HashSet<(usize, usize)>,
) -> bool
Expand description

Waits until the pool queue has been idle for quiet_secs consecutive seconds.

Continuously drains the JIT-suspect channel into pending while waiting. Returns true if the quiet window was reached, false if the queue became busy again and we should re-enter the outer idle-check loop.

When quiet_secs is 0, returns true immediately without sleeping.