Skip to main content

JitSuspectSender

Type Alias JitSuspectSender 

Source
pub(crate) type JitSuspectSender = Sender<(usize, usize)>;
Expand description

Sender half of the JIT-suspect channel.

Workers hold an optional clone of this sender and call try_send (non-blocking, drops if full) after any inference whose inference_ms equals or exceeds the TRT cache-hit threshold.

Aliased Typeยง

pub(crate) struct JitSuspectSender { /* private fields */ }