Struct TrtJitGuard 

pub(crate) struct TrtJitGuard {
    guard_seq: usize,
    warmed_seq_ceiling: usize,
}

Per-request snapshot of the in-band JIT admission policy.

Cheap to construct (two usizes); the worker builds one per request from the live warmed_seq_ceiling atomic so the decision always reflects the latest pool-wide coverage. A None guard at the call sites disables checking entirely (non-TRT EPs, or BGE_M3_TRT_INBAND_JIT_GUARD=0).

Fields

guard_seq: usize

warmed_seq_ceiling: usize

Implementations

impl TrtJitGuard

pub(crate) fn new(guard_seq: usize, warmed_seq_ceiling: usize) -> Self

Builds a guard from the danger threshold and the current pool-wide warmed-sequence ceiling.

pub(crate) fn admit( &self, batch: usize, seq: usize, ) -> Result<(), TrtJitRejection>

Decides whether a single chunk (batch, seq) may be dispatched to session.run().

Refuses iff the sequence length is in the dangerous range (seq >= guard_seq) and is not covered by the warmed profile (seq > warmed_seq_ceiling). Everything else is admitted:

• seq < guard_seq - below the dangerous tier; a cold JIT here is bounded and lets the profile grow naturally.
• seq <= warmed_seq_ceiling - covered by an existing engine plan; the run is a cache hit / fast disk-load, never a pathological JIT.

Trait Implementations

impl Clone for TrtJitGuard

fn clone(&self) -> TrtJitGuard

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TrtJitGuard

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for TrtJitGuard