Struct TrtJitRejection 

pub(crate) struct TrtJitRejection {
    pub batch: usize,
    pub seq: usize,
    pub guard_seq: usize,
    pub warmed_seq_ceiling: usize,
}

Error returned when TrtJitGuard refuses a chunk to avoid a pathological in-band TensorRT JIT compile.

Carries the offending (batch, seq) and the coverage parameters so the refusal is fully diagnosable in logs. Maps to HTTP 503 Service Unavailable (see crate::error::AppError’s From<anyhow::Error> impl): the request is retriable - coverage may extend via adaptive warmup, or a peer task may already cover the shape.

Fields

batch: usize

Chunk batch size (number of texts in the refused session.run() call).

seq: usize

Chunk (padded) sequence length that triggered the refusal.

guard_seq: usize

guard_seq threshold in effect at refusal time.

warmed_seq_ceiling: usize

Pool-wide max successfully-warmed sequence length at refusal time.

Trait Implementations

impl Clone for TrtJitRejection

fn clone(&self) -> TrtJitRejection

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TrtJitRejection

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TrtJitRejection

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for TrtJitRejection

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl PartialEq for TrtJitRejection

fn eq(&self, other: &TrtJitRejection) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TrtJitRejection

impl Eq for TrtJitRejection

impl StructuralPartialEq for TrtJitRejection