Skip to main content

finalize_embed_route

bge_m3_embedding_server::embedder::worker::guard

Function finalize_embed_route 

Source 
pub(super) fn finalize_embed_route<T>(
    ctx: &EmbedRouteContext<'_>,
    result: Result<(T, EmbedStats)>,
    reply: Sender<Result<(T, EmbedStats)>>,
    inference_ms: u128,
    warmed_local: &mut HashSet<(usize, usize)>,
) -> InferenceOutcome
Expand description

Shared post-inference path for dense, sparse, and dual routes.

Logs completion stats, classifies errors (TRT fatal / JIT guard / circuit breaker), emits abandonment observability, and sends the oneshot reply.