Skip to main content

Module dispatch

bge_m3_embedding_server::embedder::worker

Module dispatch 

Source
Expand description

Per-request dispatch for dense, sparse, dual, probe, and adaptive warmup.

Structs§

DispatchOutcome 🔒
Result of dispatching one worker request through inference.

Functions§

dispatch_request 🔒
Runs one EmbedRequest against a loaded session.
reply_request_load_error 🔒
Sends a model-reload error to whichever reply channel the request carries.