Skip to main content

probe_run_dense

bge_m3_embedding_server::embedder::worker

Function probe_run_dense 

Source 
pub(crate) fn probe_run_dense(
    session: &mut Session,
    ids_array: &Array2<i64>,
    mask_array: &Array2<i64>,
) -> Result<ProbeResult>
Expand description

Runs a single session.run() for the probe, measuring RSS before and after.

The probe texts are already tokenized and padded to pad_to externally. This function just runs inference and returns RSS deltas so probe.rs can fit the cost model.