Skip to main content

detected_sm_for_ep

bge_m3_embedding_server::embedder::worker::startup

Function detected_sm_for_ep 

Source 
pub(super) fn detected_sm_for_ep(
    ep: EpSelection,
    device_id: u32,
) -> Option<String>
Expand description

Returns the GPU compute capability for TRT EP workers, or None on CPU/CUDA.