Skip to main content

Module session

bge_m3_embedding_server::embedder

Module session 

Source
Expand description

ORT execution-provider configuration and session loading.

Structs§

GpuSessionConfig 🔒
Configuration for loading an ORT session and tokenizer for a single GPU worker.

Functions§

execution_providers 🔒
Returns the execution providers to use for this platform and EP selection.
load_models 🔒
Downloads (if not already cached) and loads both the ORT session and the tokenizer for the given model variant, returning them as a pair.
load_session 🔒
Builds an ORT session from the ONNX model file with the given execution providers.