Skip to main content

Module config

Module config 

Source
Expand description

Server configuration loaded from environment variables at startup.

All settings are read once via Config::from_env and then immutable for the server’s lifetime. See each field’s doc comment for the corresponding environment variable name and default value.

Structs§

Config
Runtime configuration loaded from environment variables.

Enums§

ModelVariant
ONNX model variant to load.

Constants§

MODEL_MAX_SEQ
Maximum sequence length supported by the model architecture. BGE-M3’s positional embedding table extends to 8192; this is the hard upper bound used to validate BGE_M3_MAX_SEQ_LENGTH.

Functions§

resolve_cost_model_override 🔒
Resolves an optional CostModel from env vars that explicitly override auto-tuning.