Expand description
Server configuration loaded from environment variables at startup.
All settings are read once via Config::from_env and then immutable
for the server’s lifetime. See each field’s doc comment for the
corresponding environment variable name and default value.
Structs§
- Config
- Runtime configuration loaded from environment variables.
Enums§
- Model
Variant - ONNX model variant to load.
Constants§
- MODEL_
MAX_ SEQ - Maximum sequence length supported by the model architecture.
BGE-M3’s positional embedding table extends to 8192; this is the hard upper
bound used to validate
BGE_M3_MAX_SEQ_LENGTH.
Functions§
- resolve_
cost_ 🔒model_ override - Resolves an optional
CostModelfrom env vars that explicitly override auto-tuning.