Skip to main content

TRT_ENGINE_SUBDIR

bge_m3_embedding_server::embedder::trt_cache::paths

Constant TRT_ENGINE_SUBDIR 

Source 
pub(crate) const TRT_ENGINE_SUBDIR: &str = "trt-engines";
Expand description

Subdirectory under BGE_M3_CACHE_DIR where ORT/TRT writes engine plan files.