Skip to main content

Module session

Module session 

Source
Expand description

ORT execution-provider configuration and session loading.

Functionsยง

execution_providers ๐Ÿ”’
Returns the execution providers to use for this platform.
load_models ๐Ÿ”’
Downloads (if not already cached) and loads both the ORT session and the tokenizer for the given model variant, returning them as a pair.
load_session ๐Ÿ”’
Builds an ORT session from the ONNX model file with the given execution providers.