Skip to main content

Module cache

Module cache 

Source
Expand description

Persistent cache of fitted probe coefficients on the EFS volume.

The cache key is {server_version, model, max_seq, arch}. When the fingerprint matches the current server’s configuration, the probe is skipped and the cached (a, b) are used immediately.

Structs§

ProbeCache 🔒

Functions§

save_probe_cache 🔒
Saves fitted probe coefficients to {cache_dir}/probe-coefficients.json via an atomic temp-file + rename.
try_load_probe_cache 🔒
Attempts to load cached probe coefficients from {cache_dir}/probe-coefficients.json.