Skip to main content

Module probe

Module probe 

Source
Expand description

Startup memory probe and cost-model coefficient fitter.

Submodules:

  • runner: drives the (batch, seq) shape sweep on the leader worker (run_probe, PROBE_SHAPES, the absolute-RSS guard, the arena warm-up).
  • cache: persistent EFS-backed cache for fitted probe coefficients (try_load_probe_cache, save_probe_cache, ProbeCache).
  • fit: ordinary least-squares fitter for the quadratic cost model (fit_cost_model, DataPoint).
  • corpus: helpers that synthesize probe texts from the curated corpus.
  • validate: tokenizer + ndarray shape check at the configured max_seq (no session.run()).

Modulesยง

cache ๐Ÿ”’
Persistent cache of fitted probe coefficients on the EFS volume.
corpus ๐Ÿ”’
Probe text synthesis helpers.
fit ๐Ÿ”’
Least-squares cost-model fit for the startup probe.
runner ๐Ÿ”’
Probe shape-sweep driver.
validate ๐Ÿ”’
Tokenizer + ndarray shape validation at the configured max_seq.