Expand description
Probe inference helpers for startup measurement and arena priming.
Functionsยง
- probe_
run_ ๐dense - Runs a single
session.run()for the probe, measuring RSS before and after. - run_
probe_ ๐batch - Runs one probe batch: tokenize texts, build padded arrays, call
session.run(), and return RSS deltas. Usesembed_denseโs no-pad tokenizer path.