Expand description
Probe text synthesis helpers.
The probe sweeps (batch, seq) shapes by submitting synthesized texts to
the leader worker. Texts come from the curated benchmark corpus; we
repeat/trim corpus entries to hit the target token count for each shape.
Functions§
- load_
probe_ 🔒texts - Loads the benchmark corpus for use as probe text material.
- synthesize_
texts 🔒 - Synthesizes
batchtexts each of approximatelytarget_seqtokens.