Expand description
Engine propagation broadcast drain and post-inference cache-miss signaling.
Functionsยง
- drain_
engine_ ๐propagation - Drains pending broadcast notifications and runs
trt_prewarmfor each new shape. - log_
inference_ ๐complete - Emits the
chunk_runINFO event and, on a cache miss, notifies both the JIT-suspect channel (adaptive warmup scheduling) and the engine propagation broadcast channel (peer worker fast disk-load).