Expand description
Server-startup orchestration: routing, workspace budget, readiness probe, and the background probe task that fits the cost model on first start.
Submodules:
router: axumRouterconstruction + tracing/request-id layers.budget: pure workspace-budget arithmetic (compute_workspace_budget).readiness: the foreground readiness probe (run_readiness_probe,run_readiness_checks_and_open).probe_task: the background probe task (spawn_probe_task) used when the cost model has not been overridden and no EFS cache hit was found.
Modulesยง
- budget ๐
- Pure workspace-budget arithmetic shared between the readiness probe and the unit tests.
- probe_
task ๐ - Background probe task spawned when the cost model has not been overridden and the EFS cache is empty (or disabled).
- readiness ๐
- Foreground readiness probe.
- router ๐
- Axum router construction with the request-id, tracing, and body-limit layers attached.
Functionsยง
- build_
router - Builds the Axum [
Router] with all embedding, health, and fleet-discovery routes, a 2 MiB body limit, request-id propagation, and structured tracing. - run_
readiness_ probe - Runs after all workers finish loading their model instances.