Expand description
GET /health and GET /health/deep handlers.
/health returns lightweight readiness status from in-memory atomics.
/health/deep runs a tiny canary inference (batch=1, seq≈8 tokens) and
returns 503 if the actual embedding pipeline is broken.
Constants§
- DEEP_
HEALTH_ 🔒CANARY - Fixed canary text for
/health/deep. Tokenises to ~8 tokens with the BGE-M3SentencePiecevocabulary, meeting the “batch=1, seq=8” goal. - DEEP_
HEALTH_ 🔒TIMEOUT - Timeout for the canary embed call in
/health/deep.
Functions§
- health
- Handles
GET /health— returns readiness status, worker counts, and tuning diagnostics. - health_
deep - Handles
GET /health/deep— runs a tiny canary inference and returns503if the actual embedding pipeline is broken.