pub(super) fn sparse_project(
hidden: &[f32],
weight: &ArrayView1<'_, f32>,
bias: f32,
) -> f32Expand description
Projects a single token’s hidden state through the sparse-linear layer.
Returns max(0, dot(hidden, weight) + bias) (ReLU-gated score).