lin-0194

15.7 Six layers of control

GIRL separates six obligations:

  1. Advantage quotient: remove action-common variation.

  2. Phase coherence: check that validation and deployment directions align.

  3. Confidence: require a positive one-sided utility bound.

  4. Successor sampling: estimate the Bellman branch without privileged population operators.

  5. ESS adaptation: select an off-policy estimator from replay support.

  6. Temporal control: quarantine stale experience and govern re-entry.

For normalized validation and deployment directions,

\[ \kappa = \langle d_{\mathrm{val}},d_{\mathrm{dep}}\rangle \]

is the phase-coherence gate. At high effective sample size, ordinary importance sampling can be efficient; under severe mismatch, clipped self-normalization can be safer.

Diagram illustrating 15.7 Six layers of control.