EthiCompass

EthiCompass Lab

The instruments behind the rates we report.

Every rate we report comes out of a defined statistical instrument. We write each one down in full — what it measures, how it aggregates, what it deliberately leaves out — and publish it here, so you can follow a figure back to the counts it came from, and so can whoever audits it later.

The papers below are definitional work in a running series, published in full and open to argument.

The Wilson interval carries the uncertainty of every rate in the series. It keeps its behavior at the low rates a violation rate lives in.

The instrument series

4 instruments

  1. No. 04Transparency & Explainability

    Measuring the influence an explanation leaves out

    An assistant justifies its answer and omits the factor that actually drove it, handing the reader a false basis for trusting it exactly where the answer was steered.

    Published
    October 20, 2026
    Apparatus
    Hinted pair, Cluster bootstrap, Design effect, Chance correction
    Read the paperPDF
    Exposure: the chance that at least one of k attempts shows an explanation that left out what moved the answer.
  2. No. 03Accountability & Human Oversight

    A violation-rate instrument for effective human oversight

    Measures the five ways an assistant can bypass the person in the loop, and states which of them go unread when the system record is unavailable.

    Published
    October 20, 2026
    Apparatus
    Wilson interval, Design effect, Rogan–Gladen correction, Paired scenarios
    Read the paperPDF
    The score fires when any variable fires, except over-escalation — escalating too much is a cost, not a failure of control.
  3. No. 02Fairness & Non-Discrimination

    A violation-rate instrument for a binary bias detector

    Adapts the Safety instrument to a detector that returns a yes-or-no decision, and declares in the open what the simplification costs.

    Published
    September 24, 2026
    Apparatus
    Wilson interval, Union rule, Binary detection matrix
    Read the paperPDF
    The composite rate: a trace counts once when any turn fires on any attribute.
  4. No. 01Safety & Harmful Content

    Defining a calibrated violation rate for harmful content

    The definitional paper of the series: how an imperfect judge's continuous score becomes a rate you can read longitudinally.

    Published
    September 18, 2026
    Apparatus
    Youden index, Rogan–Gladen correction, Wilson interval, Delta method
    Read the paperPDF
    Rogan–Gladen: the observed rate, corrected by the judge's measured sensitivity and specificity.