Skip to main content
GET
Compare two eval runs

Authorizations

Authorization
string
header
required

Your workspace API key, e.g. sk_sovereign_..., sent as Authorization: Bearer <key>.

Query Parameters

a
string
required

Eval run id of the BEFORE run (baseline of the comparison).

b
string
required

Eval run id of the AFTER run. Delta is reported as b − a.

Response

{a:{id, name, created_at, judge_model, eval_kind}, b:{…same}, rows:[{arm (candidate key), metric ("win_rate" for comparison runs; "observed_pass_rate" and, when both runs carry one, "corrected_pass_rate" for criterion runs), a:{rate, n, ci:[lo,hi]}, b:{rate, n, ci}, delta (b.rate − a.rate), delta_ci:[lo,hi] (Newcombe 95%), significant (interval excludes zero)}], unmatched:{a:[arm keys only in a], b:[arm keys only in b]}}. Cache-Control: no-store.

The response is of type object.