Create a label set
Create a golden set from human-graded requests — either explicit request ids or the newest N grades — as the first step toward a frozen, kappa-measured calibration set for a judge.
A set needs at least 20 distinct graded requests (400 ‘A golden set needs at least 20 graded requests (have N)’) and at most 5000. Verifier-sourced labels never count as members. Freeze the set (POST /v1/label_sets//freeze) before attaching it to a criterion.
Authorizations
Your workspace API key, e.g. sk_sovereign_..., sent as Authorization: Bearer <key>.
Body
Set name, trimmed, 1..80 chars (400 otherwise).
Optional description; trimmed and truncated to 500 chars.
Explicit members. Every id must carry a human (non-verifier) grade in this workspace, otherwise 400 naming how many are missing. Deduplicated. Takes precedence over latest when non-empty.
When request_ids is absent/empty: take the newest N human grades. Default 200; clamped to 20..5000.
Response
201 with the set object: { id, name, description, size, membership_hash: null, frozen_at: null, kappa: null, agreement: null, kappa_n: null, rater_count: null, attached_to: [], created_at }. The set is NOT frozen yet.
The response is of type object.