Skip to main content
POST
Run a golden-set eval suite and score regressions in one batch

Authorizations

Authorization
string
header
required

Dashboard JWT token from Clerk

Headers

Idempotency-Key
string

Stripe-style idempotency token. Pass a stable, client-generated value (1-255 chars) to dedupe retries on transient timeouts. The same key+credential+path replays the original response for 24h on 2xx (5min on 4xx, 30s on 5xx). Returns 409 if a concurrent request with the same key is already in flight; replayed responses include the Idempotency-Replay: true response header.

Required string length: 1 - 255
X-Test-Mode
enum<string>

Sandbox opt-in for Clerk-session-authenticated requests. Set to true to route the call through the test-mode pipeline: no real provider delivery, no credits deducted, response meta.test_mode: true. Ignored for live API keys (dv_live_sk_*) — server-to-server clients must use a test-prefixed key (dv_test_sk_*) to exercise sandbox. Test-prefixed keys unconditionally enable sandbox regardless of this header.

Available options:
true,
false

Body

application/json
golden_set_ids
string[]
required
Required array length: 1 - 10 elements
Example:
agent_id
string
Example:

"agt_8b21d0"

trigger_source
enum<string>
default:manual
Available options:
manual,
pre-deploy-ci,
scheduled
stt_provider
string
tts_provider
string
llm_model
string
p95_regression_threshold
number

Fractional P95 latency regression threshold (e.g. 0.2 = 20% slower). Defaults to 0.2.

judge_score_regression_threshold
number

Fractional pass-rate (judge-score) regression threshold. Defaults to 0.1.

Response

Suite run completed (partial results are returned even when some sets failed to run)

Suite run completed (partial results are returned even when some sets failed to run)

data
object
meta
object