> ## Documentation Index > Fetch the complete documentation index at: https://docs.orbit.devotel.io/llms.txt > Use this file to discover all available pages before exploring further. # Compare self vs reviewer scores for a call > Return the self-evaluation, the reviewer evaluation, and the per-criterion `variance` between them for a single call — the calibration gap that surfaces where an agent over- or under-rates their own work. `call_id` is required; un-graded auto-sampled / CSAT placeholder rows are excluded from the reviewer side. A non-reviewer agent only ever sees their own variance, while reviewer scope (owner / admin / supervisor) may pass `agent_id` to inspect any agent. ## OpenAPI ````yaml /openapi.yaml get /api/v1/quality/evaluations/variance openapi: 3.1.0 info: title: Devotel CPaaS API description: Orbit by Devotel — Communications Platform as a Service API version: 1.0.0 contact: name: Devotel url: https://devotel.io email: support@devotel.io license: name: Proprietary servers: - url: https://api.orbit.devotel.io description: Production security: - Bearer: [] - ApiKey: [] tags: - name: Messages description: >- Send and manage messages across all channels (SMS, WhatsApp, RCS, Email, Viber, etc.) - name: Agents description: AI agent creation, configuration, and execution - name: Voice description: Voice calls, IVR, conferencing, and SIP trunking - name: Webhooks description: Webhook endpoint management and delivery logs - name: Numbers description: Phone number search, provisioning, and configuration - name: Contacts description: Contact management, segmentation, and lifecycle tracking - name: Campaigns description: Marketing campaign orchestration and analytics - name: Flows description: Automation flow builder and execution engine - name: Templates description: Message template management and approval workflows - name: Settings description: Organization, channel, and user preference settings - name: Verify description: OTP generation and verification across channels - name: Push description: Push notification delivery via FCM and APNs - name: Telegram description: >- Telegram bring-your-own-bot channel: connect a bot, verify a chat against the shared sandbox bot, and read unified channel state. Production sends go through the Messaging API. - name: USSD description: >- Menu-driven USSD for feature phones: define a menu tree, simulate session steps, and host the tenant-scoped aggregator callback. - name: Integrations description: Third-party service connections and OAuth management - name: Files description: >- Server-to-server media upload, listing, retrieval, and deletion (signed-URL backed) - name: Messaging Services description: >- Twilio MessagingService-parity containers bundling sender pool, opt-out list, inbound webhook, and sticky-sender/geomatch flags - name: Sender Pools description: >- Group sending numbers into pools with a selection strategy (sticky / round-robin / random) for outbound sends - name: Opt-Out Lists description: >- Per-list STOP / HELP / START keyword sets and auto-response copy (Twilio Advanced Opt-Out parity) - name: SMPP description: Tenant BYO-SMPP bind credentials and upstream termination carriers - name: Commerce description: >- Unified omnichannel conversational-commerce: cart/checkout state machine, cross-channel payment reconciliation, hosted pay-by-link, native WhatsApp checkout, and agentic-checkout payment mandates - name: Orby description: >- In-dashboard Orby operator assistant: streamed assistant turns, conversation threads, product knowledge-base search, and the tool-action approval gate. Available to signed-in operators only (dashboard session auth — API-key requests are rejected). paths: /api/v1/quality/evaluations/variance: get: tags: - Quality summary: Compare self vs reviewer scores for a call description: >- Return the self-evaluation, the reviewer evaluation, and the per-criterion `variance` between them for a single call — the calibration gap that surfaces where an agent over- or under-rates their own work. `call_id` is required; un-graded auto-sampled / CSAT placeholder rows are excluded from the reviewer side. A non-reviewer agent only ever sees their own variance, while reviewer scope (owner / admin / supervisor) may pass `agent_id` to inspect any agent. parameters: - name: X-Test-Mode in: header required: false description: >- Sandbox opt-in for Clerk-session-authenticated requests. Set to `true` to route the call through the test-mode pipeline: no real provider delivery, no credits deducted, response `meta.test_mode: true`. **Ignored for live API keys (`dv_live_sk_*`)** — server-to-server clients must use a test-prefixed key (`dv_test_sk_*`) to exercise sandbox. Test-prefixed keys unconditionally enable sandbox regardless of this header. schema: type: string enum: - 'true' - 'false' responses: '200': description: >- The self-vs-reviewer calibration gap for one call. `self`, `reviewer` and `variance` are each null until both sides exist — a call with only one of the two is a valid 200, not a 404. content: application/json: schema: type: object additionalProperties: true description: >- The self-vs-reviewer calibration gap for one call. `self`, `reviewer` and `variance` are each null until both sides exist — a call with only one of the two is a valid 200, not a 404. properties: data: type: object additionalProperties: true properties: call_id: type: string description: The call that was compared. agent_id: type: string description: >- Agent whose scores were compared. Always the caller unless reviewer scope passed an explicit `agent_id`. self: type: - 'null' - object additionalProperties: true properties: scores: type: object additionalProperties: true description: >- Per-criterion scores, keyed by criterion id (0-100). total_score: type: number description: Weighted 0-100 rollup for this side. reviewer: type: - 'null' - object additionalProperties: true properties: scores: type: object additionalProperties: true description: >- Per-criterion scores, keyed by criterion id (0-100). total_score: type: number description: Weighted 0-100 rollup for this side. description: >- The official reviewer evaluation. Un-graded auto-sampled / CSAT placeholder rows are excluded, so this stays null until a human has actually scored the call. variance: type: - 'null' - object additionalProperties: true description: >- The deltas between the two sides — null unless both a self and a reviewer evaluation exist. A positive delta means the reviewer scored higher than the agent did. properties: self_total: type: number reviewer_total: type: number delta: type: number description: >- `reviewer_total - self_total`, computed from the rounded values so it reconciles with the two displayed totals. per_criterion: type: array description: >- One entry per criterion present on either side, sorted by criterion id. A criterion missing from one side counts as 0 there. items: type: object additionalProperties: true properties: criterion_id: type: string self_score: type: number reviewer_score: type: number delta: type: number meta: type: object properties: request_id: type: string description: >- Unique request identifier (also returned in X-Request-Id header) timestamp: type: string format: date-time description: ISO 8601 UTC timestamp of the response additionalProperties: true example: data: call_id: call_51ab77c9e0 agent_id: user_2mN4zR7Ld self: scores: crit_greeting: 100 crit_identity: 100 crit_pii: 100 total_score: 100 reviewer: scores: crit_greeting: 100 crit_identity: 80 crit_pii: 100 total_score: 92.67 variance: self_total: 100 reviewer_total: 92.67 delta: -7.33 per_criterion: - criterion_id: crit_greeting self_score: 100 reviewer_score: 100 delta: 0 - criterion_id: crit_identity self_score: 100 reviewer_score: 80 delta: -20 - criterion_id: crit_pii self_score: 100 reviewer_score: 100 delta: 0 meta: request_id: req_1a2b3c4d5e timestamp: '2026-08-19T09:00:00.000Z' '400': $ref: '#/components/responses/StandardError' '401': $ref: '#/components/responses/StandardError' '403': $ref: '#/components/responses/StandardError' '404': $ref: '#/components/responses/StandardError' '422': $ref: '#/components/responses/StandardError' '429': $ref: '#/components/responses/RateLimitedResponse' '500': $ref: '#/components/responses/StandardError' components: responses: StandardError: description: >- Standard error envelope. `error.code` is machine-readable; see the [error reference](https://docs.orbit.devotel.io/reference/error-codes) for the catalogue. content: application/json: schema: type: object properties: error: type: object required: - code - message - status properties: code: type: string description: Machine-readable error code (e.g. INVALID_PHONE_NUMBER) message: type: string description: Human-readable error description status: type: integer description: HTTP status code details: type: object additionalProperties: true description: Additional context about the error meta: type: object properties: request_id: type: string timestamp: type: string format: date-time docs_url: type: string format: uri description: Link to relevant error documentation RateLimitedResponse: description: >- Rate limit exceeded. Wait `error.retry_after` seconds (or read the `Retry-After` header) before retrying. Returned when the request would exceed the bucket identified by `X-RateLimit-Bucket`. headers: X-RateLimit-Limit: description: Total request quota for the current window. schema: type: integer minimum: 0 X-RateLimit-Remaining: description: Requests remaining in the current window. schema: type: integer minimum: 0 X-RateLimit-Reset: description: >- Absolute unix-epoch-seconds timestamp at which the current window resets. schema: type: integer minimum: 0 X-RateLimit-Bucket: description: >- Name of the rate-limit bucket the request was bound by (e.g. `auth-write`, `money`, `agent-invoke`, or `custom:/`). Stripe-style — lets clients see which named cap they hit. schema: type: string RateLimit-Limit: description: >- draft-ietf-httpapi-ratelimit-headers no-prefix mirror of `X-RateLimit-Limit`. Some SDKs read only this form. schema: type: integer minimum: 0 RateLimit-Remaining: description: >- draft-ietf-httpapi-ratelimit-headers no-prefix mirror of `X-RateLimit-Remaining`. schema: type: integer minimum: 0 RateLimit-Reset: description: >- draft-ietf-httpapi-ratelimit-headers no-prefix mirror — delta seconds from now until the window resets (NOT epoch). schema: type: integer minimum: 0 Retry-After: description: >- RFC 7231 §7.1.3 — number of seconds the client should wait before retrying. schema: type: integer minimum: 1 content: application/json: schema: type: object properties: error: type: object required: - code - message - status - retry_after properties: code: type: string enum: - RATE_LIMITED description: >- Always `RATE_LIMITED` — the global request-limiter 429. Distinct from `RATE_LIMIT_EXCEEDED`, the live per-recipient/per-tenant/per-resource frequency-cap 429 (not retired). message: type: string status: type: integer enum: - 429 retry_after: type: integer minimum: 1 description: >- Seconds to wait before retrying. Mirrors `Retry-After` header. meta: type: object properties: request_id: type: string timestamp: type: string format: date-time docs_url: type: string format: uri securitySchemes: Bearer: type: http scheme: bearer bearerFormat: JWT description: Dashboard JWT token from Clerk ApiKey: type: apiKey name: X-API-Key in: header description: Server-to-server API key (dv_live_sk_*) ````