{
  "$schema": "https://receiptaudit.com/benchmarks/schema.json",
  "suite": "receipt-audit",
  "title": "RA-Bench: receipt extraction, fake detection, evidence and duplicates",
  "preliminary": true,
  "disclosure": "We build Receipt Audit and we run this benchmark. Our engine is one of the targets, so read it as a vendor benchmark: headline numbers come from a held-out set nobody tuned on, every run is kept (incomplete ones included), and losses are listed first. The public cases, their labels, every target's outputs and the harness are available on request: email hello@godard.me for them, to reproduce a number or to dispute one.",
  "manifest": {
    "runId": "20261018T165538Z-0363fe",
    "suite": "receipt-audit",
    "suiteVersion": "0.2.0",
    "datasetHash": "9cfa2c4c2d6e596579470768c8b182ffc7d264123e0c0fc7ee707a6de9dd6d79",
    "split": "private",
    "startedAt": "2026-10-18T16:55:38.100Z",
    "finishedAt": "2026-10-18T17:12:34.377Z",
    "gitSha": "36dc1354ad557fcc6490a5cd144f8960073941db",
    "reps": 3,
    "cases": 151,
    "targets": [
      {
        "id": "self",
        "label": "Receipt Audit (Claude Haiku 5.5)",
        "kind": "self",
        "version": "engine.0.2.1+anthropic/claude-haiku-5.5+prompt.9a2a5877e979+git.36dc1354ad55",
        "config": {
          "engine": "ReceiptChecks (apps/receipt-check/lib/server/ReceiptChecks.ts), in process",
          "engineVersion": "0.2.1",
          "production": true,
          "model": "anthropic/claude-haiku-5.5",
          "prompt": "apps/receipt-check/lib/receipts/model.ts (INSTRUCTIONS, USER_PROMPT and the ModelAnalysis output schema)",
          "promptSha256": "9a2a5877e9795c37df6d2c2cb89f56cae64b76ae10bbd672cc1ab6bb41426a71",
          "instructionsSha256": "da94bf411e9d3c47462a4d77b59a373a2b478a3e6afffb86889dc5e93ad452fb",
          "hashVersion": 2,
          "endpoint": "https://ai-gateway.vercel.sh/v1/chat/completions",
          "reasoningEffort": "low",
          "structuredOutput": true,
          "modelTimeout": "90 seconds",
          "modelRetries": "2, on errors effect/ai marks retryable",
          "filePreparation": "upright, at most 3072 px and 3.75 MB (lib/receipts/model.ts)",
          "duplicateNetwork": "the production Convex functions on an in-memory backend, empty at the start of each repetition",
          "submitter": "one account per case (the case id)",
          "gitSha": "36dc1354ad557fcc6490a5cd144f8960073941db",
          "pricePerCheckUsd": 0.01633333333333333,
          "cost": "cost_per_check_usd is what a caller pays Receipt Audit per check: the list price of the smallest credit pack (credits-3k: $49 for 3,000 checks, $0.0163 per check). model_cost_per_check_usd (and each result's costUsd) is the engine's own model call: tokens × the AI Gateway list price on the price date."
        },
        "priceDate": "2026-10-18",
        "unsupportedTasks": []
      },
      {
        "id": "diy:claude-haiku-5.5",
        "label": "Claude Haiku 5.5, plain prompt",
        "kind": "diy",
        "version": "claude-haiku-5-5@claude-code-cli+prompt.512dfb3893be+git.36dc1354ad55",
        "config": {
          "transport": "claude-code-cli",
          "endpoint": "http://127.0.0.1:8789/v1/messages (claude-local: one headless `claude -p` per call, no tools, no MCP, no settings, empty cwd)",
          "billing": "subscription",
          "cli": "claude 2.1.296",
          "thinking": "Claude Code default (adaptive; can't be fully disabled via the CLI)",
          "ignored": [
            "max_tokens"
          ],
          "costUsd": "API-equivalent: the reported tokens × the AI Gateway list price, i.e. what the check costs when called through the API",
          "usage": "as the CLI reports it, including Claude Code's own cached system prompt (about 3,500 tokens, mostly cache reads); inputTokens counts uncached, cache-read and cache-write tokens",
          "model": "claude-haiku-5-5",
          "max_tokens": 4096,
          "message": "one user turn: the file (image block, or document block for a PDF), then the prompt",
          "rateLimits": "HTTP 429 (a subscription limit on claude-local) is retried with backoff like a transport error",
          "prompt": "apps/receipt-check/bench/prompt.ts (DIY_PLAIN_PROMPT)",
          "promptSha256": "512dfb3893be5aa7f89ff7be2259d8f9c94c948fe8b2d6e3dca9bc6f5889bc37",
          "gitSha": "36dc1354ad557fcc6490a5cd144f8960073941db",
          "cost": "cost_per_check_usd and model_cost_per_check_usd are both the API-equivalent token cost: tokens × the AI Gateway list price on the price date"
        },
        "priceDate": "2026-10-18",
        "unsupportedTasks": [
          "checks",
          "duplicates",
          "proof"
        ]
      },
      {
        "id": "diy:gemini-3.8-flash",
        "label": "Gemini 3.8 Flash, plain prompt",
        "kind": "diy",
        "version": "google/gemini-3.8-flash+prompt.512dfb3893be+git.36dc1354ad55",
        "config": {
          "endpoint": "https://ai-gateway.vercel.sh/v1/chat/completions (Vercel AI Gateway, OpenAI-compatible)",
          "model": "google/gemini-3.8-flash",
          "max_tokens": "not set (provider default)",
          "reasoning": "not set (provider default)",
          "temperature": "not set (provider default)",
          "message": "one user turn: the file (image_url part, or a file part for a PDF), then the prompt",
          "prompt": "apps/receipt-check/bench/prompt.ts (DIY_PLAIN_PROMPT)",
          "promptSha256": "512dfb3893be5aa7f89ff7be2259d8f9c94c948fe8b2d6e3dca9bc6f5889bc37",
          "gitSha": "36dc1354ad557fcc6490a5cd144f8960073941db",
          "cost": "cost_per_check_usd and model_cost_per_check_usd are both the API-equivalent token cost: tokens × the AI Gateway list price on the price date"
        },
        "priceDate": "2026-10-18",
        "unsupportedTasks": [
          "checks",
          "duplicates",
          "proof"
        ]
      },
      {
        "id": "decision:gpt-6-luna",
        "label": "OpenAI decision model (gpt-6-luna), asked if it's fake",
        "kind": "diy",
        "version": "openai/gpt-6-luna-decisions+prompt.977e84771afc+git.36dc1354ad55",
        "config": {
          "endpoint": "https://ai-gateway.vercel.sh/v1/decisions (Vercel AI Gateway → OpenAI Decisions API, public beta)",
          "model": "openai/gpt-6-luna-decisions",
          "questions": "apps/receipt-check/bench/prompt.ts (DECISION_QUESTIONS): a predicate (is it fake) and two choices (how it was made, which part looks altered)",
          "questionsSha256": "e17d0fb5b77b6147ffdb12fa1e22ed2dc99e5edec56d69731f297ad2c86aca37",
          "input": "one user message: DECISION_INPUT_TEXT and the image as a base64 data URL; a PDF's first page rendered at 150 dpi (pdftoppm)",
          "risk": "the predicate's probability",
          "reasons": "the two choices, in plain words",
          "cost": "input tokens × $0.1 per 1M (no output charge), price of 2026-10-12",
          "gitSha": "36dc1354ad557fcc6490a5cd144f8960073941db"
        },
        "priceDate": "2026-10-12",
        "unsupportedTasks": [
          "extraction",
          "checks",
          "duplicates",
          "proof"
        ]
      }
    ]
  },
  "metrics": [
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "self",
      "value": 0.9824561403508771,
      "lo": 0.9317452345909818,
      "hi": 0.9956658716428599,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "self",
      "value": 0.9880952380952381,
      "lo": 0.9463738491653615,
      "hi": 0.9974448358407173,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "self",
      "value": 0.9375,
      "lo": 0.7167126242970107,
      "hi": 0.9888806552353576,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "self",
      "value": 0.9669421487603307,
      "lo": 0.9180772072778854,
      "hi": 0.9870708186058749,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "self",
      "value": 0.9728682170542635,
      "lo": 0.9358935742971888,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9822222222222221,
      "lo": 0.921271845462039,
      "hi": 0.9961811597878769,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9855072463768116,
      "lo": 0.9352066402621196,
      "hi": 0.9968882426054649,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9696969696969698,
      "lo": 0.6985052183558994,
      "hi": 0.9977426005529196,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9700000000000002,
      "lo": 0.9154806357094727,
      "hi": 0.9897454759759612,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9940476190476191,
      "lo": 0.9807692307692307,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.980392156862745,
      "lo": 0.7851540058719944,
      "hi": 0.9985403350018538,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.9444444444444444,
      "lo": 0.7424269921812741,
      "hi": 0.990124809021697,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.980392156862745,
      "lo": 0.7851540058719944,
      "hi": 0.9985403350018538,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.9833333333333332,
      "lo": 0.812152827904405,
      "hi": 0.9987595193112027,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.9551282051282052,
      "lo": 0.8954248366013072,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9794238683127572,
      "lo": 0.9205185013021672,
      "hi": 0.9949144455877391,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9851851851851853,
      "lo": 0.9338287027348304,
      "hi": 0.9968189494953417,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "self",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "self",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9595959595959598,
      "lo": 0.900679787497458,
      "hi": 0.9841773610058525,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "self",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9375,
      "lo": 0.7167126242970107,
      "hi": 0.9888806552353576,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9499999999999998,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9728682170542635,
      "lo": 0.9349380790319531,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9727891156462586,
      "lo": 0.8826896443704225,
      "hi": 0.9941471116047543,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9892473118279569,
      "lo": 0.9228158443021488,
      "hi": 0.9985894184803787,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "self",
      "value": 1,
      "lo": 0.9299533801014687,
      "hi": 1,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "self",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9714285714285714,
      "lo": 0.9016774388157609,
      "hi": 0.9921293880545587,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "self",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.9333333333333332,
      "lo": 0.6349338104169441,
      "hi": 0.991204429701885,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.9393939393939393,
      "lo": 0.6593196035093029,
      "hi": 0.9920090012763662,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9783549783549783,
      "lo": 0.9165992056177531,
      "hi": 0.9946494004973204,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9841269841269842,
      "lo": 0.9293193205020928,
      "hi": 0.9965912281757762,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "self",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "self",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9641577060931902,
      "lo": 0.9043958133184984,
      "hi": 0.9870956448304649,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "self",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9783549783549783,
      "lo": 0.9165992056177531,
      "hi": 0.9946494004973204,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9841269841269842,
      "lo": 0.9293193205020928,
      "hi": 0.9965912281757762,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9641577060931902,
      "lo": 0.9043958133184984,
      "hi": 0.9870956448304649,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9796747967479674,
      "lo": 0.9214414467059509,
      "hi": 0.9949766541441967,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9850187265917604,
      "lo": 0.9331175219888524,
      "hi": 0.9967831326321611,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9659863945578233,
      "lo": 0.9090608897865508,
      "hi": 0.9877578949299785,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9841269841269841,
      "lo": 0.9512195121951219,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.9710144927536232,
      "lo": 0.8110184487836904,
      "hi": 0.9961905338354728,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.9621212121212122,
      "lo": 0.8943089430894309,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9824561403508771,
      "lo": 0.9317452345909818,
      "hi": 0.9956658716428599,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9880952380952381,
      "lo": 0.9463738491653615,
      "hi": 0.9974448358407173,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9375,
      "lo": 0.7167126242970107,
      "hi": 0.9888806552353576,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9669421487603307,
      "lo": 0.9180772072778854,
      "hi": 0.9870708186058749,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9728682170542635,
      "lo": 0.9333333333333333,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9799196787148594,
      "lo": 0.9223432070897968,
      "hi": 0.9950373591574655,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9851851851851853,
      "lo": 0.9338287027348304,
      "hi": 0.9968189494953417,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9663299663299665,
      "lo": 0.9099398176836242,
      "hi": 0.9878822707244967,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.983739837398374,
      "lo": 0.95,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.9689922480620154,
      "lo": 0.9024390243902439,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9774011299435028,
      "lo": 0.9012935311709601,
      "hi": 0.9951422675915979,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9814814814814815,
      "lo": 0.9181661300687035,
      "hi": 0.9960216296532264,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "self",
      "value": 1,
      "lo": 0.93982814785791,
      "hi": 0.9999999999999998,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "self",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9670781893004117,
      "lo": 0.9024692586862822,
      "hi": 0.9893903075970173,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "self",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.982456140350877,
      "lo": 0.8039399248192851,
      "hi": 0.9986941572352075,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.9333333333333332,
      "lo": 0.7414447301258664,
      "hi": 0.9855801328950236,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.9767441860465116,
      "lo": 0.9393939393939394,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9757575757575757,
      "lo": 0.8946078006966166,
      "hi": 0.9947877782404587,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9774011299435029,
      "lo": 0.9012935311709603,
      "hi": 0.9951422675915981,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.9312077638761376,
      "hi": 1,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9607843137254903,
      "lo": 0.8849425202336567,
      "hi": 0.9873486010125532,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "all",
      "target": "self",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "all",
      "target": "self",
      "value": 0.875,
      "lo": 0.5291118177871464,
      "hi": 0.9775825085499433,
      "n": 8,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "all",
      "target": "self",
      "value": 0.01282051282051282,
      "lo": 0.0022667317538337325,
      "hi": 0.06910857001702223,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "all",
      "target": "self",
      "value": 0.5977961432506886,
      "lo": 0.508720421979405,
      "hi": 0.6808533533531818,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.01282051282051282,
      "lo": 0.0022667317538337325,
      "hi": 0.06910857001702223,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.6166666666666667,
      "lo": 0.5187373033119878,
      "hi": 0.7059642137730489,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.48148148148148145,
      "lo": 0.2751672778870774,
      "hi": 0.694309730396132,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.5454545454545454,
      "lo": 0.280091537409322,
      "hi": 0.7872872837754024,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.5833333333333333,
      "lo": 0.3715564152382803,
      "hi": 0.7682560584195831,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.492063492063492,
      "lo": 0.2966908861842091,
      "hi": 0.6898906855447566,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.014705882352941176,
      "lo": 0.0026006835761068076,
      "hi": 0.07870973128160871,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.6262626262626262,
      "lo": 0.5279244532290261,
      "hi": 0.7151681699861687,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.3,
      "lo": 0.1454772448676043,
      "hi": 0.5189728183535235,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.4,
      "lo": 0.16818032970623614,
      "hi": 0.6873262302663417,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.014925373134328358,
      "lo": 0.0026395717340788882,
      "hi": 0.07981862319778105,
      "n": 67,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.6904761904761906,
      "lo": 0.5746590619820308,
      "hi": 0.7864750094807248,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.2588329669680317,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.5757575757575757,
      "lo": 0.30394425864475716,
      "hi": 0.8083537766631168,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.7666666666666667,
      "lo": 0.4578711470372018,
      "hi": 0.927444693035924,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.015151515151515152,
      "lo": 0.0026796405439821064,
      "hi": 0.08095920262066399,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.6559139784946236,
      "lo": 0.5549092077246491,
      "hi": 0.7445493129663152,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.015151515151515152,
      "lo": 0.0026796405439821064,
      "hi": 0.08095920262066399,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.6559139784946236,
      "lo": 0.5549092077246491,
      "hi": 0.7445493129663152,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.5,
      "lo": 0.26799202452413634,
      "hi": 0.7320079754758637,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.015151515151515152,
      "lo": 0.0026796405439821064,
      "hi": 0.08095920262066399,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.6326530612244897,
      "lo": 0.5338875533526598,
      "hi": 0.7214112247783228,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.4492753623188405,
      "lo": 0.268217036548423,
      "hi": 0.6448527653233594,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.01282051282051282,
      "lo": 0.0022667317538337325,
      "hi": 0.06910857001702223,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.5977961432506886,
      "lo": 0.508720421979405,
      "hi": 0.6808533533531818,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.5,
      "lo": 0.26799202452413634,
      "hi": 0.7320079754758637,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.014925373134328358,
      "lo": 0.0026395717340788882,
      "hi": 0.07981862319778105,
      "n": 67,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.6262626262626262,
      "lo": 0.5279244532290261,
      "hi": 0.7151681699861687,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.4333333333333334,
      "lo": 0.24487520800487073,
      "hi": 0.6432748130688387,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.01282051282051282,
      "lo": 0.0022667317538337325,
      "hi": 0.06910857001702223,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.6748971193415637,
      "lo": 0.566992010778307,
      "hi": 0.7669642144819592,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.2727272727272727,
      "lo": 0.09746059290024889,
      "hi": 0.5656453011761291,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.45,
      "lo": 0.2581978582556243,
      "hi": 0.6579146575496577,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=commons",
      "target": "self",
      "value": 0.5897435897435896,
      "lo": 0.33346465450382823,
      "hi": 0.805082329945418,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.7666666666666667,
      "lo": 0.4578711470372018,
      "hi": 0.927444693035924,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.015151515151515152,
      "lo": 0.0026796405439821064,
      "hi": 0.08095920262066399,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.6911764705882352,
      "lo": 0.5736318830649044,
      "hi": 0.7882761353244802,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "self",
      "value": 0.8834876543209876,
      "lo": 0.8036998456790123,
      "hi": 0.9489236111111111,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "self",
      "value": 0.525,
      "lo": 0.375,
      "hi": 0.825,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "self",
      "value": 0.775,
      "lo": 0.55,
      "hi": 0.9,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "self",
      "value": 0.775,
      "lo": 0.65,
      "hi": 0.9,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.4299143431347525,
      "hi": 0.7221487233323665,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "self",
      "value": 0.020576131687242795,
      "lo": 0.005085554412260843,
      "hi": 0.07948149869783273,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "self",
      "value": 0.5166666666666667,
      "lo": 0.36727661518132826,
      "hi": 0.6631359981120957,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.45,
      "lo": 0.2581978582556243,
      "hi": 0.6579146575496577,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.33333333333333337,
      "lo": 0.16906782991982028,
      "hi": 0.551307222764453,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.9027777777777778,
      "lo": 0.7407407407407407,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.8333333333333334,
      "lo": 0.5833333333333334,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.8333333333333334,
      "lo": 0.5833333333333334,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.8333333333333334,
      "lo": 0.5833333333333334,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.39062208887279953,
      "hi": 0.8618799089087867,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.39062208887279953,
      "hi": 0.8618799089087867,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.8739939637826962,
      "lo": 0.7736355633802817,
      "hi": 0.9562374245472837,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.4642857142857143,
      "lo": 0.2857142857142857,
      "hi": 0.8214285714285714,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.75,
      "lo": 0.42857142857142855,
      "hi": 0.8928571428571429,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.75,
      "lo": 0.6071428571428571,
      "hi": 0.9285714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.5476190476190476,
      "lo": 0.36889938248709064,
      "hi": 0.7148488742018763,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.023474178403755867,
      "lo": 0.005804361167912518,
      "hi": 0.09006218482255104,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.4523809523809524,
      "lo": 0.28515112579812363,
      "hi": 0.6311006175129092,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.8564705882352941,
      "lo": 0.7408823529411764,
      "hi": 0.9494117647058824,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.44,
      "lo": 0.28,
      "hi": 0.8,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.72,
      "lo": 0.44,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.72,
      "lo": 0.56,
      "hi": 0.92,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.5199999999999999,
      "lo": 0.3349851695035677,
      "hi": 0.6996871404588703,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.024509803921568624,
      "lo": 0.0060613816278084695,
      "hi": 0.09380841878833704,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.42666666666666664,
      "lo": 0.2556657739363266,
      "hi": 0.6172024228680671,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.8564705882352941,
      "lo": 0.7467573529411764,
      "hi": 0.9500073529411764,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.44,
      "lo": 0.28,
      "hi": 0.8,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.72,
      "lo": 0.4,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.72,
      "lo": 0.56,
      "hi": 0.92,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.5199999999999999,
      "lo": 0.3349851695035677,
      "hi": 0.6996871404588703,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.024509803921568624,
      "lo": 0.0060613816278084695,
      "hi": 0.09380841878833704,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.42666666666666664,
      "lo": 0.2556657739363266,
      "hi": 0.6172024228680671,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.8794117647058823,
      "lo": 0.7850367647058824,
      "hi": 0.9553921568627451,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.5,
      "lo": 0.3333333333333333,
      "hi": 0.8333333333333334,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.7666666666666667,
      "lo": 0.4666666666666667,
      "hi": 0.9,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.7666666666666667,
      "lo": 0.6333333333333333,
      "hi": 0.9333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.5666666666666667,
      "lo": 0.3919730700081361,
      "hi": 0.7262251442353347,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.024509803921568624,
      "lo": 0.0060613816278084695,
      "hi": 0.09380841878833704,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.4888888888888889,
      "lo": 0.3217282824448934,
      "hi": 0.6585720151811947,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.9076923076923077,
      "lo": 0.7384615384615385,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.6333333333333333,
      "lo": 0.339777586667533,
      "hi": 0.8528803333690298,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.6,
      "lo": 0.31267376973365824,
      "hi": 0.8318196702937638,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.8834876543209876,
      "lo": 0.8032175925925926,
      "hi": 0.9521604938271605,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.525,
      "lo": 0.375,
      "hi": 0.85,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.775,
      "lo": 0.575,
      "hi": 0.9,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.775,
      "lo": 0.65,
      "hi": 0.9,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.4299143431347525,
      "hi": 0.7221487233323665,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.020576131687242795,
      "lo": 0.005085554412260843,
      "hi": 0.07948149869783273,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.5166666666666667,
      "lo": 0.36727661518132826,
      "hi": 0.6631359981120957,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.8659420289855072,
      "lo": 0.7683574879227053,
      "hi": 0.9483212560386473,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.5,
      "lo": 0.3333333333333333,
      "hi": 0.8,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.7333333333333333,
      "lo": 0.4666666666666667,
      "hi": 0.9,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.7333333333333333,
      "lo": 0.5666666666666667,
      "hi": 0.9,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.5666666666666667,
      "lo": 0.3919730700081361,
      "hi": 0.7262251442353347,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.024154589371980673,
      "lo": 0.005973215779103619,
      "hi": 0.09252552752158813,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.4888888888888889,
      "lo": 0.3217282824448934,
      "hi": 0.6585720151811947,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.36666666666666664,
      "lo": 0.1471196666309701,
      "hi": 0.6602224133324669,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.16666666666666666,
      "lo": 0.042141900169843094,
      "hi": 0.4762132997387497,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.024509803921568624,
      "lo": 0.0060613816278084695,
      "hi": 0.09380841878833704,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.85,
      "lo": 0.6395811352592431,
      "hi": 0.9476312541037835,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.8333333333333334,
      "lo": 0.6206812940840898,
      "hi": 0.9385686005473641,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.3166666666666667,
      "lo": 0.15716056329227931,
      "hi": 0.5352519946604213,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.2,
      "lo": 0.08065766257979806,
      "hi": 0.41601743225189364,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.020576131687242795,
      "lo": 0.005085554412260843,
      "hi": 0.07948149869783273,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9027777777777778,
      "lo": 0.7839197530864198,
      "hi": 0.9950617283950617,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7,
      "lo": 0.5,
      "hi": 0.9,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.85,
      "lo": 0.65,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.85,
      "lo": 0.7,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7166666666666667,
      "lo": 0.4975386865533784,
      "hi": 0.8659737449570666,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7,
      "lo": 0.4810271816464765,
      "hi": 0.8545227551323956,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.7981481481481482,
      "lo": 0.5999382716049384,
      "hi": 0.9629629629629629,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.6,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.6,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5333333333333334,
      "lo": 0.26109856576627416,
      "hi": 0.7870659142428669,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.9302469135802469,
      "lo": 0.8296296296296296,
      "hi": 0.9925925925925926,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.2,
      "lo": 0,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.8,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.8,
      "lo": 0.6,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.36666666666666664,
      "lo": 0.1471196666309701,
      "hi": 0.6602224133324669,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.16666666666666666,
      "lo": 0.042141900169843094,
      "hi": 0.4762132997387497,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.8181818181818182,
      "lo": 0.6851781705948373,
      "hi": 0.9343504489337823,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.5454545454545454,
      "lo": 0.36363636363636365,
      "hi": 0.7727272727272727,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.6818181818181818,
      "lo": 0.45454545454545453,
      "hi": 0.8636363636363636,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.6818181818181818,
      "lo": 0.5,
      "hi": 0.8636363636363636,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.5454545454545454,
      "lo": 0.3465979532073494,
      "hi": 0.7307970581918668,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.5454545454545454,
      "lo": 0.3465979532073494,
      "hi": 0.7307970581918668,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.9633058984910837,
      "lo": 0.9115140603566529,
      "hi": 0.9965706447187929,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.5,
      "lo": 0.2777777777777778,
      "hi": 0.9444444444444444,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.8888888888888888,
      "lo": 0.6111111111111112,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.8888888888888888,
      "lo": 0.7222222222222222,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.6296296296296297,
      "lo": 0.4030311553632179,
      "hi": 0.8106297866543154,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.48148148148148145,
      "lo": 0.2751672778870774,
      "hi": 0.694309730396132,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "all",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "all",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "all",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.061129370526788386,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 6.938893903907228e-18,
      "hi": 0.06419393671876342,
      "n": 56,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "capture=scan",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.09523809523809523,
      "lo": 0.02651876743807452,
      "hi": 0.2891413907391826,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 6.938893903907228e-18,
      "hi": 0.07269781922049637,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.2588329669680317,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.061129370526788386,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.09090909090909091,
      "lo": 0.016232172885884855,
      "hi": 0.37735843645159567,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.07707356308558039,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.07707356308558039,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.07707356308558039,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.061129370526788386,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.07555760416399632,
      "n": 47,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.061129370526788386,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9888888888888889,
      "lo": 0.8676135965299882,
      "hi": 0.9991733079221313,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.07707356308558039,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "self",
      "value": 0.9669421487603306,
      "lo": 0.9180772072778853,
      "hi": 0.9870708186058748,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "self",
      "value": 0.08175757575757575,
      "lo": 0.05893863636363653,
      "hi": 0.1286132231404958,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "self",
      "value": 762.9629629629628,
      "lo": 341.6666666666667,
      "hi": 1320.2499999999998,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "self",
      "value": 483.33333333333326,
      "lo": 333.1250000000003,
      "hi": 633.3333333333333,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self",
      "value": 391.1111111111111,
      "lo": 35.00000000000001,
      "hi": 959.3888888888888,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self",
      "value": 48.33333333333333,
      "lo": 32.5,
      "hi": 63.35416666666654,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "self",
      "value": 2415.637860082304,
      "lo": 1591.2551440329216,
      "hi": 3340.450102880657,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "self",
      "value": 2416.6666666666665,
      "lo": 1666.6666666666663,
      "hi": 3166.666666666667,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "self",
      "value": 479.6296296296295,
      "lo": 114.60000000000011,
      "hi": 1041.77037037037,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "self",
      "value": 154.66666666666666,
      "lo": 106.66666666666669,
      "hi": 202.66666666666666,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "self",
      "value": 1104.6296296296293,
      "lo": 621.7194444444444,
      "hi": 1710.777777777778,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "self",
      "value": 879.6666666666666,
      "lo": 606.6666666666666,
      "hi": 1167.8333333333333,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "self",
      "value": 579.6296296296296,
      "lo": 340.16666666666663,
      "hi": 900.1851851851851,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "self",
      "value": 483.33333333333326,
      "lo": 324.99999999999994,
      "hi": 633.3333333333333,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "self",
      "value": 1903.7037037037035,
      "lo": 333.33333333333337,
      "hi": 4349.98148148148,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "self",
      "value": 483.33333333333326,
      "lo": 333.33333333333326,
      "hi": 625,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "self",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "self",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "self",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "self",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "self",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "self",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "self",
      "value": 0.3333333333333333,
      "lo": 0.16906782991982022,
      "hi": 0.5513072227644529,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "all",
      "target": "self",
      "value": 0.5333333333333334,
      "lo": 0.38270826816366976,
      "hi": 0.6781169584231781,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.6166666666666667,
      "lo": 0.40180353972776717,
      "hi": 0.7939339233932418,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5333333333333334,
      "lo": 0.26109856576627416,
      "hi": 0.7870659142428669,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.36666666666666664,
      "lo": 0.1471196666309701,
      "hi": 0.6602224133324669,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "genuine_with_proof_rate",
      "stratum": "all",
      "target": "self",
      "value": 0.024691358024691357,
      "lo": 0.006797587423664028,
      "hi": 0.08562725922196524,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "self",
      "value": 4057,
      "lo": 4057,
      "hi": 4057,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "self",
      "value": 8907,
      "lo": 8907,
      "hi": 8907,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "self",
      "value": 10350.600000000002,
      "lo": 10350.600000000002,
      "hi": 10350.600000000002,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "self",
      "value": 0.0010724015452538635,
      "lo": 0.0010724015452538635,
      "hi": 0.0010724015452538635,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 3936,
      "lo": 3936,
      "hi": 3936,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 8564.199999999999,
      "lo": 8564.199999999999,
      "hi": 8564.199999999999,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 9740.410000000003,
      "lo": 9740.410000000003,
      "hi": 9740.410000000003,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.0010592317948717952,
      "lo": 0.0010592317948717952,
      "hi": 0.0010592317948717952,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 5733,
      "lo": 5733,
      "hi": 5733,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 9387.249999999996,
      "lo": 9387.249999999996,
      "hi": 9387.249999999996,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 11241.929999999998,
      "lo": 11241.929999999998,
      "hi": 11241.929999999998,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.0011631166666666666,
      "lo": 0.0011631166666666666,
      "hi": 0.0011631166666666666,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 5574,
      "lo": 5574,
      "hi": 5574,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 8925,
      "lo": 8925,
      "hi": 8925,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 9089,
      "lo": 9089,
      "hi": 9089,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0.001114347619047619,
      "lo": 0.001114347619047619,
      "hi": 0.001114347619047619,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "self",
      "value": 4661.5,
      "lo": 4661.5,
      "hi": 4661.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "self",
      "value": 9077.449999999997,
      "lo": 9077.449999999997,
      "hi": 9077.449999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "self",
      "value": 11120.789999999994,
      "lo": 11120.789999999994,
      "hi": 11120.789999999994,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.0011173216666666666,
      "lo": 0.0011173216666666666,
      "hi": 0.0011173216666666666,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "self",
      "value": 6139,
      "lo": 6139,
      "hi": 6139,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "self",
      "value": 8986.5,
      "lo": 8986.5,
      "hi": 8986.5,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "self",
      "value": 10287.94,
      "lo": 10287.94,
      "hi": 10287.94,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.0011856440000000002,
      "lo": 0.0011856440000000002,
      "hi": 0.0011856440000000002,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "self",
      "value": 3803.5,
      "lo": 3803.5,
      "hi": 3803.5,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "self",
      "value": 8902.050000000001,
      "lo": 8902.050000000001,
      "hi": 8902.050000000001,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "self",
      "value": 10734.570000000027,
      "lo": 10734.570000000027,
      "hi": 10734.570000000027,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.001046442222222222,
      "lo": 0.001046442222222222,
      "hi": 0.001046442222222222,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 5540,
      "lo": 5540,
      "hi": 5540,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 6804.299999999999,
      "lo": 6804.299999999999,
      "hi": 6804.299999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 6944.86,
      "lo": 6944.86,
      "hi": 6944.86,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0.0010927399999999998,
      "lo": 0.0010927399999999998,
      "hi": 0.0010927399999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 5348,
      "lo": 5348,
      "hi": 5348,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 8620.05,
      "lo": 8620.05,
      "hi": 8620.05,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 9214.46,
      "lo": 9214.46,
      "hi": 9214.46,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.00110186,
      "lo": 0.00110186,
      "hi": 0.00110186,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 5013.5,
      "lo": 5013.5,
      "hi": 5013.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 8384.2,
      "lo": 8384.2,
      "hi": 8384.2,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 8588.37,
      "lo": 8588.37,
      "hi": 8588.37,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.001070373333333333,
      "lo": 0.001070373333333333,
      "hi": 0.001070373333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 5068.5,
      "lo": 5068.5,
      "hi": 5068.5,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 9522.05,
      "lo": 9522.05,
      "hi": 9522.05,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 9997.369999999999,
      "lo": 9997.369999999999,
      "hi": 9997.369999999999,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.0010892033333333336,
      "lo": 0.0010892033333333336,
      "hi": 0.0010892033333333336,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "self",
      "value": 3627,
      "lo": 3627,
      "hi": 3627,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "self",
      "value": 8564.199999999999,
      "lo": 8564.199999999999,
      "hi": 8564.199999999999,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "self",
      "value": 11268.659999999996,
      "lo": 11268.659999999996,
      "hi": 11268.659999999996,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.0010410185714285712,
      "lo": 0.0010410185714285712,
      "hi": 0.0010410185714285712,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 4140,
      "lo": 4140,
      "hi": 4140,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 8705.4,
      "lo": 8705.4,
      "hi": 8705.4,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 9630.76,
      "lo": 9630.76,
      "hi": 9630.76,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.0010910545454545454,
      "lo": 0.0010910545454545454,
      "hi": 0.0010910545454545454,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 4530,
      "lo": 4530,
      "hi": 4530,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 10100.4,
      "lo": 10100.4,
      "hi": 10100.4,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 11726.490000000002,
      "lo": 11726.490000000002,
      "hi": 11726.490000000002,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.0011642699999999998,
      "lo": 0.0011642699999999998,
      "hi": 0.0011642699999999998,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "self",
      "value": 4107,
      "lo": 4107,
      "hi": 4107,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "self",
      "value": 6431.95,
      "lo": 6431.95,
      "hi": 6431.95,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "self",
      "value": 6718.39,
      "lo": 6718.39,
      "hi": 6718.39,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "self",
      "value": 0.001070075,
      "lo": 0.001070075,
      "hi": 0.001070075,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "self",
      "value": 3924,
      "lo": 3924,
      "hi": 3924,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "self",
      "value": 8979.599999999995,
      "lo": 8979.599999999995,
      "hi": 8979.599999999995,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "self",
      "value": 10719.239999999994,
      "lo": 10719.239999999994,
      "hi": 10719.239999999994,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.001062944444444445,
      "lo": 0.001062944444444445,
      "hi": 0.001062944444444445,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 4107,
      "lo": 4107,
      "hi": 4107,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 6431.95,
      "lo": 6431.95,
      "hi": 6431.95,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 6718.39,
      "lo": 6718.39,
      "hi": 6718.39,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0.001070075,
      "lo": 0.001070075,
      "hi": 0.001070075,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 3924,
      "lo": 3924,
      "hi": 3924,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 8979.599999999995,
      "lo": 8979.599999999995,
      "hi": 8979.599999999995,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 10719.239999999994,
      "lo": 10719.239999999994,
      "hi": 10719.239999999994,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.001062944444444445,
      "lo": 0.001062944444444445,
      "hi": 0.001062944444444445,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 3913,
      "lo": 3913,
      "hi": 3913,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 8887.949999999999,
      "lo": 8887.949999999999,
      "hi": 8887.949999999999,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 10575.690000000015,
      "lo": 10575.690000000015,
      "hi": 10575.690000000015,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.0010612580729166667,
      "lo": 0.0010612580729166667,
      "hi": 0.0010612580729166667,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 5167,
      "lo": 5167,
      "hi": 5167,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 8796.599999999999,
      "lo": 8796.599999999999,
      "hi": 8796.599999999999,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 9626.559999999994,
      "lo": 9626.559999999994,
      "hi": 9626.559999999994,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.0011344173913043476,
      "lo": 0.0011344173913043476,
      "hi": 0.0011344173913043476,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 4057,
      "lo": 4057,
      "hi": 4057,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 8907,
      "lo": 8907,
      "hi": 8907,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 10350.600000000002,
      "lo": 10350.600000000002,
      "hi": 10350.600000000002,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.0010724015452538635,
      "lo": 0.0010724015452538635,
      "hi": 0.0010724015452538635,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "self",
      "value": 4020,
      "lo": 4020,
      "hi": 4020,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "self",
      "value": 7186.349999999999,
      "lo": 7186.349999999999,
      "hi": 7186.349999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "self",
      "value": 7469.27,
      "lo": 7469.27,
      "hi": 7469.27,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0.0009843416666666667,
      "lo": 0.0009843416666666667,
      "hi": 0.0009843416666666667,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 4661.5,
      "lo": 4661.5,
      "hi": 4661.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 7147.75,
      "lo": 7147.75,
      "hi": 7147.75,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 7347.950000000001,
      "lo": 7347.950000000001,
      "hi": 7347.950000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0.0010918416666666666,
      "lo": 0.0010918416666666666,
      "hi": 0.0010918416666666666,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "self",
      "value": 6057,
      "lo": 6057,
      "hi": 6057,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "self",
      "value": 10164.6,
      "lo": 10164.6,
      "hi": 10164.6,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "self",
      "value": 11787.059999999998,
      "lo": 11787.059999999998,
      "hi": 11787.059999999998,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0.001227637037037037,
      "lo": 0.001227637037037037,
      "hi": 0.001227637037037037,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "self",
      "value": 3939,
      "lo": 3939,
      "hi": 3939,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "self",
      "value": 8880.9,
      "lo": 8880.9,
      "hi": 8880.9,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "self",
      "value": 10546.979999999987,
      "lo": 10546.979999999987,
      "hi": 10546.979999999987,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.0010664630490956075,
      "lo": 0.0010664630490956075,
      "hi": 0.0010664630490956075,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "self",
      "value": 4107,
      "lo": 4107,
      "hi": 4107,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "self",
      "value": 6431.95,
      "lo": 6431.95,
      "hi": 6431.95,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "self",
      "value": 6718.39,
      "lo": 6718.39,
      "hi": 6718.39,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0.001070075,
      "lo": 0.001070075,
      "hi": 0.001070075,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "self",
      "value": 4745.5,
      "lo": 4745.5,
      "hi": 4745.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "self",
      "value": 8181.0499999999965,
      "lo": 8181.0499999999965,
      "hi": 8181.0499999999965,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "self",
      "value": 9831.409999999996,
      "lo": 9831.409999999996,
      "hi": 9831.409999999996,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0.0010990777777777775,
      "lo": 0.0010990777777777775,
      "hi": 0.0010990777777777775,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 3706.5,
      "lo": 3706.5,
      "hi": 3706.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 7810.55,
      "lo": 7810.55,
      "hi": 7810.55,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 8056.47,
      "lo": 8056.47,
      "hi": 8056.47,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0.0010202375,
      "lo": 0.0010202375,
      "hi": 0.0010202375,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "self",
      "value": 6430,
      "lo": 6430,
      "hi": 6430,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "self",
      "value": 8777.4,
      "lo": 8777.4,
      "hi": 8777.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "self",
      "value": 9224.279999999999,
      "lo": 9224.279999999999,
      "hi": 9224.279999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0.0012149733333333334,
      "lo": 0.0012149733333333334,
      "hi": 0.0012149733333333334,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 5574,
      "lo": 5574,
      "hi": 5574,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 8925,
      "lo": 8925,
      "hi": 8925,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 9089,
      "lo": 9089,
      "hi": 9089,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0.001114347619047619,
      "lo": 0.001114347619047619,
      "hi": 0.001114347619047619,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 4796.5,
      "lo": 4796.5,
      "hi": 4796.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 9140.3,
      "lo": 9140.3,
      "hi": 9140.3,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 10040.479999999998,
      "lo": 10040.479999999998,
      "hi": 10040.479999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.0011334133333333332,
      "lo": 0.0011334133333333332,
      "hi": 0.0011334133333333332,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "self",
      "value": 3849,
      "lo": 3849,
      "hi": 3849,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "self",
      "value": 8866.8,
      "lo": 8866.8,
      "hi": 8866.8,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "self",
      "value": 10358.920000000002,
      "lo": 10358.920000000002,
      "hi": 10358.920000000002,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.0010590000000000005,
      "lo": 0.0010590000000000005,
      "hi": 0.0010590000000000005,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 5049,
      "lo": 5049,
      "hi": 5049,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 8414.25,
      "lo": 8414.25,
      "hi": 8414.25,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 10157.319999999987,
      "lo": 10157.319999999987,
      "hi": 10157.319999999987,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.0010857683333333331,
      "lo": 0.0010857683333333331,
      "hi": 0.0010857683333333331,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "self",
      "value": 4325,
      "lo": 4325,
      "hi": 4325,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "self",
      "value": 7690.600000000001,
      "lo": 7690.600000000001,
      "hi": 7690.600000000001,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "self",
      "value": 9600.659999999996,
      "lo": 9600.659999999996,
      "hi": 9600.659999999996,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "self",
      "value": 0.0010844717948717947,
      "lo": 0.0010844717948717947,
      "hi": 0.0010844717948717947,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 5131,
      "lo": 5131,
      "hi": 5131,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 7944.2,
      "lo": 7944.2,
      "hi": 7944.2,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 8268.04,
      "lo": 8268.04,
      "hi": 8268.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.0010714000000000001,
      "lo": 0.0010714000000000001,
      "hi": 0.0010714000000000001,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 4796.5,
      "lo": 4796.5,
      "hi": 4796.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 7186.349999999999,
      "lo": 7186.349999999999,
      "hi": 7186.349999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 7469.27,
      "lo": 7469.27,
      "hi": 7469.27,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0.0010828,
      "lo": 0.0010828,
      "hi": 0.0010828,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 4530,
      "lo": 4530,
      "hi": 4530,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 10100.4,
      "lo": 10100.4,
      "hi": 10100.4,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 11726.490000000002,
      "lo": 11726.490000000002,
      "hi": 11726.490000000002,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.0011642699999999998,
      "lo": 0.0011642699999999998,
      "hi": 0.0011642699999999998,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 6286.5,
      "lo": 6286.5,
      "hi": 6286.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 7821.2,
      "lo": 7821.2,
      "hi": 7821.2,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 7840.24,
      "lo": 7840.24,
      "hi": 7840.24,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0.0011246166666666667,
      "lo": 0.0011246166666666667,
      "hi": 0.0011246166666666667,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 5240,
      "lo": 5240,
      "hi": 5240,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 8481,
      "lo": 8481,
      "hi": 8481,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 9165,
      "lo": 9165,
      "hi": 9165,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.0010620857142857143,
      "lo": 0.0010620857142857143,
      "hi": 0.0010620857142857143,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 4144,
      "lo": 4144,
      "hi": 4144,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 8925,
      "lo": 8925,
      "hi": 8925,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 9089,
      "lo": 9089,
      "hi": 9089,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0.0011221285714285714,
      "lo": 0.0011221285714285714,
      "hi": 0.0011221285714285714,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "self",
      "value": 3834.5,
      "lo": 3834.5,
      "hi": 3834.5,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "self",
      "value": 8945.399999999994,
      "lo": 8945.399999999994,
      "hi": 8945.399999999994,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "self",
      "value": 10479.989999999994,
      "lo": 10479.989999999994,
      "hi": 10479.989999999994,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.0010556210884353743,
      "lo": 0.0010556210884353743,
      "hi": 0.0010556210884353743,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "self",
      "value": 3534,
      "lo": 3534,
      "hi": 3534,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "self",
      "value": 9784.3,
      "lo": 9784.3,
      "hi": 9784.3,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "self",
      "value": 9913.66,
      "lo": 9913.66,
      "hi": 9913.66,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0.0010133,
      "lo": 0.0010133,
      "hi": 0.0010133,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 3370,
      "lo": 3370,
      "hi": 3370,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 7047.499999999996,
      "lo": 7047.499999999996,
      "hi": 7047.499999999996,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 9139.099999999999,
      "lo": 9139.099999999999,
      "hi": 9139.099999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0.0009790933333333333,
      "lo": 0.0009790933333333333,
      "hi": 0.0009790933333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 6516,
      "lo": 6516,
      "hi": 6516,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 9045.899999999998,
      "lo": 9045.899999999998,
      "hi": 9045.899999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 10139.579999999998,
      "lo": 10139.579999999998,
      "hi": 10139.579999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0.0011774066666666665,
      "lo": 0.0011774066666666665,
      "hi": 0.0011774066666666665,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "self",
      "value": 5610,
      "lo": 5610,
      "hi": 5610,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "self",
      "value": 7657.999999999998,
      "lo": 7657.999999999998,
      "hi": 7657.999999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "self",
      "value": 8464.4,
      "lo": 8464.4,
      "hi": 8464.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0.0010566866666666666,
      "lo": 0.0010566866666666666,
      "hi": 0.0010566866666666666,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 6024,
      "lo": 6024,
      "hi": 6024,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 9444.9,
      "lo": 9444.9,
      "hi": 9444.9,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 9620.18,
      "lo": 9620.18,
      "hi": 9620.18,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0.0012159933333333332,
      "lo": 0.0012159933333333332,
      "hi": 0.0012159933333333332,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 5540,
      "lo": 5540,
      "hi": 5540,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 6804.299999999999,
      "lo": 6804.299999999999,
      "hi": 6804.299999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 6944.86,
      "lo": 6944.86,
      "hi": 6944.86,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0.0010927399999999998,
      "lo": 0.0010927399999999998,
      "hi": 0.0010927399999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9789473684210528,
      "lo": 0.9264588050529107,
      "hi": 0.9942074931355945,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9702380952380951,
      "lo": 0.9199927306857199,
      "hi": 0.9892960024298922,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8958333333333334,
      "lo": 0.6644719692766706,
      "hi": 0.9739219503002338,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9944903581267218,
      "lo": 0.9592714842947874,
      "hi": 0.999277605062941,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9366391184573003,
      "lo": 0.8784078452068059,
      "hi": 0.9679990108555893,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9341085271317829,
      "lo": 0.869176173360421,
      "hi": 0.9850187265917603,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9733333333333335,
      "lo": 0.9078851181224088,
      "hi": 0.9926563109938686,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9746376811594202,
      "lo": 0.9188345746837493,
      "hi": 0.9923925122987399,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8484848484848484,
      "lo": 0.5547884179362573,
      "hi": 0.9617825444799631,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.94,
      "lo": 0.8752318455410406,
      "hi": 0.9722138760368118,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9583333333333334,
      "lo": 0.89937106918239,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9444444444444444,
      "lo": 0.7424269921812741,
      "hi": 0.990124809021697,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9629629629629631,
      "lo": 0.7679464317540228,
      "hi": 0.9951283611657391,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9074074074074076,
      "lo": 0.6946444413925221,
      "hi": 0.9768613763768681,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.980392156862745,
      "lo": 0.7851540058719944,
      "hi": 0.9985403350018538,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.7873326750830549,
      "hi": 0.9956171774009801,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9,
      "lo": 0.6989663547715128,
      "hi": 0.9721335187862319,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9294871794871795,
      "lo": 0.858130699088146,
      "hi": 0.9878787878787879,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9753086419753089,
      "lo": 0.914372740778035,
      "hi": 0.993202412576336,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9629629629629629,
      "lo": 0.9013598216874965,
      "hi": 0.9866627472344232,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9932659932659934,
      "lo": 0.950564884217766,
      "hi": 0.9991169638095968,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9225589225589227,
      "lo": 0.8527583826420713,
      "hi": 0.960791596384782,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8958333333333334,
      "lo": 0.6644719692766706,
      "hi": 0.9739219503002338,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9166666666666667,
      "lo": 0.7198571898005176,
      "hi": 0.9792051784887997,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9341085271317829,
      "lo": 0.8690268549280178,
      "hi": 0.9850187265917603,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8666666666666666,
      "lo": 0.5589289935914743,
      "hi": 0.9708802865090735,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.965986394557823,
      "lo": 0.872644196536202,
      "hi": 0.9915762032378928,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.967741935483871,
      "lo": 0.8897953040501456,
      "hi": 0.9911086285001833,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9299533801014687,
      "hi": 1,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9476190476190476,
      "lo": 0.8684349467396532,
      "hi": 0.980230121197822,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9696969696969696,
      "lo": 0.6985052183558991,
      "hi": 0.9977426005529195,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9333333333333332,
      "lo": 0.6349338104169441,
      "hi": 0.991204429701885,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9740259740259742,
      "lo": 0.910154172202469,
      "hi": 0.9928478401921069,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9603174603174602,
      "lo": 0.8946704173341518,
      "hi": 0.9857035469825104,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9928315412186381,
      "lo": 0.9475043370112963,
      "hi": 0.9990599525291086,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.917562724014337,
      "lo": 0.8437726655936324,
      "hi": 0.9582254415442377,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9740259740259742,
      "lo": 0.910154172202469,
      "hi": 0.9928478401921069,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9603174603174602,
      "lo": 0.8946704173341518,
      "hi": 0.9857035469825104,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9928315412186381,
      "lo": 0.9475043370112963,
      "hi": 0.9990599525291086,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.917562724014337,
      "lo": 0.8437726655936324,
      "hi": 0.9582254415442377,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9756097560975612,
      "lo": 0.915366216089361,
      "hi": 0.9932856296688368,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9625468164794007,
      "lo": 0.9003045340085396,
      "hi": 0.9865119203983728,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9931972789115647,
      "lo": 0.9500798177936901,
      "hi": 0.9991079470522714,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9217687074829933,
      "lo": 0.8513331622995962,
      "hi": 0.9603860297066055,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9206349206349206,
      "lo": 0.8048780487804879,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.946969696969697,
      "lo": 0.8717948717948718,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9789473684210528,
      "lo": 0.9264588050529107,
      "hi": 0.9942074931355945,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9702380952380951,
      "lo": 0.9199927306857199,
      "hi": 0.9892960024298922,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8958333333333334,
      "lo": 0.6644719692766706,
      "hi": 0.9739219503002338,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9944903581267218,
      "lo": 0.9592714842947874,
      "hi": 0.999277605062941,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9366391184573003,
      "lo": 0.8784078452068059,
      "hi": 0.9679990108555893,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9341085271317829,
      "lo": 0.8666666666666667,
      "hi": 0.9848484848484849,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9759036144578315,
      "lo": 0.916336907565837,
      "hi": 0.9933668338592725,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9629629629629629,
      "lo": 0.9013598216874965,
      "hi": 0.9866627472344232,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9932659932659934,
      "lo": 0.950564884217766,
      "hi": 0.9991169638095968,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9225589225589227,
      "lo": 0.8527583826420713,
      "hi": 0.960791596384782,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8861788617886179,
      "lo": 0.7618742368742368,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9803921568627452,
      "lo": 0.7851540058719947,
      "hi": 0.9985403350018539,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9833333333333332,
      "lo": 0.812152827904405,
      "hi": 0.9987595193112027,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8666666666666666,
      "lo": 0.6588956065808023,
      "hi": 0.9562792775137967,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9534883720930233,
      "lo": 0.8536585365853658,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9717514124293786,
      "lo": 0.8928170310636412,
      "hi": 0.9930100600212537,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9675925925925924,
      "lo": 0.8975488579372277,
      "hi": 0.9902681010234919,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.93982814785791,
      "hi": 0.9999999999999998,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9506172839506173,
      "lo": 0.8797976976951905,
      "hi": 0.9806306944459662,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9833333333333332,
      "lo": 0.812152827904405,
      "hi": 0.9987595193112027,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9147286821705426,
      "lo": 0.8294526375496314,
      "hi": 0.9844961240310077,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9333333333333332,
      "lo": 0.6349338104169441,
      "hi": 0.991204429701885,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9696969696969697,
      "lo": 0.8855663253531809,
      "hi": 0.9924993735974352,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9604519774011299,
      "lo": 0.8764998377475939,
      "hi": 0.9881098379819737,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9312077638761376,
      "hi": 1,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9411764705882353,
      "lo": 0.8582831156689853,
      "hi": 0.9768892344603642,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8072530864197531,
      "lo": 0.711226851851852,
      "hi": 0.8975347222222222,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.325,
      "lo": 0.2,
      "hi": 0.65,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.525,
      "lo": 0.375,
      "hi": 0.725,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.625,
      "lo": 0.45,
      "hi": 0.7756249999999966,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.45,
      "lo": 0.3070530781090492,
      "hi": 0.6017090820106794,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.028806584362139915,
      "lo": 0.008645473225018352,
      "hi": 0.09163716695614658,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3166666666666667,
      "lo": 0.19410021267745398,
      "hi": 0.47136104109488447,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004115226337448559,
      "lo": 0.0003060448651870523,
      "hi": 0.052829834102763824,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.41666666666666663,
      "lo": 0.23174394158041686,
      "hi": 0.6284435847617196,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.26666666666666666,
      "lo": 0.12281731303990051,
      "hi": 0.48570776071808197,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9166666666666666,
      "lo": 0.7777777777777778,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.75,
      "lo": 0.5,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.75,
      "lo": 0.5,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.75,
      "lo": 0.5,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5555555555555556,
      "lo": 0.29701927644834236,
      "hi": 0.7871480561455197,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4166666666666667,
      "lo": 0.19326031365875665,
      "hi": 0.6804886874504503,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7997987927565392,
      "lo": 0.6858651911468813,
      "hi": 0.9016662474849094,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.25,
      "lo": 0.10714285714285714,
      "hi": 0.6071428571428571,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4642857142857143,
      "lo": 0.2857142857142857,
      "hi": 0.6794642857142809,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5714285714285714,
      "lo": 0.35714285714285715,
      "hi": 0.7857142857142857,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4047619047619047,
      "lo": 0.24537584611270286,
      "hi": 0.5871276405093628,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.03286384976525821,
      "lo": 0.009869707069144487,
      "hi": 0.10381227643874835,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.2738095238095238,
      "lo": 0.1438302442463069,
      "hi": 0.45836553648109934,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004694835680751174,
      "lo": 0.0003491627506430964,
      "hi": 0.059886508204961886,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7929411764705883,
      "lo": 0.6685147058823531,
      "hi": 0.9094117647058824,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.28,
      "lo": 0.12,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.48,
      "lo": 0.28,
      "hi": 0.72,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.52,
      "lo": 0.32,
      "hi": 0.8,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4133333333333333,
      "lo": 0.24479087838437172,
      "hi": 0.6049624451117298,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.034313725490196074,
      "lo": 0.010307588219642616,
      "hi": 0.1081215977549329,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.28,
      "lo": 0.14283853850956563,
      "hi": 0.47576605190361576,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7929411764705883,
      "lo": 0.6685220588235294,
      "hi": 0.9029485294117646,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.28,
      "lo": 0.12,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.48,
      "lo": 0.28,
      "hi": 0.72,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.52,
      "lo": 0.32,
      "hi": 0.8,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4133333333333333,
      "lo": 0.24479087838437172,
      "hi": 0.6049624451117298,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.034313725490196074,
      "lo": 0.010307588219642616,
      "hi": 0.1081215977549329,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.28,
      "lo": 0.14283853850956563,
      "hi": 0.47576605190361576,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7845588235294118,
      "lo": 0.6646813725490196,
      "hi": 0.894859068627451,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3,
      "lo": 0.16666666666666666,
      "hi": 0.6,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666667,
      "lo": 0.3,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5333333333333333,
      "lo": 0.3333333333333333,
      "hi": 0.7666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.41111111111111115,
      "lo": 0.25511909619678397,
      "hi": 0.5872832848119216,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.034313725490196074,
      "lo": 0.010307588219642616,
      "hi": 0.1081215977549329,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.27777777777777773,
      "lo": 0.15000278257116084,
      "hi": 0.45600316995060286,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8923076923076924,
      "lo": 0.7230769230769231,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5666666666666667,
      "lo": 0.28645461820349444,
      "hi": 0.8098743418147871,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4333333333333333,
      "lo": 0.19012565818521288,
      "hi": 0.7135453817965055,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8072530864197531,
      "lo": 0.7053780864197532,
      "hi": 0.8885879629629629,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.325,
      "lo": 0.2,
      "hi": 0.625,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.525,
      "lo": 0.375,
      "hi": 0.725,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.625,
      "lo": 0.45,
      "hi": 0.8,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.45,
      "lo": 0.3070530781090492,
      "hi": 0.6017090820106794,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.028806584362139915,
      "lo": 0.008645473225018352,
      "hi": 0.09163716695614658,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3166666666666667,
      "lo": 0.19410021267745398,
      "hi": 0.47136104109488447,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004115226337448559,
      "lo": 0.0003060448651870523,
      "hi": 0.052829834102763824,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7577294685990338,
      "lo": 0.6376751207729469,
      "hi": 0.8647342995169082,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.26666666666666666,
      "lo": 0.13333333333333333,
      "hi": 0.5666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.43333333333333335,
      "lo": 0.23333333333333334,
      "hi": 0.6333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.3,
      "hi": 0.7333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3777777777777777,
      "lo": 0.22771525183142033,
      "hi": 0.5555880220555496,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.033816425120772944,
      "lo": 0.010157373471400818,
      "hi": 0.10664596387394693,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.26666666666666666,
      "lo": 0.14182663319596317,
      "hi": 0.4444796169518888,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004830917874396135,
      "lo": 0.00035928654494127993,
      "hi": 0.061530268666438445,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4333333333333333,
      "lo": 0.19012565818521288,
      "hi": 0.7135453817965055,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.29999999999999993,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.034313725490196074,
      "lo": 0.010307588219642616,
      "hi": 0.1081215977549329,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.21880653237281705,
      "hi": 0.6134184992377469,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.31666666666666665,
      "lo": 0.15716056329227926,
      "hi": 0.5352519946604213,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2992980081982123,
      "hi": 0.7007019918017877,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.31666666666666665,
      "lo": 0.15716056329227926,
      "hi": 0.5352519946604213,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.028806584362139915,
      "lo": 0.008645473225018352,
      "hi": 0.09163716695614658,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.004115226337448559,
      "lo": 0.0003060448651870523,
      "hi": 0.052829834102763824,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8049382716049382,
      "lo": 0.6607947530864198,
      "hi": 0.9213194444444444,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.2,
      "hi": 0.7,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.55,
      "lo": 0.35,
      "hi": 0.8,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6,
      "lo": 0.4,
      "hi": 0.8,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4833333333333333,
      "lo": 0.2854103181114389,
      "hi": 0.6866271871569883,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3666666666666667,
      "lo": 0.19352634117963502,
      "hi": 0.5827737009677836,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7882716049382716,
      "lo": 0.5876388888888889,
      "hi": 0.9450771604938271,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.2,
      "lo": 0,
      "hi": 0.7,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.16818032970623614,
      "hi": 0.6873262302663417,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.2333333333333333,
      "lo": 0.07255530696407597,
      "hi": 0.5421288529627982,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8308641975308642,
      "lo": 0.6425925925925926,
      "hi": 0.9740895061728394,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3,
      "lo": 0.1,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4333333333333333,
      "lo": 0.19012565818521288,
      "hi": 0.7135453817965055,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.29999999999999993,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6548821548821548,
      "lo": 0.512044051627385,
      "hi": 0.7912457912457912,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.045454545454545456,
      "lo": 0,
      "hi": 0.3181818181818182,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.18181818181818182,
      "lo": 0.045454545454545456,
      "hi": 0.45454545454545453,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3181818181818182,
      "lo": 0.09090909090909091,
      "hi": 0.5454545454545454,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.1212121212121212,
      "lo": 0.03966091229297783,
      "hi": 0.31538065938021975,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9934842249657064,
      "lo": 0.9797582304526748,
      "hi": 1,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6666666666666666,
      "lo": 0.4444444444444444,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9444444444444444,
      "lo": 0.8333333333333334,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9444444444444444,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.851851851851852,
      "lo": 0.6286440113397697,
      "hi": 0.9512928312792491,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6481481481481481,
      "lo": 0.42013019947040564,
      "hi": 0.824053734263918,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9256198347107438,
      "lo": 0.8646691146497353,
      "hi": 0.9603773160230725,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9834710743801653,
      "lo": 0.9417332575142658,
      "hi": 0.9954554064538752,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.1015702479338843,
      "lo": 0.07696418732782374,
      "hi": 0.14080440771349856,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1034.8148148148148,
      "lo": 621.7083333333335,
      "hi": 1586.5046296296284,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 752.5925925925926,
      "lo": 575,
      "hi": 949.4444444444445,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:claude-haiku-5.5",
      "value": 544.2222222222222,
      "lo": 138.2013888888889,
      "hi": 1109.9999999999998,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:claude-haiku-5.5",
      "value": 138.2222222222222,
      "lo": 59.166666666666664,
      "hi": 292.1666666666667,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:claude-haiku-5.5",
      "value": 3215.22633744856,
      "lo": 2390.843621399177,
      "hi": 4105.066872427983,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:claude-haiku-5.5",
      "value": 3483.1275720164613,
      "lo": 2816.4609053497948,
      "hi": 4125,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "diy:claude-haiku-5.5",
      "value": 660.8148148148148,
      "lo": 269.1925925925927,
      "hi": 1209.5555555555554,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "diy:claude-haiku-5.5",
      "value": 287.9259259259259,
      "lo": 184,
      "hi": 450.4444444444444,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1485.814814814815,
      "lo": 987.7379629629628,
      "hi": 2089.539814814814,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1312.925925925926,
      "lo": 1061.6666666666665,
      "hi": 1601.092592592593,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "diy:claude-haiku-5.5",
      "value": 778.1481481481482,
      "lo": 539.4444444444445,
      "hi": 1059.3935185185176,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "diy:claude-haiku-5.5",
      "value": 715.925925925926,
      "lo": 574.9814814814815,
      "hi": 856.8518518518517,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "diy:claude-haiku-5.5",
      "value": 2631.8518518518513,
      "lo": 930.7407407407406,
      "hi": 5011.11111111111,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "diy:claude-haiku-5.5",
      "value": 980.7407407407406,
      "lo": 591.6666666666667,
      "hi": 1650.5555555555557,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:claude-haiku-5.5",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:claude-haiku-5.5",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "diy:claude-haiku-5.5",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3666666666666667,
      "lo": 0.19352634117963502,
      "hi": 0.5827737009677836,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 8565,
      "lo": 8565,
      "hi": 8565,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 13551.4,
      "lo": 13551.4,
      "hi": 13551.4,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 16298.280000000002,
      "lo": 16298.280000000002,
      "hi": 16298.280000000002,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010066582229580569,
      "lo": 0.0010066582229580569,
      "hi": 0.0010066582229580569,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010066582229580569,
      "lo": 0.0010066582229580569,
      "hi": 0.0010066582229580569,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 8234.5,
      "lo": 8234.5,
      "hi": 8234.5,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 12548.199999999995,
      "lo": 12548.199999999995,
      "hi": 12548.199999999995,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 15099.340000000007,
      "lo": 15099.340000000007,
      "hi": 15099.340000000007,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009711484871794863,
      "lo": 0.0009711484871794863,
      "hi": 0.0009711484871794863,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009711484871794863,
      "lo": 0.0009711484871794863,
      "hi": 0.0009711484871794863,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 10637,
      "lo": 10637,
      "hi": 10637,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 15341.799999999996,
      "lo": 15341.799999999996,
      "hi": 15341.799999999996,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 16228.38,
      "lo": 16228.38,
      "hi": 16228.38,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012152174074074073,
      "lo": 0.0012152174074074073,
      "hi": 0.0012152174074074073,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012152174074074073,
      "lo": 0.0012152174074074073,
      "hi": 0.0012152174074074073,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 10426,
      "lo": 10426,
      "hi": 10426,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 13083,
      "lo": 13083,
      "hi": 13083,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 14236.6,
      "lo": 14236.6,
      "hi": 14236.6,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012193369047619044,
      "lo": 0.0012193369047619044,
      "hi": 0.0012193369047619044,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012193369047619044,
      "lo": 0.0012193369047619044,
      "hi": 0.0012193369047619044,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 9839,
      "lo": 9839,
      "hi": 9839,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 15093.399999999998,
      "lo": 15093.399999999998,
      "hi": 15093.399999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 16225.14,
      "lo": 16225.14,
      "hi": 16225.14,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010838899166666668,
      "lo": 0.0010838899166666668,
      "hi": 0.0010838899166666668,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010838899166666668,
      "lo": 0.0010838899166666668,
      "hi": 0.0010838899166666668,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 9005,
      "lo": 9005,
      "hi": 9005,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 14632.099999999999,
      "lo": 14632.099999999999,
      "hi": 14632.099999999999,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 15267.480000000005,
      "lo": 15267.480000000005,
      "hi": 15267.480000000005,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010460629333333335,
      "lo": 0.0010460629333333335,
      "hi": 0.0010460629333333335,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010460629333333335,
      "lo": 0.0010460629333333335,
      "hi": 0.0010460629333333335,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 8468.5,
      "lo": 8468.5,
      "hi": 8468.5,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 13134.350000000004,
      "lo": 13134.350000000004,
      "hi": 13134.350000000004,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 16225.140000000001,
      "lo": 16225.140000000001,
      "hi": 16225.140000000001,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009938560138888876,
      "lo": 0.0009938560138888876,
      "hi": 0.0009938560138888876,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009938560138888876,
      "lo": 0.0009938560138888876,
      "hi": 0.0009938560138888876,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 8126,
      "lo": 8126,
      "hi": 8126,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10304.8,
      "lo": 10304.8,
      "hi": 10304.8,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10716.96,
      "lo": 10716.96,
      "hi": 10716.96,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009434893333333333,
      "lo": 0.0009434893333333333,
      "hi": 0.0009434893333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009434893333333333,
      "lo": 0.0009434893333333333,
      "hi": 0.0009434893333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 9542,
      "lo": 9542,
      "hi": 9542,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 13155.099999999997,
      "lo": 13155.099999999997,
      "hi": 13155.099999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 15402.179999999997,
      "lo": 15402.179999999997,
      "hi": 15402.179999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010882252499999996,
      "lo": 0.0010882252499999996,
      "hi": 0.0010882252499999996,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010882252499999996,
      "lo": 0.0010882252499999996,
      "hi": 0.0010882252499999996,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 7888,
      "lo": 7888,
      "hi": 7888,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 11347.699999999999,
      "lo": 11347.699999999999,
      "hi": 11347.699999999999,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 11958.33,
      "lo": 11958.33,
      "hi": 11958.33,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008847709999999997,
      "lo": 0.0008847709999999997,
      "hi": 0.0008847709999999997,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008847709999999997,
      "lo": 0.0008847709999999997,
      "hi": 0.0008847709999999997,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 8141,
      "lo": 8141,
      "hi": 8141,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 11510,
      "lo": 11510,
      "hi": 11510,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 13620.779999999999,
      "lo": 13620.779999999999,
      "hi": 13620.779999999999,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009425091111111109,
      "lo": 0.0009425091111111109,
      "hi": 0.0009425091111111109,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009425091111111109,
      "lo": 0.0009425091111111109,
      "hi": 0.0009425091111111109,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 8267.5,
      "lo": 8267.5,
      "hi": 8267.5,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 13956.749999999998,
      "lo": 13956.749999999998,
      "hi": 13956.749999999998,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 18092.299999999996,
      "lo": 18092.299999999996,
      "hi": 18092.299999999996,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001001079976190475,
      "lo": 0.001001079976190475,
      "hi": 0.001001079976190475,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001001079976190475,
      "lo": 0.001001079976190475,
      "hi": 0.001001079976190475,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 8282,
      "lo": 8282,
      "hi": 8282,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 11066.199999999999,
      "lo": 11066.199999999999,
      "hi": 11066.199999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 11654.8,
      "lo": 11654.8,
      "hi": 11654.8,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009283833333333334,
      "lo": 0.0009283833333333334,
      "hi": 0.0009283833333333334,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009283833333333334,
      "lo": 0.0009283833333333334,
      "hi": 0.0009283833333333334,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 11441,
      "lo": 11441,
      "hi": 11441,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 16057.65,
      "lo": 16057.65,
      "hi": 16057.65,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 16241.34,
      "lo": 16241.34,
      "hi": 16241.34,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012830088333333329,
      "lo": 0.0012830088333333329,
      "hi": 0.0012830088333333329,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012830088333333329,
      "lo": 0.0012830088333333329,
      "hi": 0.0012830088333333329,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 6892.5,
      "lo": 6892.5,
      "hi": 6892.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 9293.449999999999,
      "lo": 9293.449999999999,
      "hi": 9293.449999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 9601.890000000001,
      "lo": 9601.890000000001,
      "hi": 9601.890000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007888933333333334,
      "lo": 0.0007888933333333334,
      "hi": 0.0007888933333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007888933333333334,
      "lo": 0.0007888933333333334,
      "hi": 0.0007888933333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 8529,
      "lo": 8529,
      "hi": 8529,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 12981.599999999988,
      "lo": 12981.599999999988,
      "hi": 12981.599999999988,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 16220.279999999999,
      "lo": 16220.279999999999,
      "hi": 16220.279999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009959269105691048,
      "lo": 0.0009959269105691048,
      "hi": 0.0009959269105691048,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009959269105691048,
      "lo": 0.0009959269105691048,
      "hi": 0.0009959269105691048,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 6892.5,
      "lo": 6892.5,
      "hi": 6892.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 9293.449999999999,
      "lo": 9293.449999999999,
      "hi": 9293.449999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 9601.890000000001,
      "lo": 9601.890000000001,
      "hi": 9601.890000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007888933333333334,
      "lo": 0.0007888933333333334,
      "hi": 0.0007888933333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007888933333333334,
      "lo": 0.0007888933333333334,
      "hi": 0.0007888933333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 8529,
      "lo": 8529,
      "hi": 8529,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 12981.599999999988,
      "lo": 12981.599999999988,
      "hi": 12981.599999999988,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 16220.279999999999,
      "lo": 16220.279999999999,
      "hi": 16220.279999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009959269105691048,
      "lo": 0.0009959269105691048,
      "hi": 0.0009959269105691048,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009959269105691048,
      "lo": 0.0009959269105691048,
      "hi": 0.0009959269105691048,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 8492,
      "lo": 8492,
      "hi": 8492,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 12767.399999999998,
      "lo": 12767.399999999998,
      "hi": 12767.399999999998,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 16212.18,
      "lo": 16212.18,
      "hi": 16212.18,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009922369661458325,
      "lo": 0.0009922369661458325,
      "hi": 0.0009922369661458325,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009922369661458325,
      "lo": 0.0009922369661458325,
      "hi": 0.0009922369661458325,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 9186,
      "lo": 9186,
      "hi": 9186,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 14978.4,
      "lo": 14978.4,
      "hi": 14978.4,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 16369.88,
      "lo": 16369.88,
      "hi": 16369.88,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001086915652173913,
      "lo": 0.001086915652173913,
      "hi": 0.001086915652173913,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001086915652173913,
      "lo": 0.001086915652173913,
      "hi": 0.001086915652173913,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 8565,
      "lo": 8565,
      "hi": 8565,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 13551.4,
      "lo": 13551.4,
      "hi": 13551.4,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 16298.280000000002,
      "lo": 16298.280000000002,
      "hi": 16298.280000000002,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010066582229580569,
      "lo": 0.0010066582229580569,
      "hi": 0.0010066582229580569,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010066582229580569,
      "lo": 0.0010066582229580569,
      "hi": 0.0010066582229580569,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 7285,
      "lo": 7285,
      "hi": 7285,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 12786.849999999999,
      "lo": 12786.849999999999,
      "hi": 12786.849999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 13329.37,
      "lo": 13329.37,
      "hi": 13329.37,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000994125,
      "lo": 0.000994125,
      "hi": 0.000994125,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000994125,
      "lo": 0.000994125,
      "hi": 0.000994125,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 7953.5,
      "lo": 7953.5,
      "hi": 7953.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 11643.3,
      "lo": 11643.3,
      "hi": 11643.3,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 11843.06,
      "lo": 11843.06,
      "hi": 11843.06,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.00090359375,
      "lo": 0.00090359375,
      "hi": 0.00090359375,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.00090359375,
      "lo": 0.00090359375,
      "hi": 0.00090359375,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 10823,
      "lo": 10823,
      "hi": 10823,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 16106.1,
      "lo": 16106.1,
      "hi": 16106.1,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 16242.96,
      "lo": 16242.96,
      "hi": 16242.96,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012213061111111109,
      "lo": 0.0012213061111111109,
      "hi": 0.0012213061111111109,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012213061111111109,
      "lo": 0.0012213061111111109,
      "hi": 0.0012213061111111109,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 8461,
      "lo": 8461,
      "hi": 8461,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 12760.8,
      "lo": 12760.8,
      "hi": 12760.8,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 16210.56,
      "lo": 16210.56,
      "hi": 16210.56,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009913806201550376,
      "lo": 0.0009913806201550376,
      "hi": 0.0009913806201550376,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009913806201550376,
      "lo": 0.0009913806201550376,
      "hi": 0.0009913806201550376,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 6892.5,
      "lo": 6892.5,
      "hi": 6892.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 9293.449999999999,
      "lo": 9293.449999999999,
      "hi": 9293.449999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 9601.890000000001,
      "lo": 9601.890000000001,
      "hi": 9601.890000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007888933333333334,
      "lo": 0.0007888933333333334,
      "hi": 0.0007888933333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007888933333333334,
      "lo": 0.0007888933333333334,
      "hi": 0.0007888933333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 10374.5,
      "lo": 10374.5,
      "hi": 10374.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 14883.95,
      "lo": 14883.95,
      "hi": 14883.95,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 14892.79,
      "lo": 14892.79,
      "hi": 14892.79,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011304083333333334,
      "lo": 0.0011304083333333334,
      "hi": 0.0011304083333333334,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011304083333333334,
      "lo": 0.0011304083333333334,
      "hi": 0.0011304083333333334,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 9332,
      "lo": 9332,
      "hi": 9332,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 11922.949999999997,
      "lo": 11922.949999999997,
      "hi": 11922.949999999997,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 12342.49,
      "lo": 12342.49,
      "hi": 12342.49,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009783739583333333,
      "lo": 0.0009783739583333333,
      "hi": 0.0009783739583333333,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009783739583333333,
      "lo": 0.0009783739583333333,
      "hi": 0.0009783739583333333,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 8565,
      "lo": 8565,
      "hi": 8565,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 15303.4,
      "lo": 15303.4,
      "hi": 15303.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 15806.279999999999,
      "lo": 15806.279999999999,
      "hi": 15806.279999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010804309999999998,
      "lo": 0.0010804309999999998,
      "hi": 0.0010804309999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010804309999999998,
      "lo": 0.0010804309999999998,
      "hi": 0.0010804309999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 10426,
      "lo": 10426,
      "hi": 10426,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 13083,
      "lo": 13083,
      "hi": 13083,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 14236.6,
      "lo": 14236.6,
      "hi": 14236.6,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012193369047619044,
      "lo": 0.0012193369047619044,
      "hi": 0.0012193369047619044,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012193369047619044,
      "lo": 0.0012193369047619044,
      "hi": 0.0012193369047619044,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 9978,
      "lo": 9978,
      "hi": 9978,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 15093.399999999998,
      "lo": 15093.399999999998,
      "hi": 15093.399999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 16065.249999999998,
      "lo": 16065.249999999998,
      "hi": 16065.249999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011055807500000004,
      "lo": 0.0011055807500000004,
      "hi": 0.0011055807500000004,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011055807500000004,
      "lo": 0.0011055807500000004,
      "hi": 0.0011055807500000004,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 8228,
      "lo": 8228,
      "hi": 8228,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 12912.399999999992,
      "lo": 12912.399999999992,
      "hi": 12912.399999999992,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 16400.12,
      "lo": 16400.12,
      "hi": 16400.12,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009780458408408402,
      "lo": 0.0009780458408408402,
      "hi": 0.0009780458408408402,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009780458408408402,
      "lo": 0.0009780458408408402,
      "hi": 0.0009780458408408402,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 9147,
      "lo": 9147,
      "hi": 9147,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 13099.199999999999,
      "lo": 13099.199999999999,
      "hi": 13099.199999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 14842.459999999992,
      "lo": 14842.459999999992,
      "hi": 14842.459999999992,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010665344166666667,
      "lo": 0.0010665344166666667,
      "hi": 0.0010665344166666667,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010665344166666667,
      "lo": 0.0010665344166666667,
      "hi": 0.0010665344166666667,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 8603,
      "lo": 8603,
      "hi": 8603,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 15039.800000000003,
      "lo": 15039.800000000003,
      "hi": 15039.800000000003,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 16395.079999999998,
      "lo": 16395.079999999998,
      "hi": 16395.079999999998,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001055288974358974,
      "lo": 0.001055288974358974,
      "hi": 0.001055288974358974,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001055288974358974,
      "lo": 0.001055288974358974,
      "hi": 0.001055288974358974,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 7888,
      "lo": 7888,
      "hi": 7888,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 10649.75,
      "lo": 10649.75,
      "hi": 10649.75,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 10788.35,
      "lo": 10788.35,
      "hi": 10788.35,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008111379166666666,
      "lo": 0.0008111379166666666,
      "hi": 0.0008111379166666666,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008111379166666666,
      "lo": 0.0008111379166666666,
      "hi": 0.0008111379166666666,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 6552.5,
      "lo": 6552.5,
      "hi": 6552.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 10759.15,
      "lo": 10759.15,
      "hi": 10759.15,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 10920.630000000001,
      "lo": 10920.630000000001,
      "hi": 10920.630000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008140895833333332,
      "lo": 0.0008140895833333332,
      "hi": 0.0008140895833333332,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008140895833333332,
      "lo": 0.0008140895833333332,
      "hi": 0.0008140895833333332,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 11441,
      "lo": 11441,
      "hi": 11441,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 16057.65,
      "lo": 16057.65,
      "hi": 16057.65,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 16241.34,
      "lo": 16241.34,
      "hi": 16241.34,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012830088333333329,
      "lo": 0.0012830088333333329,
      "hi": 0.0012830088333333329,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012830088333333329,
      "lo": 0.0012830088333333329,
      "hi": 0.0012830088333333329,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 9829.5,
      "lo": 9829.5,
      "hi": 9829.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 12590.849999999999,
      "lo": 12590.849999999999,
      "hi": 12590.849999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 12984.57,
      "lo": 12984.57,
      "hi": 12984.57,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011242405555555554,
      "lo": 0.0011242405555555554,
      "hi": 0.0011242405555555554,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011242405555555554,
      "lo": 0.0011242405555555554,
      "hi": 0.0011242405555555554,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 9603,
      "lo": 9603,
      "hi": 9603,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 15034,
      "lo": 15034,
      "hi": 15034,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 15752.400000000001,
      "lo": 15752.400000000001,
      "hi": 15752.400000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011236916666666665,
      "lo": 0.0011236916666666665,
      "hi": 0.0011236916666666665,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011236916666666665,
      "lo": 0.0011236916666666665,
      "hi": 0.0011236916666666665,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 8652,
      "lo": 8652,
      "hi": 8652,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 11016,
      "lo": 11016,
      "hi": 11016,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 13823.200000000003,
      "lo": 13823.200000000003,
      "hi": 13823.200000000003,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010218885714285712,
      "lo": 0.0010218885714285712,
      "hi": 0.0010218885714285712,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010218885714285712,
      "lo": 0.0010218885714285712,
      "hi": 0.0010218885714285712,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 8208.5,
      "lo": 8208.5,
      "hi": 8208.5,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 12205.949999999999,
      "lo": 12205.949999999999,
      "hi": 12205.949999999999,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 15812.029999999982,
      "lo": 15812.029999999982,
      "hi": 15812.029999999982,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009677993027210883,
      "lo": 0.0009677993027210883,
      "hi": 0.0009677993027210883,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009677993027210883,
      "lo": 0.0009677993027210883,
      "hi": 0.0009677993027210883,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 9005,
      "lo": 9005,
      "hi": 9005,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 13772.4,
      "lo": 13772.4,
      "hi": 13772.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 14219.279999999999,
      "lo": 14219.279999999999,
      "hi": 14219.279999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010320666666666666,
      "lo": 0.0010320666666666666,
      "hi": 0.0010320666666666666,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010320666666666666,
      "lo": 0.0010320666666666666,
      "hi": 0.0010320666666666666,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 7868,
      "lo": 7868,
      "hi": 7868,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 10875.8,
      "lo": 10875.8,
      "hi": 10875.8,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 10946.36,
      "lo": 10946.36,
      "hi": 10946.36,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009047889999999999,
      "lo": 0.0009047889999999999,
      "hi": 0.0009047889999999999,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009047889999999999,
      "lo": 0.0009047889999999999,
      "hi": 0.0009047889999999999,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 9684,
      "lo": 9684,
      "hi": 9684,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 11079.199999999999,
      "lo": 11079.199999999999,
      "hi": 11079.199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 11344.64,
      "lo": 11344.64,
      "hi": 11344.64,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009472559999999999,
      "lo": 0.0009472559999999999,
      "hi": 0.0009472559999999999,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009472559999999999,
      "lo": 0.0009472559999999999,
      "hi": 0.0009472559999999999,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 7188,
      "lo": 7188,
      "hi": 7188,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 10356.899999999998,
      "lo": 10356.899999999998,
      "hi": 10356.899999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 11344.179999999998,
      "lo": 11344.179999999998,
      "hi": 11344.179999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000807193,
      "lo": 0.000807193,
      "hi": 0.000807193,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000807193,
      "lo": 0.000807193,
      "hi": 0.000807193,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 8411,
      "lo": 8411,
      "hi": 8411,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 11750.099999999999,
      "lo": 11750.099999999999,
      "hi": 11750.099999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 12426.019999999999,
      "lo": 12426.019999999999,
      "hi": 12426.019999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010202606666666666,
      "lo": 0.0010202606666666666,
      "hi": 0.0010202606666666666,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010202606666666666,
      "lo": 0.0010202606666666666,
      "hi": 0.0010202606666666666,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 8126,
      "lo": 8126,
      "hi": 8126,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10304.8,
      "lo": 10304.8,
      "hi": 10304.8,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10716.96,
      "lo": 10716.96,
      "hi": 10716.96,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009434893333333333,
      "lo": 0.0009434893333333333,
      "hi": 0.0009434893333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009434893333333333,
      "lo": 0.0009434893333333333,
      "hi": 0.0009434893333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9824561403508771,
      "lo": 0.9317452345909818,
      "hi": 0.9956658716428599,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9910714285714286,
      "lo": 0.9511515316911152,
      "hi": 0.9984221452967079,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8541666666666667,
      "lo": 0.61583659599594,
      "hi": 0.955357963625501,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9807162534435262,
      "lo": 0.9376270285245951,
      "hi": 0.9942215290961489,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9393939393939396,
      "lo": 0.8818885986835527,
      "hi": 0.9698583637262395,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9108527131782945,
      "lo": 0.8333333333333334,
      "hi": 0.9767441860465116,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9777777777777777,
      "lo": 0.9144909766147252,
      "hi": 0.9945062405683717,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9891304347826086,
      "lo": 0.9409721438693747,
      "hi": 0.9980786709599082,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.787878787878788,
      "lo": 0.4924369043258686,
      "hi": 0.9342956298440527,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9500000000000002,
      "lo": 0.8882495307680811,
      "hi": 0.978456320845632,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9464285714285714,
      "lo": 0.8690195417789758,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8703703703703703,
      "lo": 0.650030075749184,
      "hi": 0.9604297585866252,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8703703703703703,
      "lo": 0.650030075749184,
      "hi": 0.9604297585866252,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.980392156862745,
      "lo": 0.7851540058719944,
      "hi": 0.9985403350018538,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8833333333333334,
      "lo": 0.6786711249982054,
      "hi": 0.9644662538279667,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8666666666666668,
      "lo": 0.6588956065808026,
      "hi": 0.9562792775137968,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.984126984126984,
      "lo": 0.8197054744620497,
      "hi": 0.9988186500710351,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9682539682539681,
      "lo": 0.7958607110560707,
      "hi": 0.9958265569349456,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9038461538461539,
      "lo": 0.7908496732026143,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9794238683127572,
      "lo": 0.9205185013021672,
      "hi": 0.9949144455877391,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9925925925925926,
      "lo": 0.9458274191401511,
      "hi": 0.9990285941927713,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9764309764309764,
      "lo": 0.9243370119698572,
      "hi": 0.992932486295479,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9326599326599327,
      "lo": 0.8654382557577118,
      "hi": 0.9675591331263569,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8541666666666667,
      "lo": 0.61583659599594,
      "hi": 0.955357963625501,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8833333333333332,
      "lo": 0.6786711249982051,
      "hi": 0.9644662538279665,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9108527131782945,
      "lo": 0.8333333333333334,
      "hi": 0.9759177888022679,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9727891156462586,
      "lo": 0.8826896443704225,
      "hi": 0.9941471116047543,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9838709677419355,
      "lo": 0.9141327973931,
      "hi": 0.9971471328313782,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9299533801014687,
      "hi": 1,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9666666666666668,
      "lo": 0.894789949284871,
      "hi": 0.9899885257988801,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8666666666666666,
      "lo": 0.5589289935914743,
      "hi": 0.9708802865090735,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5237867002612504,
      "hi": 0.9578580998301569,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9783549783549783,
      "lo": 0.9165992056177531,
      "hi": 0.9946494004973204,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.992063492063492,
      "lo": 0.942130257640888,
      "hi": 0.9989591524907163,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9749103942652331,
      "lo": 0.9196691212682562,
      "hi": 0.9924746486524973,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.92831541218638,
      "lo": 0.8572107293621686,
      "hi": 0.9654396895474923,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9783549783549783,
      "lo": 0.9165992056177531,
      "hi": 0.9946494004973204,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.992063492063492,
      "lo": 0.942130257640888,
      "hi": 0.9989591524907163,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9749103942652331,
      "lo": 0.9196691212682562,
      "hi": 0.9924746486524973,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.92831541218638,
      "lo": 0.8572107293621686,
      "hi": 0.9654396895474923,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9796747967479674,
      "lo": 0.9214414467059509,
      "hi": 0.9949766541441967,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9925093632958801,
      "lo": 0.9452443834215531,
      "hi": 0.9990176712708276,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9761904761904763,
      "lo": 0.9235970638607018,
      "hi": 0.9928600884043643,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9319727891156464,
      "lo": 0.8641334248847691,
      "hi": 0.9672241346699696,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9047619047619048,
      "lo": 0.7617595818815334,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9855072463768115,
      "lo": 0.8331247102869502,
      "hi": 0.9989214717974179,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9710144927536232,
      "lo": 0.8110184487836904,
      "hi": 0.9961905338354728,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9166666666666666,
      "lo": 0.8249423758865249,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9824561403508771,
      "lo": 0.9317452345909818,
      "hi": 0.9956658716428599,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9910714285714286,
      "lo": 0.9511515316911152,
      "hi": 0.9984221452967079,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8541666666666667,
      "lo": 0.61583659599594,
      "hi": 0.955357963625501,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9807162534435262,
      "lo": 0.9376270285245951,
      "hi": 0.9942215290961489,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9393939393939396,
      "lo": 0.8818885986835527,
      "hi": 0.9698583637262395,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9108527131782945,
      "lo": 0.8390772310473976,
      "hi": 0.9770114942528736,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9799196787148594,
      "lo": 0.9223432070897968,
      "hi": 0.9950373591574655,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9925925925925926,
      "lo": 0.9458274191401511,
      "hi": 0.9990285941927713,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9764309764309764,
      "lo": 0.9243370119698572,
      "hi": 0.992932486295479,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9326599326599327,
      "lo": 0.8654382557577118,
      "hi": 0.9675591331263569,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8699186991869918,
      "lo": 0.7235110606920024,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9803921568627452,
      "lo": 0.7851540058719947,
      "hi": 0.9985403350018539,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8666666666666668,
      "lo": 0.6588956065808026,
      "hi": 0.9562792775137968,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9534883720930233,
      "lo": 0.8536585365853658,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9774011299435028,
      "lo": 0.9012935311709601,
      "hi": 0.9951422675915979,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9861111111111112,
      "lo": 0.9254339785252386,
      "hi": 0.9975440481170943,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.93982814785791,
      "hi": 0.9999999999999998,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9711934156378601,
      "lo": 0.9083628330438535,
      "hi": 0.9913545267749816,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9333333333333333,
      "lo": 0.7414447301258665,
      "hi": 0.9855801328950234,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8833333333333334,
      "lo": 0.6786711249982054,
      "hi": 0.9644662538279667,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8682170542635659,
      "lo": 0.7519338611248557,
      "hi": 0.9719130751045629,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9743589743589743,
      "lo": 0.7342293087215223,
      "hi": 0.9980904662244944,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9743589743589743,
      "lo": 0.7342293087215223,
      "hi": 0.9980904662244944,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8666666666666666,
      "lo": 0.5589289935914743,
      "hi": 0.9708802865090735,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5237867002612504,
      "hi": 0.9578580998301569,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9757575757575757,
      "lo": 0.8946078006966166,
      "hi": 0.9947877782404587,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9887005649717513,
      "lo": 0.9191356019930423,
      "hi": 0.9985176121248422,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9312077638761376,
      "hi": 1,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9705882352941176,
      "lo": 0.8989536863477694,
      "hi": 0.9918968204568701,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8078703703703703,
      "lo": 0.703395061728395,
      "hi": 0.8947646604938271,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.35,
      "lo": 0.225,
      "hi": 0.75,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.65,
      "lo": 0.475,
      "hi": 0.8,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.65,
      "lo": 0.5,
      "hi": 0.7756249999999966,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.38270826816366965,
      "hi": 0.678116958423178,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.525,
      "lo": 0.3749736210669248,
      "hi": 0.670645298873211,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0.1454772448676043,
      "hi": 0.5189728183535235,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.2833333333333333,
      "lo": 0.13402625504293345,
      "hi": 0.5024613134466217,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9814814814814815,
      "lo": 0.9166666666666666,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9166666666666666,
      "lo": 0.75,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9166666666666666,
      "lo": 0.75,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9166666666666666,
      "lo": 0.75,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8611111111111112,
      "lo": 0.5820496733717648,
      "hi": 0.9650379884883391,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8611111111111112,
      "lo": 0.5820496733717648,
      "hi": 0.9650379884883391,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7248490945674044,
      "lo": 0.6026031187122737,
      "hi": 0.8430897887323942,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.6785714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.6785714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.6785714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.39285714285714285,
      "lo": 0.2356568654157959,
      "hi": 0.5759095570340281,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.38095238095238093,
      "lo": 0.2260299946646406,
      "hi": 0.5645993636129416,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.69,
      "lo": 0.5491029411764706,
      "hi": 0.818845588235294,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.29333333333333333,
      "lo": 0.15243474463599363,
      "hi": 0.48928471908547977,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.28,
      "lo": 0.14283853850956563,
      "hi": 0.47576605190361576,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.69,
      "lo": 0.5464632352941177,
      "hi": 0.816485294117647,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.6,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.29333333333333333,
      "lo": 0.15243474463599363,
      "hi": 0.48928471908547977,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.28,
      "lo": 0.14283853850956563,
      "hi": 0.47576605190361576,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7416666666666667,
      "lo": 0.6141789215686275,
      "hi": 0.84953431372549,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3777777777777778,
      "lo": 0.22771525183142044,
      "hi": 0.5555880220555498,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.36666666666666664,
      "lo": 0.21873920806100708,
      "hi": 0.5448643634520511,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8078703703703703,
      "lo": 0.7124961419753086,
      "hi": 0.8919791666666667,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.35,
      "lo": 0.225,
      "hi": 0.75,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.65,
      "lo": 0.475,
      "hi": 0.8,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.65,
      "lo": 0.5,
      "hi": 0.8,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.38270826816366965,
      "hi": 0.678116958423178,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.525,
      "lo": 0.3749736210669248,
      "hi": 0.670645298873211,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.743719806763285,
      "lo": 0.6234118357487923,
      "hi": 0.8553260869565217,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.3658333333333348,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.3333333333333333,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3777777777777778,
      "lo": 0.22771525183142044,
      "hi": 0.5555880220555498,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.36666666666666664,
      "lo": 0.21873920806100708,
      "hi": 0.5448643634520511,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3333333333333333,
      "lo": 0.12697541213017843,
      "hi": 0.632202187824118,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.29999999999999993,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333334,
      "lo": 0.32763499420531206,
      "hi": 0.7282899952578334,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333334,
      "lo": 0.32763499420531206,
      "hi": 0.7282899952578334,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333334,
      "lo": 0.32763499420531206,
      "hi": 0.7282899952578334,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5166666666666667,
      "lo": 0.3133728128430117,
      "hi": 0.7145896818885611,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9555555555555556,
      "lo": 0.9006095679012346,
      "hi": 0.9987654320987654,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.55,
      "lo": 0.35,
      "hi": 0.95,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.75,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.75,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7666666666666667,
      "lo": 0.5485724655436073,
      "hi": 0.8988274501615559,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7666666666666667,
      "lo": 0.5485724655436073,
      "hi": 0.8988274501615559,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5703703703703704,
      "lo": 0.3388425925925927,
      "hi": 0.7913734567901234,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.1,
      "lo": 0,
      "hi": 0.5,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0,
      "hi": 0.6,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0,
      "hi": 0.6,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.26666666666666666,
      "lo": 0.08962557199115637,
      "hi": 0.5732230679448586,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.26666666666666666,
      "lo": 0.08962557199115637,
      "hi": 0.5732230679448586,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.75,
      "lo": 0.5635493827160494,
      "hi": 0.9173148148148147,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.2,
      "lo": 0,
      "hi": 0.7,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3333333333333333,
      "lo": 0.12697541213017843,
      "hi": 0.632202187824118,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.29999999999999993,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7337261503928171,
      "lo": 0.6110830527497195,
      "hi": 0.8602763748597082,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.2727272727272727,
      "lo": 0.13636363636363635,
      "hi": 0.6363636363636364,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2727272727272727,
      "hi": 0.6818181818181818,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2727272727272727,
      "hi": 0.6829545454545392,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.45454545454545453,
      "lo": 0.2692029418081331,
      "hi": 0.6534020467926505,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.45454545454545453,
      "lo": 0.2692029418081331,
      "hi": 0.6534020467926505,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8984910836762688,
      "lo": 0.7705761316872428,
      "hi": 0.9938271604938271,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4444444444444444,
      "lo": 0.2222222222222222,
      "hi": 0.9444444444444444,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.6666666666666666,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.6666666666666666,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.6296296296296297,
      "lo": 0.4030311553632179,
      "hi": 0.8106297866543154,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.6111111111111112,
      "lo": 0.3861904160223791,
      "hi": 0.7969475342783638,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9586776859504132,
      "lo": 0.9069051929166947,
      "hi": 0.9822225139248748,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9917355371900827,
      "lo": 0.9546693563957512,
      "hi": 0.9985396266145802,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.1182093663911845,
      "lo": 0.0782320936639116,
      "hi": 0.17038842975206597,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 674.4444444444445,
      "lo": 358.33333333333337,
      "hi": 1148.3333333333335,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 682.7777777777777,
      "lo": 358.33333333333337,
      "hi": 1206.86111111111,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:gemini-3.8-flash",
      "value": 256.33333333333337,
      "lo": 35.00000000000001,
      "hi": 683.1875,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:gemini-3.8-flash",
      "value": 257.16666666666663,
      "lo": 36.66666666666666,
      "hi": 685.6666666666666,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:gemini-3.8-flash",
      "value": 2532.7160493827164,
      "lo": 1749.9999999999998,
      "hi": 3333.333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:gemini-3.8-flash",
      "value": 2574.382716049383,
      "lo": 1791.6666666666665,
      "hi": 3375.1466049382707,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "diy:gemini-3.8-flash",
      "value": 357.1111111111111,
      "lo": 114.66666666666666,
      "hi": 794.0666666666662,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "diy:gemini-3.8-flash",
      "value": 359.77777777777777,
      "lo": 119.93333333333342,
      "hi": 791.3333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1057.111111111111,
      "lo": 636.9999999999999,
      "hi": 1593.9999999999998,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1072.2777777777776,
      "lo": 636.9999999999999,
      "hi": 1639.8791666666646,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "diy:gemini-3.8-flash",
      "value": 564.4444444444446,
      "lo": 358.33333333333326,
      "hi": 835,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "diy:gemini-3.8-flash",
      "value": 572.7777777777777,
      "lo": 358.33333333333337,
      "hi": 832.833333333333,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1358.888888888889,
      "lo": 358.33333333333326,
      "hi": 3251.874999999999,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1367.2222222222222,
      "lo": 358.33333333333337,
      "hi": 3235.2083333333326,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:gemini-3.8-flash",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:gemini-3.8-flash",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "diy:gemini-3.8-flash",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0.1454772448676043,
      "hi": 0.5189728183535235,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 6598,
      "lo": 6598,
      "hi": 6598,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 15762.6,
      "lo": 15762.6,
      "hi": 15762.6,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 22150.440000000002,
      "lo": 22150.440000000002,
      "hi": 22150.440000000002,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004423951986754967,
      "lo": 0.004423951986754967,
      "hi": 0.004423951986754967,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004423951986754967,
      "lo": 0.004423951986754967,
      "hi": 0.004423951986754967,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 6396,
      "lo": 6396,
      "hi": 6396,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 12977.09999999994,
      "lo": 12977.09999999994,
      "hi": 12977.09999999994,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 19314.840000000044,
      "lo": 19314.840000000044,
      "hi": 19314.840000000044,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004079538461538463,
      "lo": 0.004079538461538463,
      "hi": 0.004079538461538463,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004079538461538463,
      "lo": 0.004079538461538463,
      "hi": 0.004079538461538463,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 10914,
      "lo": 10914,
      "hi": 10914,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 19329.3,
      "lo": 19329.3,
      "hi": 19329.3,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 23501.909999999993,
      "lo": 23501.909999999993,
      "hi": 23501.909999999993,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006792611111111113,
      "lo": 0.006792611111111113,
      "hi": 0.006792611111111113,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006792611111111113,
      "lo": 0.006792611111111113,
      "hi": 0.006792611111111113,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 10421,
      "lo": 10421,
      "hi": 10421,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 19274,
      "lo": 19274,
      "hi": 19274,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 19966.8,
      "lo": 19966.8,
      "hi": 19966.8,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006686928571428572,
      "lo": 0.006686928571428572,
      "hi": 0.006686928571428572,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006686928571428572,
      "lo": 0.006686928571428572,
      "hi": 0.006686928571428572,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 8903,
      "lo": 8903,
      "hi": 8903,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 18169.1,
      "lo": 18169.1,
      "hi": 18169.1,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 22655.009999999973,
      "lo": 22655.009999999973,
      "hi": 22655.009999999973,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0055742,
      "lo": 0.0055742,
      "hi": 0.0055742,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0055742,
      "lo": 0.0055742,
      "hi": 0.0055742,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 9150,
      "lo": 9150,
      "hi": 9150,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 17108.8,
      "lo": 17108.8,
      "hi": 17108.8,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 17888.140000000003,
      "lo": 17888.140000000003,
      "hi": 17888.140000000003,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005463909999999999,
      "lo": 0.005463909999999999,
      "hi": 0.005463909999999999,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005463909999999999,
      "lo": 0.005463909999999999,
      "hi": 0.005463909999999999,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 6361,
      "lo": 6361,
      "hi": 6361,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 14783.000000000002,
      "lo": 14783.000000000002,
      "hi": 14783.000000000002,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 22944.170000000046,
      "lo": 22944.170000000046,
      "hi": 22944.170000000046,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00417859791666667,
      "lo": 0.00417859791666667,
      "hi": 0.00417859791666667,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00417859791666667,
      "lo": 0.00417859791666667,
      "hi": 0.00417859791666667,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 6503,
      "lo": 6503,
      "hi": 6503,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 7401.5,
      "lo": 7401.5,
      "hi": 7401.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 7432.3,
      "lo": 7432.3,
      "hi": 7432.3,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003942650000000001,
      "lo": 0.003942650000000001,
      "hi": 0.003942650000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003942650000000001,
      "lo": 0.003942650000000001,
      "hi": 0.003942650000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 10411,
      "lo": 10411,
      "hi": 10411,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 18692.55,
      "lo": 18692.55,
      "hi": 18692.55,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 19629.059999999998,
      "lo": 19629.059999999998,
      "hi": 19629.059999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0062766875,
      "lo": 0.0062766875,
      "hi": 0.0062766875,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0062766875,
      "lo": 0.0062766875,
      "hi": 0.0062766875,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 8940.5,
      "lo": 8940.5,
      "hi": 8940.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 16481.59999999999,
      "lo": 16481.59999999999,
      "hi": 16481.59999999999,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 18436.61,
      "lo": 18436.61,
      "hi": 18436.61,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005265700000000001,
      "lo": 0.005265700000000001,
      "hi": 0.005265700000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005265700000000001,
      "lo": 0.005265700000000001,
      "hi": 0.005265700000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 5743,
      "lo": 5743,
      "hi": 5743,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 8480.55,
      "lo": 8480.55,
      "hi": 8480.55,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 16532.889999999974,
      "lo": 16532.889999999974,
      "hi": 16532.889999999974,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0035639249999999995,
      "lo": 0.0035639249999999995,
      "hi": 0.0035639249999999995,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0035639249999999995,
      "lo": 0.0035639249999999995,
      "hi": 0.0035639249999999995,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 6318,
      "lo": 6318,
      "hi": 6318,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 14554.449999999984,
      "lo": 14554.449999999984,
      "hi": 14554.449999999984,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 22183.98,
      "lo": 22183.98,
      "hi": 22183.98,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004059614285714286,
      "lo": 0.004059614285714286,
      "hi": 0.004059614285714286,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004059614285714286,
      "lo": 0.004059614285714286,
      "hi": 0.004059614285714286,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 6135,
      "lo": 6135,
      "hi": 6135,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 8771.999999999996,
      "lo": 8771.999999999996,
      "hi": 8771.999999999996,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 10814.4,
      "lo": 10814.4,
      "hi": 10814.4,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003628022727272727,
      "lo": 0.003628022727272727,
      "hi": 0.003628022727272727,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003628022727272727,
      "lo": 0.003628022727272727,
      "hi": 0.003628022727272727,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 8893,
      "lo": 8893,
      "hi": 8893,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 18853.299999999996,
      "lo": 18853.299999999996,
      "hi": 18853.299999999996,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 25013.310000000005,
      "lo": 25013.310000000005,
      "hi": 25013.310000000005,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005882700000000001,
      "lo": 0.005882700000000001,
      "hi": 0.005882700000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005882700000000001,
      "lo": 0.005882700000000001,
      "hi": 0.005882700000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 8981,
      "lo": 8981,
      "hi": 8981,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 14633.949999999997,
      "lo": 14633.949999999997,
      "hi": 14633.949999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 17093.990000000005,
      "lo": 17093.990000000005,
      "hi": 17093.990000000005,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0052005625,
      "lo": 0.0052005625,
      "hi": 0.0052005625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0052005625,
      "lo": 0.0052005625,
      "hi": 0.0052005625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 6358,
      "lo": 6358,
      "hi": 6358,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 14706.999999999995,
      "lo": 14706.999999999995,
      "hi": 14706.999999999995,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 21384.159999999974,
      "lo": 21384.159999999974,
      "hi": 21384.159999999974,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004149384146341464,
      "lo": 0.004149384146341464,
      "hi": 0.004149384146341464,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004149384146341464,
      "lo": 0.004149384146341464,
      "hi": 0.004149384146341464,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 8981,
      "lo": 8981,
      "hi": 8981,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 14633.949999999997,
      "lo": 14633.949999999997,
      "hi": 14633.949999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 17093.990000000005,
      "lo": 17093.990000000005,
      "hi": 17093.990000000005,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0052005625,
      "lo": 0.0052005625,
      "hi": 0.0052005625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0052005625,
      "lo": 0.0052005625,
      "hi": 0.0052005625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 6358,
      "lo": 6358,
      "hi": 6358,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 14706.999999999995,
      "lo": 14706.999999999995,
      "hi": 14706.999999999995,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 21384.159999999974,
      "lo": 21384.159999999974,
      "hi": 21384.159999999974,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004149384146341464,
      "lo": 0.004149384146341464,
      "hi": 0.004149384146341464,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004149384146341464,
      "lo": 0.004149384146341464,
      "hi": 0.004149384146341464,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 6403.5,
      "lo": 6403.5,
      "hi": 6403.5,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 15249.499999999987,
      "lo": 15249.499999999987,
      "hi": 15249.499999999987,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 20800.96000000006,
      "lo": 20800.96000000006,
      "hi": 20800.96000000006,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004245072265625001,
      "lo": 0.004245072265625001,
      "hi": 0.004245072265625001,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004245072265625001,
      "lo": 0.004245072265625001,
      "hi": 0.004245072265625001,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 9108,
      "lo": 9108,
      "hi": 9108,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 18122.399999999998,
      "lo": 18122.399999999998,
      "hi": 18122.399999999998,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 22137.96,
      "lo": 22137.96,
      "hi": 22137.96,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005419456521739131,
      "lo": 0.005419456521739131,
      "hi": 0.005419456521739131,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005419456521739131,
      "lo": 0.005419456521739131,
      "hi": 0.005419456521739131,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 6598,
      "lo": 6598,
      "hi": 6598,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 15762.6,
      "lo": 15762.6,
      "hi": 15762.6,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 22150.440000000002,
      "lo": 22150.440000000002,
      "hi": 22150.440000000002,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004423951986754967,
      "lo": 0.004423951986754967,
      "hi": 0.004423951986754967,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004423951986754967,
      "lo": 0.004423951986754967,
      "hi": 0.004423951986754967,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 5909.5,
      "lo": 5909.5,
      "hi": 5909.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 11966.099999999997,
      "lo": 11966.099999999997,
      "hi": 11966.099999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 14077.220000000003,
      "lo": 14077.220000000003,
      "hi": 14077.220000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0041005,
      "lo": 0.0041005,
      "hi": 0.0041005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0041005,
      "lo": 0.0041005,
      "hi": 0.0041005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 6705,
      "lo": 6705,
      "hi": 6705,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 8848,
      "lo": 8848,
      "hi": 8848,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 8856.8,
      "lo": 8856.8,
      "hi": 8856.8,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037579375000000004,
      "lo": 0.0037579375000000004,
      "hi": 0.0037579375000000004,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037579375000000004,
      "lo": 0.0037579375000000004,
      "hi": 0.0037579375000000004,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 11987,
      "lo": 11987,
      "hi": 11987,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 19184.8,
      "lo": 19184.8,
      "hi": 19184.8,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 25249.13999999999,
      "lo": 25249.13999999999,
      "hi": 25249.13999999999,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.007588972222222222,
      "lo": 0.007588972222222222,
      "hi": 0.007588972222222222,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.007588972222222222,
      "lo": 0.007588972222222222,
      "hi": 0.007588972222222222,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 6411,
      "lo": 6411,
      "hi": 6411,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 14510.499999999996,
      "lo": 14510.499999999996,
      "hi": 14510.499999999996,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 20684.31999999995,
      "lo": 20684.31999999995,
      "hi": 20684.31999999995,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0042216763565891486,
      "lo": 0.0042216763565891486,
      "hi": 0.0042216763565891486,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0042216763565891486,
      "lo": 0.0042216763565891486,
      "hi": 0.0042216763565891486,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 8981,
      "lo": 8981,
      "hi": 8981,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 14633.949999999997,
      "lo": 14633.949999999997,
      "hi": 14633.949999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 17093.990000000005,
      "lo": 17093.990000000005,
      "hi": 17093.990000000005,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0052005625,
      "lo": 0.0052005625,
      "hi": 0.0052005625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0052005625,
      "lo": 0.0052005625,
      "hi": 0.0052005625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 8873,
      "lo": 8873,
      "hi": 8873,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 11987.299999999988,
      "lo": 11987.299999999988,
      "hi": 11987.299999999988,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 17115.859999999986,
      "lo": 17115.859999999986,
      "hi": 17115.859999999986,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635291666666667,
      "lo": 0.004635291666666667,
      "hi": 0.004635291666666667,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635291666666667,
      "lo": 0.004635291666666667,
      "hi": 0.004635291666666667,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 10438.5,
      "lo": 10438.5,
      "hi": 10438.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 17953.64999999999,
      "lo": 17953.64999999999,
      "hi": 17953.64999999999,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 18902.07,
      "lo": 18902.07,
      "hi": 18902.07,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0058764375000000015,
      "lo": 0.0058764375000000015,
      "hi": 0.0058764375000000015,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0058764375000000015,
      "lo": 0.0058764375000000015,
      "hi": 0.0058764375000000015,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 10049,
      "lo": 10049,
      "hi": 10049,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 17260.1,
      "lo": 17260.1,
      "hi": 17260.1,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 17521.62,
      "lo": 17521.62,
      "hi": 17521.62,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006342749999999999,
      "lo": 0.006342749999999999,
      "hi": 0.006342749999999999,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006342749999999999,
      "lo": 0.006342749999999999,
      "hi": 0.006342749999999999,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 10421,
      "lo": 10421,
      "hi": 10421,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 19274,
      "lo": 19274,
      "hi": 19274,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 19966.8,
      "lo": 19966.8,
      "hi": 19966.8,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006686928571428572,
      "lo": 0.006686928571428572,
      "hi": 0.006686928571428572,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006686928571428572,
      "lo": 0.006686928571428572,
      "hi": 0.006686928571428572,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 8926,
      "lo": 8926,
      "hi": 8926,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 18046.55,
      "lo": 18046.55,
      "hi": 18046.55,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 19629.059999999998,
      "lo": 19629.059999999998,
      "hi": 19629.059999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005818075000000002,
      "lo": 0.005818075000000002,
      "hi": 0.005818075000000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005818075000000002,
      "lo": 0.005818075000000002,
      "hi": 0.005818075000000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 6222,
      "lo": 6222,
      "hi": 6222,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 11604.599999999995,
      "lo": 11604.599999999995,
      "hi": 11604.599999999995,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 22166.04,
      "lo": 22166.04,
      "hi": 22166.04,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0038828738738738745,
      "lo": 0.0038828738738738745,
      "hi": 0.0038828738738738745,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0038828738738738745,
      "lo": 0.0038828738738738745,
      "hi": 0.0038828738738738745,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 10360.5,
      "lo": 10360.5,
      "hi": 10360.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 18692.55,
      "lo": 18692.55,
      "hi": 18692.55,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 22655.009999999973,
      "lo": 22655.009999999973,
      "hi": 22655.009999999973,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0060328125,
      "lo": 0.0060328125,
      "hi": 0.0060328125,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0060328125,
      "lo": 0.0060328125,
      "hi": 0.0060328125,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 8228,
      "lo": 8228,
      "hi": 8228,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 19170.000000000004,
      "lo": 19170.000000000004,
      "hi": 19170.000000000004,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 22161.36,
      "lo": 22161.36,
      "hi": 22161.36,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005105961538461539,
      "lo": 0.005105961538461539,
      "hi": 0.005105961538461539,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005105961538461539,
      "lo": 0.005105961538461539,
      "hi": 0.005105961538461539,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 10530,
      "lo": 10530,
      "hi": 10530,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 13329.55,
      "lo": 13329.55,
      "hi": 13329.55,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 14349.910000000002,
      "lo": 14349.910000000002,
      "hi": 14349.910000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006176,
      "lo": 0.006176,
      "hi": 0.006176,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006176,
      "lo": 0.006176,
      "hi": 0.006176,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 7308,
      "lo": 7308,
      "hi": 7308,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 18282.95,
      "lo": 18282.95,
      "hi": 18282.95,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 18542.99,
      "lo": 18542.99,
      "hi": 18542.99,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0051988124999999994,
      "lo": 0.0051988124999999994,
      "hi": 0.0051988124999999994,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0051988124999999994,
      "lo": 0.0051988124999999994,
      "hi": 0.0051988124999999994,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 8893,
      "lo": 8893,
      "hi": 8893,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 18853.299999999996,
      "lo": 18853.299999999996,
      "hi": 18853.299999999996,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 25013.310000000005,
      "lo": 25013.310000000005,
      "hi": 25013.310000000005,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005882700000000001,
      "lo": 0.005882700000000001,
      "hi": 0.005882700000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005882700000000001,
      "lo": 0.005882700000000001,
      "hi": 0.005882700000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 10701,
      "lo": 10701,
      "hi": 10701,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 17106.4,
      "lo": 17106.4,
      "hi": 17106.4,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 17117.28,
      "lo": 17117.28,
      "hi": 17117.28,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006489875,
      "lo": 0.006489875,
      "hi": 0.006489875,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006489875,
      "lo": 0.006489875,
      "hi": 0.006489875,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 10781,
      "lo": 10781,
      "hi": 10781,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 19274,
      "lo": 19274,
      "hi": 19274,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 19966.8,
      "lo": 19966.8,
      "hi": 19966.8,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006950857142857143,
      "lo": 0.006950857142857143,
      "hi": 0.006950857142857143,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006950857142857143,
      "lo": 0.006950857142857143,
      "hi": 0.006950857142857143,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 7885,
      "lo": 7885,
      "hi": 7885,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 12250,
      "lo": 12250,
      "hi": 12250,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 13529.2,
      "lo": 13529.2,
      "hi": 13529.2,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0054197857142857155,
      "lo": 0.0054197857142857155,
      "hi": 0.0054197857142857155,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0054197857142857155,
      "lo": 0.0054197857142857155,
      "hi": 0.0054197857142857155,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 6109.5,
      "lo": 6109.5,
      "hi": 6109.5,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 10305,
      "lo": 10305,
      "hi": 10305,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 16744.239999999947,
      "lo": 16744.239999999947,
      "hi": 16744.239999999947,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037206275510204096,
      "lo": 0.0037206275510204096,
      "hi": 0.0037206275510204096,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037206275510204096,
      "lo": 0.0037206275510204096,
      "hi": 0.0037206275510204096,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 6166,
      "lo": 6166,
      "hi": 6166,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 8831.599999999999,
      "lo": 8831.599999999999,
      "hi": 8831.599999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 10042.32,
      "lo": 10042.32,
      "hi": 10042.32,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003660300000000001,
      "lo": 0.003660300000000001,
      "hi": 0.003660300000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003660300000000001,
      "lo": 0.003660300000000001,
      "hi": 0.003660300000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 5078,
      "lo": 5078,
      "hi": 5078,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 5909.799999999999,
      "lo": 5909.799999999999,
      "hi": 5909.799999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 6092.36,
      "lo": 6092.36,
      "hi": 6092.36,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0029698000000000007,
      "lo": 0.0029698000000000007,
      "hi": 0.0029698000000000007,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0029698000000000007,
      "lo": 0.0029698000000000007,
      "hi": 0.0029698000000000007,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 6773,
      "lo": 6773,
      "hi": 6773,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 8999.4,
      "lo": 8999.4,
      "hi": 8999.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 9513.48,
      "lo": 9513.48,
      "hi": 9513.48,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00377545,
      "lo": 0.00377545,
      "hi": 0.00377545,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00377545,
      "lo": 0.00377545,
      "hi": 0.00377545,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 5900,
      "lo": 5900,
      "hi": 5900,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 21746.699999999946,
      "lo": 21746.699999999946,
      "hi": 21746.699999999946,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 48760.53999999997,
      "lo": 48760.53999999997,
      "hi": 48760.53999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00334395,
      "lo": 0.00334395,
      "hi": 0.00334395,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00334395,
      "lo": 0.00334395,
      "hi": 0.00334395,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 5302,
      "lo": 5302,
      "hi": 5302,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 8727.399999999996,
      "lo": 8727.399999999996,
      "hi": 8727.399999999996,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 11117.479999999998,
      "lo": 11117.479999999998,
      "hi": 11117.479999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0036913999999999996,
      "lo": 0.0036913999999999996,
      "hi": 0.0036913999999999996,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0036913999999999996,
      "lo": 0.0036913999999999996,
      "hi": 0.0036913999999999996,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 6503,
      "lo": 6503,
      "hi": 6503,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 7401.5,
      "lo": 7401.5,
      "hi": 7401.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 7432.3,
      "lo": 7432.3,
      "hi": 7432.3,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003942650000000001,
      "lo": 0.003942650000000001,
      "hi": 0.003942650000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003942650000000001,
      "lo": 0.003942650000000001,
      "hi": 0.003942650000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.6368827160493827,
      "lo": 0.5192862654320988,
      "hi": 0.7476929012345679,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.325,
      "lo": 0.175,
      "hi": 0.475,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.35,
      "lo": 0.225,
      "hi": 0.5,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.375,
      "lo": 0.225,
      "hi": 0.525,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.225,
      "lo": 0.12316091323540743,
      "hi": 0.37503096742310027,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.10499989725437704,
      "hi": 0.347573063463995,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.05,
      "lo": 0.008881448800795402,
      "hi": 0.23613119344674205,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.16112515805281938,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.8518518518518519,
      "lo": 0.6666666666666666,
      "hi": 0.9814814814814815,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5833333333333334,
      "lo": 0.3333333333333333,
      "hi": 0.9166666666666666,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5833333333333334,
      "lo": 0.3333333333333333,
      "hi": 0.9166666666666666,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5833333333333334,
      "lo": 0.3333333333333333,
      "hi": 0.9166666666666666,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5,
      "lo": 0.2537815976337061,
      "hi": 0.7462184023662939,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5,
      "lo": 0.2537815976337061,
      "hi": 0.7462184023662939,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.5807344064386318,
      "lo": 0.4441649899396378,
      "hi": 0.7241260060362171,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.21428571428571427,
      "lo": 0.07142857142857142,
      "hi": 0.35714285714285715,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.10714285714285714,
      "hi": 0.42857142857142855,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.2857142857142857,
      "lo": 0.10714285714285714,
      "hi": 0.4642857142857143,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.10714285714285714,
      "lo": 0.03711836682929999,
      "hi": 0.27195851548672156,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.07142857142857142,
      "lo": 0.019812064115305755,
      "hi": 0.22645362568399052,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.5102941176470588,
      "lo": 0.35734558823529416,
      "hi": 0.6570588235294118,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.12,
      "lo": 0,
      "hi": 0.28,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.16,
      "lo": 0.04,
      "hi": 0.32,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.04,
      "hi": 0.36,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.04,
      "lo": 0.007096233501987265,
      "hi": 0.19544063736193734,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13319225093904846,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.5102941176470588,
      "lo": 0.3561617647058824,
      "hi": 0.6617720588235294,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.12,
      "lo": 0,
      "hi": 0.28,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.16,
      "lo": 0.04,
      "hi": 0.32,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.04,
      "hi": 0.4,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.04,
      "lo": 0.007096233501987265,
      "hi": 0.19544063736193734,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13319225093904846,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.5272058823529412,
      "lo": 0.3850000000000001,
      "hi": 0.6649632352941175,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.16666666666666666,
      "lo": 0.03333333333333333,
      "hi": 0.3333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.06666666666666667,
      "hi": 0.36666666666666664,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.23333333333333334,
      "lo": 0.1,
      "hi": 0.4,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.03333333333333333,
      "lo": 0.005908590381612455,
      "hi": 0.16670390991409173,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.9230769230769231,
      "lo": 0.7846153846153846,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.7,
      "lo": 0.39677814746114537,
      "hi": 0.8922087325936989,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.7,
      "lo": 0.39677814746114537,
      "hi": 0.8922087325936989,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.6368827160493827,
      "lo": 0.5240625,
      "hi": 0.7495524691358023,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.325,
      "lo": 0.2,
      "hi": 0.475,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.35,
      "lo": 0.2,
      "hi": 0.5,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.375,
      "lo": 0.225,
      "hi": 0.525,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.225,
      "lo": 0.12316091323540743,
      "hi": 0.37503096742310027,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.10499989725437704,
      "hi": 0.347573063463995,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.5729468599033817,
      "lo": 0.43477657004830916,
      "hi": 0.709921497584541,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.23333333333333334,
      "lo": 0.1,
      "hi": 0.4,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.26666666666666666,
      "lo": 0.1,
      "hi": 0.43333333333333335,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.3,
      "lo": 0.13333333333333333,
      "hi": 0.4666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.13333333333333333,
      "lo": 0.053096554840547455,
      "hi": 0.296813266820363,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0.03459988874733419,
      "hi": 0.25621082579184085,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.08065766257979806,
      "hi": 0.41601743225189364,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.08065766257979806,
      "hi": 0.41601743225189364,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.11186170140766569,
      "hi": 0.468700877618744,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.08065766257979806,
      "hi": 0.41601743225189364,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.7324074074074074,
      "lo": 0.571905864197531,
      "hi": 0.8780941358024691,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.55,
      "lo": 0.3,
      "hi": 0.75,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.55,
      "lo": 0.35,
      "hi": 0.75,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.55,
      "lo": 0.35,
      "hi": 0.75,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.4,
      "lo": 0.21880653237281705,
      "hi": 0.6134184992377469,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.4,
      "lo": 0.21880653237281705,
      "hi": 0.6134184992377469,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.5648148148148148,
      "lo": 0.35121913580246916,
      "hi": 0.767932098765432,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0,
      "hi": 0.4,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0,
      "hi": 0.5,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0,
      "hi": 0.5,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0.017876213095072896,
      "hi": 0.4041500267952385,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.5179012345679013,
      "lo": 0.303070987654321,
      "hi": 0.7154475308641974,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0,
      "hi": 0.3,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0,
      "hi": 0.4,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0,
      "hi": 0.5,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.6638608305274972,
      "lo": 0.5148709315375982,
      "hi": 0.7985409652076318,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.36363636363636365,
      "lo": 0.18181818181818182,
      "hi": 0.5454545454545454,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.36363636363636365,
      "lo": 0.18181818181818182,
      "hi": 0.5909090909090909,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.4090909090909091,
      "lo": 0.22727272727272727,
      "hi": 0.5909090909090909,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.13150760287989469,
      "hi": 0.4815173401240238,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.13150760287989469,
      "hi": 0.4815173401240238,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.6039094650205762,
      "lo": 0.4310270919067216,
      "hi": 0.7698902606310014,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2777777777777778,
      "lo": 0.1111111111111111,
      "hi": 0.5,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.3333333333333333,
      "lo": 0.1111111111111111,
      "hi": 0.5555555555555556,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.3333333333333333,
      "lo": 0.1111111111111111,
      "hi": 0.5555555555555556,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.16666666666666666,
      "lo": 0.05836576805861446,
      "hi": 0.39222038103915724,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.1111111111111111,
      "lo": 0.03101952264561239,
      "hi": 0.32799765130178804,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.18338842975206598,
      "lo": 0.1472561983471074,
      "hi": 0.216448347107438,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 625,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 800,
      "lo": 675,
      "hi": 925.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "decision:gpt-6-luna",
      "value": 77.50000000000001,
      "lo": 65,
      "hi": 90.00000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "decision:gpt-6-luna",
      "value": 80,
      "lo": 67.5,
      "hi": 90.00000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "decision:gpt-6-luna",
      "value": 3875.000000000001,
      "lo": 3250,
      "hi": 4500.000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "decision:gpt-6-luna",
      "value": 4000.000000000001,
      "lo": 3375,
      "hi": 4625.000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "decision:gpt-6-luna",
      "value": 248.00000000000003,
      "lo": 208.00000000000003,
      "hi": 288.00000000000006,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "decision:gpt-6-luna",
      "value": 256,
      "lo": 216.00000000000003,
      "hi": 296.00000000000006,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "decision:gpt-6-luna",
      "value": 1410.5,
      "lo": 1183,
      "hi": 1638.0000000000002,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "decision:gpt-6-luna",
      "value": 1456,
      "lo": 1228.5000000000002,
      "hi": 1638.0000000000002,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 650,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "decision:gpt-6-luna",
      "value": 800,
      "lo": 675,
      "hi": 925.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 625,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "decision:gpt-6-luna",
      "value": 800,
      "lo": 675,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "decision:gpt-6-luna",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "decision:gpt-6-luna",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "decision:gpt-6-luna",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "decision:gpt-6-luna",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "decision:gpt-6-luna",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "decision:gpt-6-luna",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.05,
      "lo": 0.008881448800795402,
      "hi": 0.23613119344674205,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 384,
      "lo": 384,
      "hi": 384,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 680.1999999999999,
      "lo": 680.1999999999999,
      "hi": 680.1999999999999,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 875.5200000000009,
      "lo": 875.5200000000009,
      "hi": 875.5200000000009,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 391.5,
      "lo": 391.5,
      "hi": 391.5,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 684.7499999999998,
      "lo": 684.7499999999998,
      "hi": 684.7499999999998,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 902.9800000000002,
      "lo": 902.9800000000002,
      "hi": 902.9800000000002,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016913846153846185,
      "lo": 0.00016913846153846185,
      "hi": 0.00016913846153846185,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016913846153846185,
      "lo": 0.00016913846153846185,
      "hi": 0.00016913846153846185,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 363,
      "lo": 363,
      "hi": 363,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 642.8,
      "lo": 642.8,
      "hi": 642.8,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 771.52,
      "lo": 771.52,
      "hi": 771.52,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016527777777777783,
      "lo": 0.00016527777777777783,
      "hi": 0.00016527777777777783,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016527777777777783,
      "lo": 0.00016527777777777783,
      "hi": 0.00016527777777777783,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 368,
      "lo": 368,
      "hi": 368,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 648,
      "lo": 648,
      "hi": 648,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 753.6000000000001,
      "lo": 753.6000000000001,
      "hi": 753.6000000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 351.5,
      "lo": 351.5,
      "hi": 351.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 616.1999999999998,
      "lo": 616.1999999999998,
      "hi": 616.1999999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 800.0799999999997,
      "lo": 800.0799999999997,
      "hi": 800.0799999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.00016975,
      "lo": 0.00016975,
      "hi": 0.00016975,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.00016975,
      "lo": 0.00016975,
      "hi": 0.00016975,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 422,
      "lo": 422,
      "hi": 422,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 677.8,
      "lo": 677.8,
      "hi": 677.8,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 782.08,
      "lo": 782.08,
      "hi": 782.08,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.0001894800000000001,
      "lo": 0.0001894800000000001,
      "hi": 0.0001894800000000001,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.0001894800000000001,
      "lo": 0.0001894800000000001,
      "hi": 0.0001894800000000001,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 378.5,
      "lo": 378.5,
      "hi": 378.5,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 658.5000000000001,
      "lo": 658.5000000000001,
      "hi": 658.5000000000001,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 872.0900000000013,
      "lo": 872.0900000000013,
      "hi": 872.0900000000013,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.00016482500000000036,
      "lo": 0.00016482500000000036,
      "hi": 0.00016482500000000036,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.00016482500000000036,
      "lo": 0.00016482500000000036,
      "hi": 0.00016482500000000036,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 370,
      "lo": 370,
      "hi": 370,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 573.3999999999999,
      "lo": 573.3999999999999,
      "hi": 573.3999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 628.28,
      "lo": 628.28,
      "hi": 628.28,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 407.5,
      "lo": 407.5,
      "hi": 407.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 709.8499999999999,
      "lo": 709.8499999999999,
      "hi": 709.8499999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 750.4999999999998,
      "lo": 750.4999999999998,
      "hi": 750.4999999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.0001762999999999999,
      "lo": 0.0001762999999999999,
      "hi": 0.0001762999999999999,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.0001762999999999999,
      "lo": 0.0001762999999999999,
      "hi": 0.0001762999999999999,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 374.5,
      "lo": 374.5,
      "hi": 374.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 696.4999999999995,
      "lo": 696.4999999999995,
      "hi": 696.4999999999995,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 826.48,
      "lo": 826.48,
      "hi": 826.48,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.0001798000000000001,
      "lo": 0.0001798000000000001,
      "hi": 0.0001798000000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.0001798000000000001,
      "lo": 0.0001798000000000001,
      "hi": 0.0001798000000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 380,
      "lo": 380,
      "hi": 380,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 564.15,
      "lo": 564.15,
      "hi": 564.15,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 670.4899999999999,
      "lo": 670.4899999999999,
      "hi": 670.4899999999999,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0.00015826666666666673,
      "lo": 0.00015826666666666673,
      "hi": 0.00015826666666666673,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0.00015826666666666673,
      "lo": 0.00015826666666666673,
      "hi": 0.00015826666666666673,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 394,
      "lo": 394,
      "hi": 394,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 719.2499999999994,
      "lo": 719.2499999999994,
      "hi": 719.2499999999994,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 956.3099999999998,
      "lo": 956.3099999999998,
      "hi": 956.3099999999998,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0.000168557142857143,
      "lo": 0.000168557142857143,
      "hi": 0.000168557142857143,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0.000168557142857143,
      "lo": 0.000168557142857143,
      "hi": 0.000168557142857143,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 397,
      "lo": 397,
      "hi": 397,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 650.9999999999999,
      "lo": 650.9999999999999,
      "hi": 650.9999999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 717.6,
      "lo": 717.6,
      "hi": 717.6,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0.0001742727272727273,
      "lo": 0.0001742727272727273,
      "hi": 0.0001742727272727273,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0.0001742727272727273,
      "lo": 0.0001742727272727273,
      "hi": 0.0001742727272727273,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 342,
      "lo": 342,
      "hi": 342,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 543.75,
      "lo": 543.75,
      "hi": 543.75,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 625.5200000000001,
      "lo": 625.5200000000001,
      "hi": 625.5200000000001,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 444.5,
      "lo": 444.5,
      "hi": 444.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 739.5999999999999,
      "lo": 739.5999999999999,
      "hi": 739.5999999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 778.32,
      "lo": 778.32,
      "hi": 778.32,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 379,
      "lo": 379,
      "hi": 379,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 641.1999999999999,
      "lo": 641.1999999999999,
      "hi": 641.1999999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 867.6799999999996,
      "lo": 867.6799999999996,
      "hi": 867.6799999999996,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 444.5,
      "lo": 444.5,
      "hi": 444.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 739.5999999999999,
      "lo": 739.5999999999999,
      "hi": 739.5999999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 778.32,
      "lo": 778.32,
      "hi": 778.32,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 379,
      "lo": 379,
      "hi": 379,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 641.1999999999999,
      "lo": 641.1999999999999,
      "hi": 641.1999999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 867.6799999999996,
      "lo": 867.6799999999996,
      "hi": 867.6799999999996,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 381,
      "lo": 381,
      "hi": 381,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 641.6999999999999,
      "lo": 641.6999999999999,
      "hi": 641.6999999999999,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 860.3300000000008,
      "lo": 860.3300000000008,
      "hi": 860.3300000000008,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.00016628125000000044,
      "lo": 0.00016628125000000044,
      "hi": 0.00016628125000000044,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.00016628125000000044,
      "lo": 0.00016628125000000044,
      "hi": 0.00016628125000000044,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 422,
      "lo": 422,
      "hi": 422,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 784.8,
      "lo": 784.8,
      "hi": 784.8,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 898.5999999999988,
      "lo": 898.5999999999988,
      "hi": 898.5999999999988,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.00017830434782608703,
      "lo": 0.00017830434782608703,
      "hi": 0.00017830434782608703,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.00017830434782608703,
      "lo": 0.00017830434782608703,
      "hi": 0.00017830434782608703,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 384,
      "lo": 384,
      "hi": 384,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 680.1999999999999,
      "lo": 680.1999999999999,
      "hi": 680.1999999999999,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 875.5200000000009,
      "lo": 875.5200000000009,
      "hi": 875.5200000000009,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 328.5,
      "lo": 328.5,
      "hi": 328.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 694.1499999999999,
      "lo": 694.1499999999999,
      "hi": 694.1499999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 820.4300000000002,
      "lo": 820.4300000000002,
      "hi": 820.4300000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999998,
      "lo": 0.00017774999999999998,
      "hi": 0.00017774999999999998,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999998,
      "lo": 0.00017774999999999998,
      "hi": 0.00017774999999999998,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 357.5,
      "lo": 357.5,
      "hi": 357.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 602.9999999999999,
      "lo": 602.9999999999999,
      "hi": 602.9999999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 647,
      "lo": 647,
      "hi": 647,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0.00017675000000000004,
      "lo": 0.00017675000000000004,
      "hi": 0.00017675000000000004,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0.00017675000000000004,
      "lo": 0.00017675000000000004,
      "hi": 0.00017675000000000004,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 353,
      "lo": 353,
      "hi": 353,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 531.5999999999999,
      "lo": 531.5999999999999,
      "hi": 531.5999999999999,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 560.8,
      "lo": 560.8,
      "hi": 560.8,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0.00016099999999999998,
      "lo": 0.00016099999999999998,
      "hi": 0.00016099999999999998,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0.00016099999999999998,
      "lo": 0.00016099999999999998,
      "hi": 0.00016099999999999998,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 381,
      "lo": 381,
      "hi": 381,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 649.6999999999998,
      "lo": 649.6999999999998,
      "hi": 649.6999999999998,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 858.8599999999993,
      "lo": 858.8599999999993,
      "hi": 858.8599999999993,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.00016654263565891517,
      "lo": 0.00016654263565891517,
      "hi": 0.00016654263565891517,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.00016654263565891517,
      "lo": 0.00016654263565891517,
      "hi": 0.00016654263565891517,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 444.5,
      "lo": 444.5,
      "hi": 444.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 739.5999999999999,
      "lo": 739.5999999999999,
      "hi": 739.5999999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 778.32,
      "lo": 778.32,
      "hi": 778.32,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 419.5,
      "lo": 419.5,
      "hi": 419.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 668.9999999999999,
      "lo": 668.9999999999999,
      "hi": 668.9999999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 723.3999999999999,
      "lo": 723.3999999999999,
      "hi": 723.3999999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0.00016900000000000002,
      "lo": 0.00016900000000000002,
      "hi": 0.00016900000000000002,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0.00016900000000000002,
      "lo": 0.00016900000000000002,
      "hi": 0.00016900000000000002,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 404.5,
      "lo": 404.5,
      "hi": 404.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 723.4499999999999,
      "lo": 723.4499999999999,
      "hi": 723.4499999999999,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 729.08,
      "lo": 729.08,
      "hi": 729.08,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999993,
      "lo": 0.00017774999999999993,
      "hi": 0.00017774999999999993,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999993,
      "lo": 0.00017774999999999993,
      "hi": 0.00017774999999999993,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 422,
      "lo": 422,
      "hi": 422,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 685.6,
      "lo": 685.6,
      "hi": 685.6,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 692.3199999999999,
      "lo": 692.3199999999999,
      "hi": 692.3199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0.00017919999999999996,
      "lo": 0.00017919999999999996,
      "hi": 0.00017919999999999996,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0.00017919999999999996,
      "lo": 0.00017919999999999996,
      "hi": 0.00017919999999999996,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 368,
      "lo": 368,
      "hi": 368,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 648,
      "lo": 648,
      "hi": 648,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 753.6000000000001,
      "lo": 753.6000000000001,
      "hi": 753.6000000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 391,
      "lo": 391,
      "hi": 391,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 709.8499999999999,
      "lo": 709.8499999999999,
      "hi": 709.8499999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 750.4999999999998,
      "lo": 750.4999999999998,
      "hi": 750.4999999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.00017940000000000002,
      "lo": 0.00017940000000000002,
      "hi": 0.00017940000000000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.00017940000000000002,
      "lo": 0.00017940000000000002,
      "hi": 0.00017940000000000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 387,
      "lo": 387,
      "hi": 387,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 656.4,
      "lo": 656.4,
      "hi": 656.4,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 913.2400000000001,
      "lo": 913.2400000000001,
      "hi": 913.2400000000001,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0.0001663423423423424,
      "lo": 0.0001663423423423424,
      "hi": 0.0001663423423423424,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0.0001663423423423424,
      "lo": 0.0001663423423423424,
      "hi": 0.0001663423423423424,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 366.5,
      "lo": 366.5,
      "hi": 366.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 676.3,
      "lo": 676.3,
      "hi": 676.3,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 800.0799999999997,
      "lo": 800.0799999999997,
      "hi": 800.0799999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.00016665000000000004,
      "lo": 0.00016665000000000004,
      "hi": 0.00016665000000000004,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.00016665000000000004,
      "lo": 0.00016665000000000004,
      "hi": 0.00016665000000000004,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 438,
      "lo": 438,
      "hi": 438,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 807.7,
      "lo": 807.7,
      "hi": 807.7,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 952.5999999999996,
      "lo": 952.5999999999996,
      "hi": 952.5999999999996,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0.0001780769230769231,
      "lo": 0.0001780769230769231,
      "hi": 0.0001780769230769231,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0.0001780769230769231,
      "lo": 0.0001780769230769231,
      "hi": 0.0001780769230769231,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 356.5,
      "lo": 356.5,
      "hi": 356.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 565.45,
      "lo": 565.45,
      "hi": 565.45,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 565.89,
      "lo": 565.89,
      "hi": 565.89,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.0001595,
      "lo": 0.0001595,
      "hi": 0.0001595,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.0001595,
      "lo": 0.0001595,
      "hi": 0.0001595,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 419,
      "lo": 419,
      "hi": 419,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 721.0999999999998,
      "lo": 721.0999999999998,
      "hi": 721.0999999999998,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 825.8200000000002,
      "lo": 825.8200000000002,
      "hi": 825.8200000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0.0002105,
      "lo": 0.0002105,
      "hi": 0.0002105,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0.0002105,
      "lo": 0.0002105,
      "hi": 0.0002105,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 342,
      "lo": 342,
      "hi": 342,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 543.75,
      "lo": 543.75,
      "hi": 543.75,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 625.5200000000001,
      "lo": 625.5200000000001,
      "hi": 625.5200000000001,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 387.5,
      "lo": 387.5,
      "hi": 387.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 726.6,
      "lo": 726.6,
      "hi": 726.6,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 729.3199999999999,
      "lo": 729.3199999999999,
      "hi": 729.3199999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0.00015599999999999994,
      "lo": 0.00015599999999999994,
      "hi": 0.00015599999999999994,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0.00015599999999999994,
      "lo": 0.00015599999999999994,
      "hi": 0.00015599999999999994,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 366,
      "lo": 366,
      "hi": 366,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 566,
      "lo": 566,
      "hi": 566,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 658.8000000000001,
      "lo": 658.8000000000001,
      "hi": 658.8000000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.00016199999999999995,
      "lo": 0.00016199999999999995,
      "hi": 0.00016199999999999995,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.00016199999999999995,
      "lo": 0.00016199999999999995,
      "hi": 0.00016199999999999995,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 433,
      "lo": 433,
      "hi": 433,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 709,
      "lo": 709,
      "hi": 709,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 765.8000000000001,
      "lo": 765.8000000000001,
      "hi": 765.8000000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0.00020799999999999993,
      "lo": 0.00020799999999999993,
      "hi": 0.00020799999999999993,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0.00020799999999999993,
      "lo": 0.00020799999999999993,
      "hi": 0.00020799999999999993,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 382.5,
      "lo": 382.5,
      "hi": 382.5,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 627.3499999999999,
      "lo": 627.3499999999999,
      "hi": 627.3499999999999,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 902.2599999999999,
      "lo": 902.2599999999999,
      "hi": 902.2599999999999,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.0001647857142857145,
      "lo": 0.0001647857142857145,
      "hi": 0.0001647857142857145,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.0001647857142857145,
      "lo": 0.0001647857142857145,
      "hi": 0.0001647857142857145,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 384,
      "lo": 384,
      "hi": 384,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 669.2999999999996,
      "lo": 669.2999999999996,
      "hi": 669.2999999999996,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 854.6599999999999,
      "lo": 854.6599999999999,
      "hi": 854.6599999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0.00015000000000000001,
      "lo": 0.00015000000000000001,
      "hi": 0.00015000000000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0.00015000000000000001,
      "lo": 0.00015000000000000001,
      "hi": 0.00015000000000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 359,
      "lo": 359,
      "hi": 359,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 510.4,
      "lo": 510.4,
      "hi": 510.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 526.0799999999999,
      "lo": 526.0799999999999,
      "hi": 526.0799999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0.00017760000000000003,
      "lo": 0.00017760000000000003,
      "hi": 0.00017760000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0.00017760000000000003,
      "lo": 0.00017760000000000003,
      "hi": 0.00017760000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 413,
      "lo": 413,
      "hi": 413,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 543.6999999999999,
      "lo": 543.6999999999999,
      "hi": 543.6999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 554.34,
      "lo": 554.34,
      "hi": 554.34,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0.00019360000000000002,
      "lo": 0.00019360000000000002,
      "hi": 0.00019360000000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0.00019360000000000002,
      "lo": 0.00019360000000000002,
      "hi": 0.00019360000000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 232,
      "lo": 232,
      "hi": 232,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 485.29999999999995,
      "lo": 485.29999999999995,
      "hi": 485.29999999999995,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 525.06,
      "lo": 525.06,
      "hi": 525.06,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0.0000826,
      "lo": 0.0000826,
      "hi": 0.0000826,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0.0000826,
      "lo": 0.0000826,
      "hi": 0.0000826,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 407,
      "lo": 407,
      "hi": 407,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 580.6999999999999,
      "lo": 580.6999999999999,
      "hi": 580.6999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 591.34,
      "lo": 591.34,
      "hi": 591.34,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0.00019180000000000003,
      "lo": 0.00019180000000000003,
      "hi": 0.00019180000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0.00019180000000000003,
      "lo": 0.00019180000000000003,
      "hi": 0.00019180000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 370,
      "lo": 370,
      "hi": 370,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 573.3999999999999,
      "lo": 573.3999999999999,
      "hi": 573.3999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 628.28,
      "lo": 628.28,
      "hi": 628.28,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    }
  ],
  "findings": {
    "losses": [
      "Price: $0.016 a check, 16× a plain Claude Haiku call ($0.0010), 4× plain Gemini 3.8 Flash ($0.0044) and about 90× the OpenAI decision model ($0.00017). What it buys is listed under the wins.",
      "Speed and consistency against the decision model: it answers in 0.4 s at the median (ours 4.1 s) and gave the same decision in every repetition (ours 97%). It catches far fewer fakes (see the wins)."
    ],
    "wins": [
      "Duplicates: 99% of resubmitted copies recognised (re-encoded, resized, cropped, rotated, screenshotted and re-photographed; n=30), with 4.5% false matches on look-alike receipts (n=11). Plain prompts and decision models have no memory across checks and can't do this.",
      "Proof: 53% of fakes were caught with evidence a caller can re-check without trusting a model (amounts that don't add up, an AI or receipt-generator tag in the file, an edit record, a duplicate match); 2.5% of genuine receipts carried such a finding. A plain prompt or a decision model only gives an opinion.",
      "Against the OpenAI decision model: 78% of fakes caught at a 5% false-flag rate vs 35%, and a ROC AUC of 0.88 vs 0.64.",
      "Speed against plain prompts: a median of 4.1 s vs 6.6 s (Gemini) and 8.6 s (Claude)."
    ],
    "ties": [
      "Catching fakes against plain prompts, ahead but not proven: 78% caught at a 5% false-flag rate vs 65% (Gemini) and 53% (Claude); ROC AUC 0.88 vs 0.81. With 40 fakes the 95% intervals overlap.",
      "Expected cost of decisions per 1,000 receipts at risk ≥ 0.7 (1% of receipts fake, $100 per missed fake, $17 per false flag; sources in the methodology): $483 vs $683 (Gemini), $753 (Claude), $800 (decision model) and $1,000 for approving everything. The intervals overlap with the plain prompts.",
      "False flags at risk ≥ 0.5: 2.1% of genuine receipts vs 1.2% (Gemini), 2.9% (Claude) and 0% (decision model); not a proven difference.",
      "Extraction: 97% of documents with every labelled field right, vs 94% for both plain prompts.",
      "Naming the edited field on edited fakes: 33%, vs 30% (Gemini) and 37% (Claude).",
      "Calibration error of the risk: 8%, vs 10–12% for the plain prompts and 18% for the decision model."
    ]
  },
  "datasets": [
    {
      "name": "SROIE (ICDAR 2019 scanned receipts), Voxel51/scanned_receipts mirror",
      "license": "CC-BY-4.0",
      "url": "https://huggingface.co/datasets/Voxel51/scanned_receipts",
      "cases": 98
    },
    {
      "name": "RA-Bench fakes from SROIE",
      "license": "CC-BY-4.0",
      "url": "https://huggingface.co/datasets/Voxel51/scanned_receipts",
      "cases": 20
    },
    {
      "name": "RA-Bench generated fakes",
      "license": "CC-BY-4.0",
      "url": null,
      "cases": 20
    },
    {
      "name": "Wikimedia Commons (Naha Mama Pavilionz)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:JP_%E6%97%A5%E6%9C%AC_Japan_%E6%B2%96%E7%B9%A9_OKINAWA_Family_Cuisine_Restaurant_January_2025_R12S_01.jpg",
      "cases": 2
    },
    {
      "name": "Wikimedia Commons (NORTLAUKAU 26088 JP)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:JP_%E6%97%A5%E6%9C%AC_Japan_%E6%B2%96%E7%B9%A9_OKINAWA_Route_253_%E6%B5%A6%E8%A5%BF_Chome_Yoshinoya_Restaurant_%E7%89%9B%E4%B8%BC%E9%A3%AF_Beef_slice_rice_bowl_February_2026_N13P_05.jpg",
      "cases": 2
    },
    {
      "name": "Wikimedia Commons (Solomon203)",
      "license": "CC BY-SA 4.0",
      "url": "https://commons.wikimedia.org/wiki/File:FamilyMart_Keelung_Baifu_Store_e-invoice_WJ90244062.jpg",
      "cases": 2
    },
    {
      "name": "Wikimedia Commons (Aw58)",
      "license": "CC BY-SA 4.0",
      "url": "https://commons.wikimedia.org/wiki/File:Paragon_fiskalny_-_12.07.2024.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (Grandmaster Huon)",
      "license": "Public domain",
      "url": "https://commons.wikimedia.org/wiki/File:Grocery_Store_Receipt_in_Vienna.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (Lantus)",
      "license": "Public domain",
      "url": "https://commons.wikimedia.org/wiki/File:Migros_Kassenzettel_2025.pdf",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (LIman TADU Foo RUBB)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:SZ_%E6%B7%B1%E5%9C%B3_Shenzhen_%E9%BE%8D%E5%B4%97_Longgang_%E4%BA%94%E5%92%8C%E8%B7%AF_118_Wuhe_Road_%E6%B5%B7%E8%BE%BE%E5%92%8C%E6%88%90%E8%B4%AD%E7%89%A9%E4%B8%AD%E5%BF%83_HaiDa_HeCheng_Shopping_Mall_shop_%E6%B5%81%E6%B5%AA%E6%B3%A1%E6%B3%A1%E7%83%A4%E8%82%89_LiuLang_PaoPao_Korean_BBQ_Buffet_Restaurant_bill_n_rules_November_2025_R12S_01.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (Sakurakat)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:Bill_Vishwanand_2026-01-28.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (TaiZiThee 832)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:SZ_%E6%B7%B1%E5%9C%B3_Shenzhen_%E5%AF%B6%E5%AE%89%E4%B8%AD%E5%BF%83_BaoAn_%E5%89%B5%E6%A5%AD%E4%B8%80%E8%B7%AF_Chuangye_1st_Road_mall_AEON_Supermarket_bill_December_2024_R12S_01.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (YEING Luwem Hai Wangs)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:SZ_%E6%B7%B1%E5%9C%B3_Shenzhen_%E7%A6%8F%E7%94%B0_Futian_%E9%87%91%E7%94%B0%E8%B7%AF_Jintian_Road_%E4%B8%83%E9%AE%AE%E8%B6%85%E5%B8%82_Seven_Fresh_Supermarket_checkout_bill_February_2024_R12S_20.jpg",
      "cases": 1
    }
  ],
  "limitations": [
    "Preliminary: small samples, so intervals are wide. Read the intervals, not the point estimates.",
    "Public cases come from datasets that are probably in the models' training data.",
    "The DIY baselines use one plain prompt; a stronger prompt would do better. A strong-prompt baseline comes later.",
    "DIY targets have no memory across checks and no deterministic checks: those tasks are marked not supported, not scored as zero.",
    "Our engine runs in process, so its latency has no network hop to receiptaudit.com; DIY latency includes the round trip to the model.",
    "Costs are model tokens at list price on the price date; no infrastructure cost is included.",
    "When the Claude baseline's config says transport claude-code-cli, it ran through Claude Code's CLI on a subscription: thinking is adaptive and can't be fully turned off, its cost is what the same tokens cost through the API, and its latency includes the CLI's start-up.",
    "The duplicate network starts empty for each repetition: it only knows the run's own earlier cases, not production traffic.",
    "We made the fakes ourselves, with current image models and edits; fakes in the wild may differ.",
    "Most genuine receipts are scans from 2016–2018 (SROIE, CORD), with a few recent ones; fakes are dated to match, so a model can't tell them apart by date alone. More recent genuine receipts are being added.",
    "This run is not blind for false proof. After run 20261012T223232Z-63be0d we looked at held-out outputs to find why 16% of genuine receipts carried a finding labelled proof, and fixed it (engine 0.2.1: a warning is no longer proof; cash rounding for MYR and others). The 2.5% here is measured on those same cases; the next held-out rotation re-checks it.",
    "The OpenAI decision model (Decisions API, gpt-6-luna) is in public beta."
  ],
  "examples": [],
  "methodology": "RA-Bench 0.2.0. These definitions, thresholds and exclusions were written before the run and change only in a new suite version.\n\nWho and what. Receipt Audit runs this benchmark on its own product. Every target gets the same cases, the same files, the same timeout (180 s per attempt by default) and the same scoring; only the target changes. A target is our engine (\"self\", in process, with the duplicate network on an empty in-memory backend that lives for one repetition) or an agent's own model asked with one plain prompt (\"diy\"). DIY targets get the same file preparation as our engine (upright, at most 3072 px and 3.75 MB) so that API size limits don't count against them. Transport failures (network errors, HTTP 408, 429 and 5xx) are retried up to 3 times with exponential backoff; nothing else is retried, and a wrong answer is a result. Models are pinned: no fallback to another model.\n\nUnits and intervals. A case run several times counts once, with the share of its runs that succeeded. Rates carry a 95% Wilson interval over cases (operations rates: over calls). ROC AUC, detection at a fixed false-flag rate and line-item F1 carry a 95% percentile bootstrap interval (2000 resamples, genuine receipts and fakes resampled separately, seeded per row so a re-scored run gives the same interval). Latency and cost have no interval. Every row reports n. Rows are given for all cases and for every stratum (a \"dimension=value\" tag on the case, or a label-derived group) with at least 10 cases.\n\nWhich cases count. Extraction, checks and authenticity use base cases only: cases that aren't a transform of another case (no lineage). Duplicate transforms count only for the duplicates task. Operations use every call.\n\nExtraction. Scored only on fields the label covers; a field labelled null means the document doesn't show it, and only a null answer is right. Merchant name: lowercase, accents stripped, \"&\" read as \"and\", punctuation dropped, then a match at edit-distance similarity ≥ 0.9. Date: the exact ISO date (YYYY-MM-DD). Subtotal, tax total and total: within 0.01. Currency: the exact ISO 4217 code. Receipt number: equal after keeping only letters and digits, lowercased. \"All fields right\": every labelled scalar field of the document right in that run (line items excluded). Line-item F1: labelled and extracted items paired one to one when descriptions are at least 0.8 alike (same normalisation) and totals match within 0.01, micro-averaged over all documents. Valid output: the call succeeded and returned readable fields. A failed call or an unreadable answer gets every field wrong.\n\nChecks. totals_add_up is scored against the label \"the printed amounts add up\". A positive is a document whose amounts don't add up; the check flags it when it reports failed. Recall over documents that don't add up; precision over documents it flagged; false alarms over genuine documents that do add up; coverage is the share of documents where the check ran (a check that couldn't run isn't output). Targets without deterministic checks report this task as not supported.\n\nAuthenticity (genuine vs fake). Higher risk means more likely fake. ROC AUC uses each target's risk as the score; a result without a risk scores 0.5 (no opinion), ties count half. Detection at a 1%, 5% and 10% false-flag rate: the share of fakes flagged by the lowest threshold that flags at most that share of genuine receipts (ties at the threshold are all flagged). At the documented thresholds risk ≥ 0.5 and risk ≥ 0.7: the share of fakes flagged (detection) and of genuine receipts flagged (false flags); a result without a risk is never flagged. Strata from the labels: each fake class (\"class=ai_full\", …) and fakes whose amounts add up or don't (\"arithmetic=consistent\", \"arithmetic=inconsistent\"), each compared with every genuine receipt; and provenance metadata (\"provenance=intact\", \"stripped\", \"none\"), genuine receipts and fakes alike.\n\nDuplicates. Every case is submitted by a different account, so a repeat is \"someone else submitted this receipt before\". Recall: the share of duplicate transforms (re-encoded, cropped, re-shot copies of an earlier case) the target recognised as seen before; exact recall counts only matches on the identical image hash. False matches: the share of distinct receipts reported as seen before, for hard negatives (different receipts that look alike: same merchant, template or day; \"false_match_rate\") and for the other genuine receipts (\"false_match_rate_genuine\"). Originals always run before their transforms. Targets without memory across checks (DIY prompts) report the task as not supported, not as zero.\n\nDecisions. A decision is the yes/no a caller acts on: flagged when risk ≥ 0.5. Consistency: over base cases run at least twice, the share whose decision is the same in every repetition; total consistency, the share whose extracted total is the same (within 0.01, or absent) in every repetition. Calibration error: expected calibration error of risk against \"is fake\" over every run with a risk, 10 equal-width bins, weighted by run count (lower is better; it depends on this set's share of fakes). Expected cost per 1,000 receipts at risk ≥ 0.5 and ≥ 0.7: 1000 × ((1 − p) × false-flag rate × C_review + p × (1 − detection) × C_miss). Defaults, each from a cited, graded source (research/41-benchmark-cost-model.md): p = 1% of submitted receipts are fake (SAP Concur's share of receipts flagged as AI-generated; no study measures the true share, so this is the best available assumption, not a measurement); C_miss = $100, the face value of a missed fake (AppZen's mean AI-generated fake, 12 months to May 2026); C_review = $17, one false flag's review (18 minutes, GBTA, at a loaded auditor wage of $57.47/h, BLS). At these defaults one point of false-flag rate costs as much as about 17 points of detection. The sweep varies one assumption at a time over its published spread (\"assumption=…\": fakes 0.1% and 5%; a missed fake $32 and $182; a review $8 and $73). Approving everything costs 1000 × p × C_miss ($1000 at the defaults), reported as its own row: a detector above it loses money under those assumptions. The formula counts only mistakes (it treats reviewing a fake that was rightly flagged as free) and leaves out unmeasured costs: an employee's time and trust after a false flag, and repeat fraud or tax penalties after a miss. This set has far more fakes than real submissions, so the cost re-weights the measured rates by p rather than using the set's own mix.\n\nEvidence. A yes/no is easy to get from any model; a reviewer also needs to know what is wrong. Edited field named: over fakes whose label names the edited field (AI-inpainted and hand-edited fakes), the share of runs that flag the receipt and whose first 3 reasons point at that field. A reason points at a field through an explicit \"@field\" tag, a deterministic check about it (an arithmetic check points at the total and subtotal), or, for free-text reasons, a pre-registered keyword (total, amount due; subtotal; tax, VAT, GST; date; merchant, store, vendor, logo, name; item, line, quantity, price).\n\nVerifiable evidence. A finding is proof of tampering when a caller can check it without trusting a model and it shows the document was generated or changed: an AI-generator, AI source-type or receipt/invoice-generator tag read from the file, PDF modification records, a thumbnail that doesn't match the image, a photo taken before the printed purchase date, printed amounts that don't add up (with the numbers), or a duplicate-network match. Other file facts (an editor or office tool, missing camera data) and plausibility or policy checks (tax rate, the receipt's age, currency) are real but don't show tampering, and don't count. A model's visual judgement is an opinion, however confident. Fakes caught with proof: the share of fakes flagged with at least one proof among their reasons. Genuine receipts with proof: the guard against false proof (lower is better). Only targets that can return verifiable findings report this task; a plain prompt returns opinions by construction and reports it as not supported.\n\nOperations. Latency: wall time of the final attempt of each successful call, measured by the harness (p50, p95, p99). Cost per check is what the caller pays for one check: for Receipt Audit, the list price of its smallest credit pack per check; for a DIY baseline, its model tokens × the AI Gateway list price on the run's price date. Model cost per check is the model tokens × that list price for every target, our engine's own model call included (infrastructure not included). Both are averaged over successful calls. Error, refusal and timeout rates over all calls.\n\nFindings. Each of our targets is compared with each baseline on the headline rows of every task (stratum \"all\"): a win or a loss only when the 95% intervals don't overlap, otherwise a tie; for latency and cost, which have no interval, only when one value is at least 1.2 times the other. A comparison resting on fewer than 10 cases (or calls) on either side is always a tie. A task a baseline can't do by construction is reported as such, not as a score of zero.",
  "reproduce": {
    "repo": null,
    "command": "cd apps/receipt-check && nub run bench run --cases benchmarks/receipt-audit/heldout-cases.jsonl --split private --targets self,diy:claude-haiku-5.5,diy:gemini-3.8-flash,decision:gpt-6-luna --reps 3"
  },
  "history": [
    {
      "runId": "20261012T231905Z-2c62d5",
      "ranAt": "2026-10-12T23:35:25.647Z",
      "url": "https://receiptaudit.com/benchmarks/runs/20261012T231905Z-2c62d5.json",
      "incomplete": true
    },
    {
      "runId": "20261012T230424Z-fc67c6",
      "ranAt": "2026-10-12T23:18:58.299Z",
      "url": "https://receiptaudit.com/benchmarks/runs/20261012T230424Z-fc67c6.json"
    },
    {
      "runId": "20261012T223232Z-63be0d",
      "ranAt": "2026-10-12T22:49:04.881Z",
      "url": "https://receiptaudit.com/benchmarks/runs/20261012T223232Z-63be0d.json"
    },
    {
      "runId": "20261012T203648Z-44a89a",
      "ranAt": "2026-10-12T20:47:27.588Z",
      "url": "https://receiptaudit.com/benchmarks/runs/20261012T203648Z-44a89a.json"
    }
  ]
}