{
  "$schema": "https://receiptaudit.com/benchmarks/schema.json",
  "suite": "receipt-audit",
  "title": "RA-Bench: receipt extraction, fake detection, evidence and duplicates",
  "preliminary": true,
  "disclosure": "We build Receipt Audit and we run this benchmark. Our engine is one of the targets, so read it as a vendor benchmark: the public split's cases, labels, every target's outputs and the code are open, every run is kept, and losses are listed first. To reproduce a number, run the command below with your own keys; to dispute one, email hello@godard.me.",
  "manifest": {
    "runId": "20261012T223232Z-63be0d",
    "suite": "receipt-audit",
    "suiteVersion": "0.2.0",
    "datasetHash": "9cfa2c4c2d6e596579470768c8b182ffc7d264123e0c0fc7ee707a6de9dd6d79",
    "split": "private",
    "startedAt": "2026-10-12T22:32:32.183Z",
    "finishedAt": "2026-10-12T22:49:04.881Z",
    "gitSha": "963a2be96c1ca3036d9b2d067aae01037e70305a",
    "reps": 3,
    "cases": 151,
    "targets": [
      {
        "id": "self",
        "label": "Receipt Audit (Claude Haiku 5.5)",
        "kind": "self",
        "version": "engine.0.2.0+anthropic/claude-haiku-5.5+prompt.9a2a5877e979+git.963a2be96c1c",
        "config": {
          "engine": "ReceiptChecks (apps/receipt-check/lib/server/ReceiptChecks.ts), in process",
          "engineVersion": "0.2.0",
          "production": true,
          "model": "anthropic/claude-haiku-5.5",
          "prompt": "apps/receipt-check/lib/receipts/model.ts (INSTRUCTIONS, USER_PROMPT and the ModelAnalysis output schema)",
          "promptSha256": "9a2a5877e9795c37df6d2c2cb89f56cae64b76ae10bbd672cc1ab6bb41426a71",
          "instructionsSha256": "da94bf411e9d3c47462a4d77b59a373a2b478a3e6afffb86889dc5e93ad452fb",
          "hashVersion": 2,
          "endpoint": "https://ai-gateway.vercel.sh/v1/chat/completions",
          "reasoningEffort": "low",
          "structuredOutput": true,
          "modelTimeout": "90 seconds",
          "modelRetries": "2, on errors effect/ai marks retryable",
          "filePreparation": "upright, at most 3072 px and 3.75 MB (lib/receipts/model.ts)",
          "duplicateNetwork": "the production Convex functions on an in-memory backend, empty at the start of each repetition",
          "submitter": "one account per case (the case id)",
          "gitSha": "963a2be96c1ca3036d9b2d067aae01037e70305a",
          "pricePerCheckUsd": 0.01633333333333333,
          "cost": "cost_per_check_usd is what a caller pays Receipt Audit per check: the list price of the smallest credit pack (credits-3k: $49 for 3,000 checks, $0.0163 per check). model_cost_per_check_usd (and each result's costUsd) is the engine's own model call: tokens × the AI Gateway list price on the price date."
        },
        "priceDate": "2026-10-12",
        "unsupportedTasks": []
      },
      {
        "id": "self-gemini",
        "label": "Receipt Audit on Gemini 3.8 Flash",
        "kind": "self",
        "version": "engine.0.2.0+google/gemini-3.8-flash+prompt.9a2a5877e979+git.963a2be96c1c",
        "config": {
          "engine": "ReceiptChecks (apps/receipt-check/lib/server/ReceiptChecks.ts), in process",
          "engineVersion": "0.2.0",
          "production": false,
          "model": "google/gemini-3.8-flash",
          "prompt": "apps/receipt-check/lib/receipts/model.ts (INSTRUCTIONS, USER_PROMPT and the ModelAnalysis output schema)",
          "promptSha256": "9a2a5877e9795c37df6d2c2cb89f56cae64b76ae10bbd672cc1ab6bb41426a71",
          "instructionsSha256": "da94bf411e9d3c47462a4d77b59a373a2b478a3e6afffb86889dc5e93ad452fb",
          "hashVersion": 2,
          "endpoint": "https://ai-gateway.vercel.sh/v1/chat/completions",
          "reasoningEffort": "low",
          "structuredOutput": true,
          "modelTimeout": "90 seconds",
          "modelRetries": "2, on errors effect/ai marks retryable",
          "filePreparation": "upright, at most 3072 px and 3.75 MB (lib/receipts/model.ts)",
          "duplicateNetwork": "the production Convex functions on an in-memory backend, empty at the start of each repetition",
          "submitter": "one account per case (the case id)",
          "gitSha": "963a2be96c1ca3036d9b2d067aae01037e70305a",
          "pricePerCheckUsd": 0.01633333333333333,
          "cost": "cost_per_check_usd is what a caller pays Receipt Audit per check: the list price of the smallest credit pack (credits-3k: $49 for 3,000 checks, $0.0163 per check). model_cost_per_check_usd (and each result's costUsd) is the engine's own model call: tokens × the AI Gateway list price on the price date."
        },
        "priceDate": "2026-10-12",
        "unsupportedTasks": []
      },
      {
        "id": "diy:claude-haiku-5.5",
        "label": "Claude Haiku 5.5, plain prompt",
        "kind": "diy",
        "version": "claude-haiku-5-5@claude-code-cli+prompt.512dfb3893be+git.963a2be96c1c",
        "config": {
          "transport": "claude-code-cli",
          "endpoint": "http://127.0.0.1:8789/v1/messages (claude-local: one headless `claude -p` per call, no tools, no MCP, no settings, empty cwd)",
          "billing": "subscription",
          "cli": "claude 2.1.296",
          "thinking": "Claude Code default (adaptive; can't be fully disabled via the CLI)",
          "ignored": [
            "max_tokens"
          ],
          "costUsd": "API-equivalent: the reported tokens × the AI Gateway list price, i.e. what the check costs when called through the API",
          "usage": "as the CLI reports it, including Claude Code's own cached system prompt (about 3,500 tokens, mostly cache reads); inputTokens counts uncached, cache-read and cache-write tokens",
          "model": "claude-haiku-5-5",
          "max_tokens": 4096,
          "message": "one user turn: the file (image block, or document block for a PDF), then the prompt",
          "rateLimits": "HTTP 429 (a subscription limit on claude-local) is retried with backoff like a transport error",
          "prompt": "apps/receipt-check/bench/prompt.ts (DIY_PLAIN_PROMPT)",
          "promptSha256": "512dfb3893be5aa7f89ff7be2259d8f9c94c948fe8b2d6e3dca9bc6f5889bc37",
          "gitSha": "963a2be96c1ca3036d9b2d067aae01037e70305a",
          "cost": "cost_per_check_usd and model_cost_per_check_usd are both the API-equivalent token cost: tokens × the AI Gateway list price on the price date"
        },
        "priceDate": "2026-10-12",
        "unsupportedTasks": [
          "checks",
          "duplicates",
          "proof"
        ]
      },
      {
        "id": "diy:gemini-3.8-flash",
        "label": "Gemini 3.8 Flash, plain prompt",
        "kind": "diy",
        "version": "google/gemini-3.8-flash+prompt.512dfb3893be+git.963a2be96c1c",
        "config": {
          "endpoint": "https://ai-gateway.vercel.sh/v1/chat/completions (Vercel AI Gateway, OpenAI-compatible)",
          "model": "google/gemini-3.8-flash",
          "max_tokens": "not set (provider default)",
          "reasoning": "not set (provider default)",
          "temperature": "not set (provider default)",
          "message": "one user turn: the file (image_url part, or a file part for a PDF), then the prompt",
          "prompt": "apps/receipt-check/bench/prompt.ts (DIY_PLAIN_PROMPT)",
          "promptSha256": "512dfb3893be5aa7f89ff7be2259d8f9c94c948fe8b2d6e3dca9bc6f5889bc37",
          "gitSha": "963a2be96c1ca3036d9b2d067aae01037e70305a",
          "cost": "cost_per_check_usd and model_cost_per_check_usd are both the API-equivalent token cost: tokens × the AI Gateway list price on the price date"
        },
        "priceDate": "2026-10-12",
        "unsupportedTasks": [
          "checks",
          "duplicates",
          "proof"
        ]
      },
      {
        "id": "decision:gpt-6-luna",
        "label": "OpenAI decision model (gpt-6-luna), asked if it's fake",
        "kind": "diy",
        "version": "openai/gpt-6-luna-decisions+prompt.977e84771afc+git.963a2be96c1c",
        "config": {
          "endpoint": "https://ai-gateway.vercel.sh/v1/decisions (Vercel AI Gateway → OpenAI Decisions API, public beta)",
          "model": "openai/gpt-6-luna-decisions",
          "questions": "apps/receipt-check/bench/prompt.ts (DECISION_QUESTIONS): a predicate (is it fake) and two choices (how it was made, which part looks altered)",
          "questionsSha256": "e17d0fb5b77b6147ffdb12fa1e22ed2dc99e5edec56d69731f297ad2c86aca37",
          "input": "one user message: DECISION_INPUT_TEXT and the image as a base64 data URL; a PDF's first page rendered at 150 dpi (pdftoppm)",
          "risk": "the predicate's probability",
          "reasons": "the two choices, in plain words",
          "cost": "input tokens × $0.1 per 1M (no output charge), price of 2026-10-12",
          "gitSha": "963a2be96c1ca3036d9b2d067aae01037e70305a"
        },
        "priceDate": "2026-10-12",
        "unsupportedTasks": [
          "extraction",
          "checks",
          "duplicates",
          "proof"
        ]
      }
    ]
  },
  "metrics": [
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "self",
      "value": 0.9929824561403509,
      "lo": 0.9485657733553275,
      "hi": 0.9990797570145254,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "self",
      "value": 0.9970238095238095,
      "lo": 0.9613049808095904,
      "hi": 0.9997786801417214,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "self",
      "value": 0.9166666666666666,
      "lo": 0.6900615298103708,
      "hi": 0.9819320697442654,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "self",
      "value": 0.9972451790633609,
      "lo": 0.9640940508491554,
      "hi": 0.9997951448559698,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "self",
      "value": 0.9393939393939393,
      "lo": 0.6593196035093029,
      "hi": 0.9920090012763662,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "self",
      "value": 0.9724517906336089,
      "lo": 0.925732299627971,
      "hi": 0.9900959389505827,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "self",
      "value": 0.9496124031007752,
      "lo": 0.897119341563786,
      "hi": 0.9921591427268582,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.991111111111111,
      "lo": 0.9355304426628702,
      "hi": 0.9988341387206848,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.996376811594203,
      "lo": 0.9532321227978544,
      "hi": 0.9997305559548253,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9090909090909091,
      "lo": 0.6226415635484043,
      "hi": 0.9837678271141151,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9966666666666666,
      "lo": 0.9568343423635072,
      "hi": 0.9997521160842201,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9733333333333333,
      "lo": 0.9202310017580144,
      "hi": 0.9914151532727056,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9583333333333334,
      "lo": 0.8910256410256411,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.9629629629629631,
      "lo": 0.7679464317540228,
      "hi": 0.9951283611657391,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.9682539682539681,
      "lo": 0.7958607110560707,
      "hi": 0.9958265569349456,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.9166666666666666,
      "lo": 0.8333333333333334,
      "hi": 0.9818181818181818,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "self",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9917695473251028,
      "lo": 0.9400857569362633,
      "hi": 0.9989205705602497,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9962962962962963,
      "lo": 0.9522356269965258,
      "hi": 0.9997245668877723,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "self",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9966329966329965,
      "lo": 0.9564147063138855,
      "hi": 0.9997496116658817,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.973063973063973,
      "lo": 0.9194589814850982,
      "hi": 0.9913280468278327,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "self",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9166666666666666,
      "lo": 0.6900615298103708,
      "hi": 0.9819320697442654,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9393939393939393,
      "lo": 0.6593196035093029,
      "hi": 0.9920090012763662,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9000000000000001,
      "lo": 0.6989663547715128,
      "hi": 0.9721335187862319,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.9496124031007752,
      "lo": 0.8888888888888888,
      "hi": 0.9923371647509579,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9863945578231291,
      "lo": 0.903854800411718,
      "hi": 0.9982146679656219,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9946236559139786,
      "lo": 0.931930460479973,
      "hi": 0.9996001348606047,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "self",
      "value": 1,
      "lo": 0.9299533801014687,
      "hi": 1,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9952380952380951,
      "lo": 0.9393027381160542,
      "hi": 0.9996458476871096,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.9809523809523808,
      "lo": 0.9159558711659863,
      "hi": 0.9959076592774709,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "self",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9913419913419913,
      "lo": 0.9371239399782889,
      "hi": 0.9988644472982802,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.996031746031746,
      "lo": 0.9489739527692823,
      "hi": 0.9997048880891898,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "self",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9964157706093189,
      "lo": 0.9537149395960378,
      "hi": 0.9997334538682969,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9713261648745519,
      "lo": 0.9144937860329291,
      "hi": 0.990765879963894,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "self",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9913419913419913,
      "lo": 0.9371239399782889,
      "hi": 0.9988644472982802,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.996031746031746,
      "lo": 0.9489739527692823,
      "hi": 0.9997048880891898,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9964157706093189,
      "lo": 0.9537149395960378,
      "hi": 0.9997334538682969,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9713261648745519,
      "lo": 0.9144937860329291,
      "hi": 0.990765879963894,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.991869918699187,
      "lo": 0.9407831209904305,
      "hi": 0.9989337451355684,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9962546816479402,
      "lo": 0.9517212833373914,
      "hi": 0.9997214713906728,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9965986394557822,
      "lo": 0.9559868312363212,
      "hi": 0.9997470561258187,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9727891156462585,
      "lo": 0.9186718751836159,
      "hi": 0.9912391545652709,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9841269841269841,
      "lo": 0.9512195121951219,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.9710144927536232,
      "lo": 0.8110184487836904,
      "hi": 0.9961905338354728,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.9166666666666666,
      "lo": 0.8181818181818182,
      "hi": 0.9791666666666666,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9929824561403509,
      "lo": 0.9485657733553275,
      "hi": 0.9990797570145254,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9970238095238095,
      "lo": 0.9613049808095904,
      "hi": 0.9997786801417214,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9166666666666666,
      "lo": 0.6900615298103708,
      "hi": 0.9819320697442654,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9972451790633609,
      "lo": 0.9640940508491554,
      "hi": 0.9997951448559698,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9393939393939393,
      "lo": 0.6593196035093029,
      "hi": 0.9920090012763662,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9724517906336089,
      "lo": 0.925732299627971,
      "hi": 0.9900959389505827,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9496124031007752,
      "lo": 0.8971119929453263,
      "hi": 0.9923371647509579,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9919678714859437,
      "lo": 0.9414644387200456,
      "hi": 0.9989466019936749,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9962962962962963,
      "lo": 0.9522356269965258,
      "hi": 0.9997245668877723,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9966329966329965,
      "lo": 0.9564147063138855,
      "hi": 0.9997496116658817,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9696969696969697,
      "lo": 0.9146631979389799,
      "hi": 0.9896413604215459,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9512195121951219,
      "lo": 0.8833333333333333,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "self",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.9689922480620154,
      "lo": 0.9024390243902439,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9887005649717513,
      "lo": 0.9191356019930423,
      "hi": 0.9985176121248422,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9953703703703705,
      "lo": 0.94090287231164,
      "hi": 0.9996556881714992,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "self",
      "value": 1,
      "lo": 0.93982814785791,
      "hi": 0.9999999999999998,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9958847736625513,
      "lo": 0.9471701658972359,
      "hi": 0.9996939551348129,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9835390946502056,
      "lo": 0.9268260532345567,
      "hi": 0.9964646871908851,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "self",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.9,
      "lo": 0.6989663547715128,
      "hi": 0.9721335187862319,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.9302325581395349,
      "lo": 0.8416666666666667,
      "hi": 0.9864583333333314,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "self",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9878787878787878,
      "lo": 0.9136456688540908,
      "hi": 0.9984096700559038,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9943502824858758,
      "lo": 0.9286821264270523,
      "hi": 0.9995797953684963,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.9312077638761376,
      "hi": 1,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9950980392156862,
      "lo": 0.937613542532009,
      "hi": 0.9996354281687053,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.980392156862745,
      "lo": 0.9136229260308151,
      "hi": 0.9957869663322545,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "self",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "all",
      "target": "self",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "all",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "all",
      "target": "self",
      "value": 0.04700854700854701,
      "lo": 0.017725492285507877,
      "hi": 0.11881645497511259,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "all",
      "target": "self",
      "value": 0.6005509641873279,
      "lo": 0.5114851987583597,
      "hi": 0.6834286829216241,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.04700854700854701,
      "lo": 0.017725492285507877,
      "hi": 0.11881645497511259,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.6333333333333334,
      "lo": 0.5355836185816258,
      "hi": 0.7212181152298447,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.4074074074074074,
      "lo": 0.21698710238109628,
      "hi": 0.6303979390349514,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.5454545454545454,
      "lo": 0.280091537409322,
      "hi": 0.7872872837754024,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.5333333333333333,
      "lo": 0.32763499420531195,
      "hi": 0.7282899952578333,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.5079365079365079,
      "lo": 0.3101093144552433,
      "hi": 0.7033091138157908,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.053921568627450976,
      "lo": 0.020356855767480246,
      "hi": 0.13519110132395523,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.6262626262626263,
      "lo": 0.5279244532290264,
      "hi": 0.7151681699861687,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.33333333333333337,
      "lo": 0.16906782991982028,
      "hi": 0.551307222764453,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.3333333333333333,
      "lo": 0.12697541213017843,
      "hi": 0.632202187824118,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.05472636815920398,
      "lo": 0.020663613346552402,
      "hi": 0.13708006302679593,
      "n": 67,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.7,
      "lo": 0.5845568276122731,
      "hi": 0.79463394742362,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.2588329669680317,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.5757575757575757,
      "lo": 0.30394425864475716,
      "hi": 0.8083537766631168,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.7333333333333333,
      "lo": 0.42677693205514144,
      "hi": 0.9103744280088436,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.05555555555555555,
      "lo": 0.020979758469971653,
      "hi": 0.1390225144309539,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.6594982078853047,
      "lo": 0.5585786236130181,
      "hi": 0.7477640010018765,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.05555555555555555,
      "lo": 0.020979758469971653,
      "hi": 0.1390225144309539,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.6594982078853047,
      "lo": 0.5585786236130181,
      "hi": 0.7477640010018765,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.5,
      "lo": 0.26799202452413634,
      "hi": 0.7320079754758637,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.05555555555555555,
      "lo": 0.020979758469971653,
      "hi": 0.1390225144309539,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.6360544217687075,
      "lo": 0.5373376905929841,
      "hi": 0.7245072100541776,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.44927536231884063,
      "lo": 0.26821703654842305,
      "hi": 0.6448527653233596,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.04700854700854701,
      "lo": 0.017725492285507877,
      "hi": 0.11881645497511259,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.6005509641873279,
      "lo": 0.5114851987583597,
      "hi": 0.6834286829216241,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.5,
      "lo": 0.26799202452413634,
      "hi": 0.7320079754758637,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.05472636815920398,
      "lo": 0.020663613346552402,
      "hi": 0.13708006302679593,
      "n": 67,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.632996632996633,
      "lo": 0.5347427962752133,
      "hi": 0.7213147668447922,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.4333333333333333,
      "lo": 0.24487520800487064,
      "hi": 0.6432748130688386,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.04700854700854701,
      "lo": 0.017725492285507877,
      "hi": 0.11881645497511259,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.6831275720164609,
      "lo": 0.5754888355221031,
      "hi": 0.7741829768092345,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.2727272727272727,
      "lo": 0.09746059290024889,
      "hi": 0.5656453011761291,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.4333333333333333,
      "lo": 0.24487520800487064,
      "hi": 0.6432748130688386,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=commons",
      "target": "self",
      "value": 0.5897435897435896,
      "lo": 0.33346465450382823,
      "hi": 0.805082329945418,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.7333333333333333,
      "lo": 0.42677693205514144,
      "hi": 0.9103744280088436,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.05555555555555555,
      "lo": 0.020979758469971653,
      "hi": 0.1390225144309539,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.7009803921568627,
      "lo": 0.5838219945703167,
      "hi": 0.796645409377498,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "self",
      "value": 0.8753086419753087,
      "lo": 0.7956635802469136,
      "hi": 0.9447530864197531,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "self",
      "value": 0.575,
      "lo": 0.425,
      "hi": 0.775,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "self",
      "value": 0.675,
      "lo": 0.525,
      "hi": 0.875,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "self",
      "value": 0.8,
      "lo": 0.6243750000000011,
      "hi": 0.9,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "self",
      "value": 0.6,
      "lo": 0.44595893660346186,
      "hi": 0.7365167431570808,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "self",
      "value": 0.024691358024691357,
      "lo": 0.006797587423664028,
      "hi": 0.08562725922196524,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "self",
      "value": 0.5,
      "lo": 0.35199526933465386,
      "hi": 0.6480047306653461,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "self",
      "value": 0.004115226337448559,
      "lo": 0.0003060448651870523,
      "hi": 0.052829834102763824,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.5,
      "lo": 0.2992980081982123,
      "hi": 0.7007019918017877,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.3,
      "lo": 0.1454772448676043,
      "hi": 0.5189728183535235,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.9027777777777778,
      "lo": 0.75,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.39062208887279953,
      "hi": 0.8618799089087867,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.39062208887279953,
      "hi": 0.8618799089087867,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.8584004024144869,
      "lo": 0.753760060362173,
      "hi": 0.9466863682092556,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.5357142857142857,
      "lo": 0.35714285714285715,
      "hi": 0.7857142857142857,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.6428571428571429,
      "lo": 0.4642857142857143,
      "hi": 0.8571428571428571,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.7857142857142857,
      "lo": 0.5714285714285714,
      "hi": 0.9285714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.5714285714285714,
      "lo": 0.3907078562746876,
      "hi": 0.734914528758763,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.028169014084507043,
      "lo": 0.007759263582683522,
      "hi": 0.0970150011664947,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.42857142857142855,
      "lo": 0.26508547124123694,
      "hi": 0.6092921437253123,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.004694835680751174,
      "lo": 0.0003491627506430964,
      "hi": 0.059886508204961886,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.8414705882352941,
      "lo": 0.7217573529411765,
      "hi": 0.94,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.52,
      "lo": 0.32,
      "hi": 0.8,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.64,
      "lo": 0.44,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.76,
      "lo": 0.52,
      "hi": 0.92,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.56,
      "lo": 0.3706733186979878,
      "hi": 0.7333436111893266,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.029411764705882353,
      "lo": 0.008103179543129883,
      "hi": 0.10104631365223063,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.4,
      "lo": 0.23403302377747973,
      "hi": 0.5926054264103301,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.8414705882352941,
      "lo": 0.7238161764705883,
      "hi": 0.9426617647058823,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.52,
      "lo": 0.32,
      "hi": 0.8,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.64,
      "lo": 0.44,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.76,
      "lo": 0.52,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.56,
      "lo": 0.3706733186979878,
      "hi": 0.7333436111893266,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.029411764705882353,
      "lo": 0.008103179543129883,
      "hi": 0.10104631365223063,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.4,
      "lo": 0.23403302377747973,
      "hi": 0.5926054264103301,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.8654411764705883,
      "lo": 0.7634313725490196,
      "hi": 0.949515931372549,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.5666666666666667,
      "lo": 0.4,
      "hi": 0.8,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.5,
      "hi": 0.8674999999999955,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.8,
      "lo": 0.5666666666666667,
      "hi": 0.9333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.6,
      "lo": 0.42320360253322475,
      "hi": 0.7540937188319815,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.029411764705882353,
      "lo": 0.008103179543129883,
      "hi": 0.10104631365223063,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.4666666666666667,
      "lo": 0.30232388907699753,
      "hi": 0.638577003801267,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.9038461538461539,
      "lo": 0.7422115384615386,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.6,
      "lo": 0.3,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.6,
      "lo": 0.3,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.8,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.6,
      "lo": 0.31267376973365824,
      "hi": 0.8318196702937638,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.6,
      "lo": 0.31267376973365824,
      "hi": 0.8318196702937638,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.8753086419753087,
      "lo": 0.7939814814814815,
      "hi": 0.9469212962962963,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.575,
      "lo": 0.425,
      "hi": 0.775,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.675,
      "lo": 0.525,
      "hi": 0.875,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.8,
      "lo": 0.6,
      "hi": 0.9,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.6,
      "lo": 0.44595893660346186,
      "hi": 0.7365167431570808,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.024691358024691357,
      "lo": 0.006797587423664028,
      "hi": 0.08562725922196524,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.5,
      "lo": 0.35199526933465386,
      "hi": 0.6480047306653461,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.004115226337448559,
      "lo": 0.0003060448651870523,
      "hi": 0.052829834102763824,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.8596618357487923,
      "lo": 0.7565096618357487,
      "hi": 0.9468719806763284,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.5666666666666667,
      "lo": 0.4,
      "hi": 0.8,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.5,
      "hi": 0.8666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.7666666666666667,
      "lo": 0.5666666666666667,
      "hi": 0.9,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.6,
      "lo": 0.42320360253322475,
      "hi": 0.7540937188319815,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.028985507246376812,
      "lo": 0.007985202692364197,
      "hi": 0.09966583763065553,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.4666666666666667,
      "lo": 0.30232388907699753,
      "hi": 0.638577003801267,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.004830917874396135,
      "lo": 0.00035928654494127993,
      "hi": 0.061530268666438445,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.1,
      "lo": 0.017876213095072896,
      "hi": 0.4041500267952385,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.029411764705882353,
      "lo": 0.008103179543129883,
      "hi": 0.10104631365223063,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.004901960784313725,
      "lo": 0.0003645718312947112,
      "hi": 0.06238645746799082,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.9166666666666666,
      "lo": 0.7198571898005176,
      "hi": 0.9792051784887997,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.7833333333333333,
      "lo": 0.5661276081063967,
      "hi": 0.909234802330339,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.2833333333333333,
      "lo": 0.13402625504293345,
      "hi": 0.5024613134466217,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.21666666666666665,
      "lo": 0.09076519766966104,
      "hi": 0.43387239189360327,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.024691358024691357,
      "lo": 0.006797587423664028,
      "hi": 0.08562725922196524,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.004115226337448559,
      "lo": 0.0003060448651870523,
      "hi": 0.052829834102763824,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.904320987654321,
      "lo": 0.7904166666666667,
      "hi": 0.9876543209876543,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7,
      "lo": 0.5,
      "hi": 0.9,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7,
      "lo": 0.5,
      "hi": 0.95,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.85,
      "lo": 0.6,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7,
      "lo": 0.4810271816464765,
      "hi": 0.8545227551323956,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.7,
      "lo": 0.4810271816464765,
      "hi": 0.8545227551323956,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.754320987654321,
      "lo": 0.5370061728395062,
      "hi": 0.9296450617283949,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.6,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.9382716049382716,
      "lo": 0.8382716049382716,
      "hi": 0.9962962962962963,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.4,
      "lo": 0.1,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.9,
      "lo": 0.6,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.1,
      "lo": 0.017876213095072896,
      "hi": 0.4041500267952385,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.8310886644219978,
      "lo": 0.7003226711560046,
      "hi": 0.946415544332211,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.5909090909090909,
      "lo": 0.4090909090909091,
      "hi": 0.8181818181818182,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.6818181818181818,
      "lo": 0.5,
      "hi": 0.8636363636363636,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.7272727272727273,
      "lo": 0.5,
      "hi": 0.8636363636363636,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.6060606060606061,
      "lo": 0.4012436519661464,
      "hi": 0.7793447079653582,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.5454545454545454,
      "lo": 0.3465979532073494,
      "hi": 0.7307970581918668,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.9293552812071331,
      "lo": 0.8405349794238683,
      "hi": 0.9886831275720165,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.5555555555555556,
      "lo": 0.3333333333333333,
      "hi": 0.7777777777777778,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.6666666666666666,
      "lo": 0.4444444444444444,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.8888888888888888,
      "lo": 0.6111111111111112,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.5925925925925927,
      "lo": 0.36960206096504866,
      "hi": 0.7830128976189038,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.4444444444444444,
      "lo": 0.24559518127005633,
      "hi": 0.6628358435795723,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "all",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "all",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "all",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "all",
      "target": "self",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.005952380952380952,
      "lo": 0.0004427241870828963,
      "hi": 0.0748917609040762,
      "n": 56,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.9841269841269842,
      "lo": 0.81970547446205,
      "hi": 0.998818650071035,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.09523809523809523,
      "lo": 0.02651876743807452,
      "hi": 0.2891413907391826,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.006802721088435374,
      "lo": 0.0005059980953141668,
      "hi": 0.08480817732626389,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.2588329669680317,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.0606060606060606,
      "lo": 0.007990998723633791,
      "hi": 0.3406803964906971,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.0070921985815602835,
      "lo": 0.0005275397246634964,
      "hi": 0.0881427225362974,
      "n": 47,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.9777777777777777,
      "lo": 0.8500057891447929,
      "hi": 0.9970814129334143,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "self",
      "value": 0.9669421487603306,
      "lo": 0.9180772072778853,
      "hi": 0.9870708186058748,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "self",
      "value": 0.9917355371900827,
      "lo": 0.9546693563957512,
      "hi": 0.9985396266145802,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "self",
      "value": 0.07265013774104676,
      "lo": 0.05008264462809913,
      "hi": 0.12636349862258944,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "self",
      "value": 815.5555555555555,
      "lo": 369.19444444444446,
      "hi": 1400.3703703703704,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "self",
      "value": 569.2592592592592,
      "lo": 383.3333333333333,
      "hi": 785.9259259259259,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self",
      "value": 459.3333333333333,
      "lo": 40.833333333333336,
      "hi": 1081.7291666666665,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self",
      "value": 119.88888888888887,
      "lo": 38.33333333333333,
      "hi": 267.1666666666667,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "self",
      "value": 2398.765432098766,
      "lo": 1557.3122427983542,
      "hi": 3347.1193415637854,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "self",
      "value": 2566.4609053497943,
      "lo": 1816.460905349794,
      "hi": 3299.786522633744,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "self",
      "value": 543.5555555555555,
      "lo": 130.66666666666666,
      "hi": 1118.9629629629628,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "self",
      "value": 229.25925925925927,
      "lo": 125.33333333333336,
      "hi": 413.1111111111111,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "self",
      "value": 1143.5555555555554,
      "lo": 660.7592592592591,
      "hi": 1771.4444444444441,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "self",
      "value": 979.2592592592592,
      "lo": 675.9259259259261,
      "hi": 1297.7592592592596,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "self",
      "value": 595.5555555555557,
      "lo": 341.6666666666667,
      "hi": 938.1666666666665,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "self",
      "value": 532.5925925925926,
      "lo": 366.6481481481481,
      "hi": 699.2592592592592,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "self",
      "value": 2184.4444444444443,
      "lo": 408.1250000000003,
      "hi": 4631.620370370363,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "self",
      "value": 797.4074074074074,
      "lo": 391.66666666666674,
      "hi": 1442.2222222222222,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "self",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "self",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "self",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "self",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "self",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "self",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "self",
      "value": 0.3333333333333333,
      "lo": 0.16906782991982022,
      "hi": 0.5513072227644529,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "all",
      "target": "self",
      "value": 0.55,
      "lo": 0.39829091798932054,
      "hi": 0.6929469218909508,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.6,
      "lo": 0.3865815007622531,
      "hi": 0.781193467627183,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "genuine_with_proof_rate",
      "stratum": "all",
      "target": "self",
      "value": 0.16049382716049382,
      "lo": 0.09626154226711317,
      "hi": 0.25547049105119335,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "self",
      "value": 4700,
      "lo": 4700,
      "hi": 4700,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "self",
      "value": 10518,
      "lo": 10518,
      "hi": 10518,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "self",
      "value": 12611.880000000001,
      "lo": 12611.880000000001,
      "hi": 12611.880000000001,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "self",
      "value": 0.0010680604856512137,
      "lo": 0.0010680604856512137,
      "hi": 0.0010680604856512137,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 4630.5,
      "lo": 4630.5,
      "hi": 4630.5,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 10152.099999999999,
      "lo": 10152.099999999999,
      "hi": 10152.099999999999,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 11447.250000000007,
      "lo": 11447.250000000007,
      "hi": 11447.250000000007,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0.0010554471794871794,
      "lo": 0.0010554471794871794,
      "hi": 0.0010554471794871794,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 6044,
      "lo": 6044,
      "hi": 6044,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 11018.599999999991,
      "lo": 11018.599999999991,
      "hi": 11018.599999999991,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 12588.8,
      "lo": 12588.8,
      "hi": 12588.8,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0.0011381629629629627,
      "lo": 0.0011381629629629627,
      "hi": 0.0011381629629629627,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 6992,
      "lo": 6992,
      "hi": 6992,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 8940,
      "lo": 8940,
      "hi": 8940,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 9315.2,
      "lo": 9315.2,
      "hi": 9315.2,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0.001143990476190476,
      "lo": 0.001143990476190476,
      "hi": 0.001143990476190476,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "self",
      "value": 5263.5,
      "lo": 5263.5,
      "hi": 5263.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "self",
      "value": 11079.299999999997,
      "lo": 11079.299999999997,
      "hi": 11079.299999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "self",
      "value": 12574.4,
      "lo": 12574.4,
      "hi": 12574.4,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0.0011091716666666667,
      "lo": 0.0011091716666666667,
      "hi": 0.0011091716666666667,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "self",
      "value": 6095,
      "lo": 6095,
      "hi": 6095,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "self",
      "value": 9878.4,
      "lo": 9878.4,
      "hi": 9878.4,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "self",
      "value": 10395.080000000002,
      "lo": 10395.080000000002,
      "hi": 10395.080000000002,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0.0011334906666666674,
      "lo": 0.0011334906666666674,
      "hi": 0.0011334906666666674,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "self",
      "value": 4520,
      "lo": 4520,
      "hi": 4520,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "self",
      "value": 10866.7,
      "lo": 10866.7,
      "hi": 10866.7,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "self",
      "value": 12671.750000000002,
      "lo": 12671.750000000002,
      "hi": 12671.750000000002,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0.0010545241666666666,
      "lo": 0.0010545241666666666,
      "hi": 0.0010545241666666666,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 4307,
      "lo": 4307,
      "hi": 4307,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 9742.599999999999,
      "lo": 9742.599999999999,
      "hi": 9742.599999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 10382.119999999999,
      "lo": 10382.119999999999,
      "hi": 10382.119999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0.0010221400000000002,
      "lo": 0.0010221400000000002,
      "hi": 0.0010221400000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 4767,
      "lo": 4767,
      "hi": 4767,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 9956.65,
      "lo": 9956.65,
      "hi": 9956.65,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 10904.769999999999,
      "lo": 10904.769999999999,
      "hi": 10904.769999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0.0010679266666666668,
      "lo": 0.0010679266666666668,
      "hi": 0.0010679266666666668,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 4260.5,
      "lo": 4260.5,
      "hi": 4260.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 8581.3,
      "lo": 8581.3,
      "hi": 8581.3,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 9948.390000000001,
      "lo": 9948.390000000001,
      "hi": 9948.390000000001,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0.0010383566666666666,
      "lo": 0.0010383566666666666,
      "hi": 0.0010383566666666666,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 4756,
      "lo": 4756,
      "hi": 4756,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 10913.699999999999,
      "lo": 10913.699999999999,
      "hi": 10913.699999999999,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 12269.409999999998,
      "lo": 12269.409999999998,
      "hi": 12269.409999999998,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0.001071086666666667,
      "lo": 0.001071086666666667,
      "hi": 0.001071086666666667,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "self",
      "value": 4646.5,
      "lo": 4646.5,
      "hi": 4646.5,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "self",
      "value": 10098.149999999992,
      "lo": 10098.149999999992,
      "hi": 10098.149999999992,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "self",
      "value": 12635.96,
      "lo": 12635.96,
      "hi": 12635.96,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0.0010661209523809524,
      "lo": 0.0010661209523809524,
      "hi": 0.0010661209523809524,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 4448,
      "lo": 4448,
      "hi": 4448,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 8684.199999999999,
      "lo": 8684.199999999999,
      "hi": 8684.199999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 9234.119999999999,
      "lo": 9234.119999999999,
      "hi": 9234.119999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0.0009976454545454544,
      "lo": 0.0009976454545454544,
      "hi": 0.0009976454545454544,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 7113.5,
      "lo": 7113.5,
      "hi": 7113.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 12251.899999999998,
      "lo": 12251.899999999998,
      "hi": 12251.899999999998,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 12646.4,
      "lo": 12646.4,
      "hi": 12646.4,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0.0011799866666666666,
      "lo": 0.0011799866666666666,
      "hi": 0.0011799866666666666,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "self",
      "value": 5087,
      "lo": 5087,
      "hi": 5087,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "self",
      "value": 7912.549999999999,
      "lo": 7912.549999999999,
      "hi": 7912.549999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "self",
      "value": 8325.710000000001,
      "lo": 8325.710000000001,
      "hi": 8325.710000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "self",
      "value": 0.00105345,
      "lo": 0.00105345,
      "hi": 0.00105345,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "self",
      "value": 4592,
      "lo": 4592,
      "hi": 4592,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "self",
      "value": 10850.8,
      "lo": 10850.8,
      "hi": 10850.8,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "self",
      "value": 12665,
      "lo": 12665,
      "hi": 12665,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "self",
      "value": 0.0010593644986449866,
      "lo": 0.0010593644986449866,
      "hi": 0.0010593644986449866,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 5087,
      "lo": 5087,
      "hi": 5087,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 7912.549999999999,
      "lo": 7912.549999999999,
      "hi": 7912.549999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 8325.710000000001,
      "lo": 8325.710000000001,
      "hi": 8325.710000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0.00105345,
      "lo": 0.00105345,
      "hi": 0.00105345,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 4592,
      "lo": 4592,
      "hi": 4592,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 10850.8,
      "lo": 10850.8,
      "hi": 10850.8,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 12665,
      "lo": 12665,
      "hi": 12665,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0.0010593644986449866,
      "lo": 0.0010593644986449866,
      "hi": 0.0010593644986449866,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 4520,
      "lo": 4520,
      "hi": 4520,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 10793.04999999999,
      "lo": 10793.04999999999,
      "hi": 10793.04999999999,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 12653.750000000002,
      "lo": 12653.750000000002,
      "hi": 12653.750000000002,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0.0010537945312500002,
      "lo": 0.0010537945312500002,
      "hi": 0.0010537945312500002,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "self",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 6514,
      "lo": 6514,
      "hi": 6514,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 9907.8,
      "lo": 9907.8,
      "hi": 9907.8,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 10416.559999999998,
      "lo": 10416.559999999998,
      "hi": 10416.559999999998,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0.001147453623188406,
      "lo": 0.001147453623188406,
      "hi": 0.001147453623188406,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "self",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 4700,
      "lo": 4700,
      "hi": 4700,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 10518,
      "lo": 10518,
      "hi": 10518,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 12611.880000000001,
      "lo": 12611.880000000001,
      "hi": 12611.880000000001,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0.0010680604856512137,
      "lo": 0.0010680604856512137,
      "hi": 0.0010680604856512137,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "self",
      "value": 6850,
      "lo": 6850,
      "hi": 6850,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "self",
      "value": 8188.699999999999,
      "lo": 8188.699999999999,
      "hi": 8188.699999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "self",
      "value": 8631.34,
      "lo": 8631.34,
      "hi": 8631.34,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0.0010867583333333333,
      "lo": 0.0010867583333333333,
      "hi": 0.0010867583333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 5498.5,
      "lo": 5498.5,
      "hi": 5498.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 10048.05,
      "lo": 10048.05,
      "hi": 10048.05,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 10835.210000000001,
      "lo": 10835.210000000001,
      "hi": 10835.210000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0.0011134666666666666,
      "lo": 0.0011134666666666666,
      "hi": 0.0011134666666666666,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "self",
      "value": 5586,
      "lo": 5586,
      "hi": 5586,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "self",
      "value": 12326.6,
      "lo": 12326.6,
      "hi": 12326.6,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "self",
      "value": 12653.6,
      "lo": 12653.6,
      "hi": 12653.6,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0.0011563222222222222,
      "lo": 0.0011563222222222222,
      "hi": 0.0011563222222222222,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "self",
      "value": 4562,
      "lo": 4562,
      "hi": 4562,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "self",
      "value": 10752.099999999997,
      "lo": 10752.099999999997,
      "hi": 10752.099999999997,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "self",
      "value": 12651.499999999998,
      "lo": 12651.499999999998,
      "hi": 12651.499999999998,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "self",
      "value": 0.001061884237726098,
      "lo": 0.001061884237726098,
      "hi": 0.001061884237726098,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "self",
      "value": 5087,
      "lo": 5087,
      "hi": 5087,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "self",
      "value": 7912.549999999999,
      "lo": 7912.549999999999,
      "hi": 7912.549999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "self",
      "value": 8325.710000000001,
      "lo": 8325.710000000001,
      "hi": 8325.710000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0.00105345,
      "lo": 0.00105345,
      "hi": 0.00105345,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "self",
      "value": 6160,
      "lo": 6160,
      "hi": 6160,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "self",
      "value": 9916.949999999999,
      "lo": 9916.949999999999,
      "hi": 9916.949999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "self",
      "value": 10224.99,
      "lo": 10224.99,
      "hi": 10224.99,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0.0011253,
      "lo": 0.0011253,
      "hi": 0.0011253,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 4020.5,
      "lo": 4020.5,
      "hi": 4020.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 9805.349999999995,
      "lo": 9805.349999999995,
      "hi": 9805.349999999995,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 11000.09,
      "lo": 11000.09,
      "hi": 11000.09,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0.0009633208333333335,
      "lo": 0.0009633208333333335,
      "hi": 0.0009633208333333335,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "self",
      "value": 6390,
      "lo": 6390,
      "hi": 6390,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "self",
      "value": 10160.9,
      "lo": 10160.9,
      "hi": 10160.9,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "self",
      "value": 10560.18,
      "lo": 10560.18,
      "hi": 10560.18,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0.0011288066666666667,
      "lo": 0.0011288066666666667,
      "hi": 0.0011288066666666667,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 6992,
      "lo": 6992,
      "hi": 6992,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 8940,
      "lo": 8940,
      "hi": 8940,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 9315.2,
      "lo": 9315.2,
      "hi": 9315.2,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0.001143990476190476,
      "lo": 0.001143990476190476,
      "hi": 0.001143990476190476,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 4245,
      "lo": 4245,
      "hi": 4245,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 11079.299999999997,
      "lo": 11079.299999999997,
      "hi": 11079.299999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 12574.4,
      "lo": 12574.4,
      "hi": 12574.4,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0.0011123466666666667,
      "lo": 0.0011123466666666667,
      "hi": 0.0011123466666666667,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "self",
      "value": 4644,
      "lo": 4644,
      "hi": 4644,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "self",
      "value": 10502.999999999998,
      "lo": 10502.999999999998,
      "hi": 10502.999999999998,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "self",
      "value": 12623.08,
      "lo": 12623.08,
      "hi": 12623.08,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0.0010606771771771775,
      "lo": 0.0010606771771771775,
      "hi": 0.0010606771771771775,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 5413,
      "lo": 5413,
      "hi": 5413,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 10102,
      "lo": 10102,
      "hi": 10102,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 10744.289999999997,
      "lo": 10744.289999999997,
      "hi": 10744.289999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0.0010647516666666664,
      "lo": 0.0010647516666666664,
      "hi": 0.0010647516666666664,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "self",
      "value": 6433,
      "lo": 6433,
      "hi": 6433,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "self",
      "value": 9816.6,
      "lo": 9816.6,
      "hi": 9816.6,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "self",
      "value": 10129.859999999999,
      "lo": 10129.859999999999,
      "hi": 10129.859999999999,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "self",
      "value": 0.001132779487179487,
      "lo": 0.001132779487179487,
      "hi": 0.001132779487179487,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 3940,
      "lo": 3940,
      "hi": 3940,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 9452.05,
      "lo": 9452.05,
      "hi": 9452.05,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 10292.010000000002,
      "lo": 10292.010000000002,
      "hi": 10292.010000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.0010242333333333334,
      "lo": 0.0010242333333333334,
      "hi": 0.0010242333333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 4773,
      "lo": 4773,
      "hi": 4773,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 7134.8,
      "lo": 7134.8,
      "hi": 7134.8,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 7233.360000000001,
      "lo": 7233.360000000001,
      "hi": 7233.360000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0.0010536333333333334,
      "lo": 0.0010536333333333334,
      "hi": 0.0010536333333333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 7113.5,
      "lo": 7113.5,
      "hi": 7113.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 12251.899999999998,
      "lo": 12251.899999999998,
      "hi": 12251.899999999998,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 12646.4,
      "lo": 12646.4,
      "hi": 12646.4,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0.0011799866666666666,
      "lo": 0.0011799866666666666,
      "hi": 0.0011799866666666666,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 4767,
      "lo": 4767,
      "hi": 4767,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 8525.349999999999,
      "lo": 8525.349999999999,
      "hi": 8525.349999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 8789.869999999999,
      "lo": 8789.869999999999,
      "hi": 8789.869999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0.0010357555555555553,
      "lo": 0.0010357555555555553,
      "hi": 0.0010357555555555553,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 5993,
      "lo": 5993,
      "hi": 5993,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 10660,
      "lo": 10660,
      "hi": 10660,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 11137.6,
      "lo": 11137.6,
      "hi": 11137.6,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0.0010556809523809526,
      "lo": 0.0010556809523809526,
      "hi": 0.0010556809523809526,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 4022,
      "lo": 4022,
      "hi": 4022,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 9409,
      "lo": 9409,
      "hi": 9409,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 9993.800000000001,
      "lo": 9993.800000000001,
      "hi": 9993.800000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0.001107747619047619,
      "lo": 0.001107747619047619,
      "hi": 0.001107747619047619,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "self",
      "value": 4520,
      "lo": 4520,
      "hi": 4520,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "self",
      "value": 10656.54999999999,
      "lo": 10656.54999999999,
      "hi": 10656.54999999999,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "self",
      "value": 12663.539999999997,
      "lo": 12663.539999999997,
      "hi": 12663.539999999997,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0.0010511125850340142,
      "lo": 0.0010511125850340142,
      "hi": 0.0010511125850340142,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "self",
      "value": 7678,
      "lo": 7678,
      "hi": 7678,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "self",
      "value": 11352,
      "lo": 11352,
      "hi": 11352,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "self",
      "value": 11766.4,
      "lo": 11766.4,
      "hi": 11766.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0.0011316666666666667,
      "lo": 0.0011316666666666667,
      "hi": 0.0011316666666666667,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 4306,
      "lo": 4306,
      "hi": 4306,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 9982.8,
      "lo": 9982.8,
      "hi": 9982.8,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 10126.16,
      "lo": 10126.16,
      "hi": 10126.16,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0.00106736,
      "lo": 0.00106736,
      "hi": 0.00106736,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 4700,
      "lo": 4700,
      "hi": 4700,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 7848.999999999999,
      "lo": 7848.999999999999,
      "hi": 7848.999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 8364.199999999999,
      "lo": 8364.199999999999,
      "hi": 8364.199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0.0010131733333333334,
      "lo": 0.0010131733333333334,
      "hi": 0.0010131733333333334,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "self",
      "value": 7083,
      "lo": 7083,
      "hi": 7083,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "self",
      "value": 11229.599999999993,
      "lo": 11229.599999999993,
      "hi": 11229.599999999993,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "self",
      "value": 14646.719999999998,
      "lo": 14646.719999999998,
      "hi": 14646.719999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0.0010149533333333332,
      "lo": 0.0010149533333333332,
      "hi": 0.0010149533333333332,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 6428,
      "lo": 6428,
      "hi": 6428,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 11043,
      "lo": 11043,
      "hi": 11043,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 11205.4,
      "lo": 11205.4,
      "hi": 11205.4,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0.0011772266666666665,
      "lo": 0.0011772266666666665,
      "hi": 0.0011772266666666665,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 4307,
      "lo": 4307,
      "hi": 4307,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 9742.599999999999,
      "lo": 9742.599999999999,
      "hi": 9742.599999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 10382.119999999999,
      "lo": 10382.119999999999,
      "hi": 10382.119999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0.0010221400000000002,
      "lo": 0.0010221400000000002,
      "hi": 0.0010221400000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "self",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9894736842105263,
      "lo": 0.9427612985868637,
      "hi": 0.9981394237376521,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9910714285714286,
      "lo": 0.9511515316911152,
      "hi": 0.9984221452967079,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9375,
      "lo": 0.7167126242970107,
      "hi": 0.9888806552353576,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9752066115702479,
      "lo": 0.9296356592312203,
      "hi": 0.9915326856947302,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.8604651162790697,
      "lo": 0.7261391625615764,
      "hi": 0.9655172413793104,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9512761575171942,
      "hi": 1,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.9891304347826086,
      "lo": 0.9409721438693747,
      "hi": 0.9980786709599082,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.9090909090909091,
      "lo": 0.6226415635484043,
      "hi": 0.9837678271141151,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.98,
      "lo": 0.929988209271456,
      "hi": 0.9944980324498376,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.875,
      "lo": 0.6779661016949152,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0.8269230769230769,
      "lo": 0.6037735849056604,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.9876543209876543,
      "lo": 0.9333311840195164,
      "hi": 0.9978173499414611,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.9888888888888889,
      "lo": 0.9397159168824657,
      "hi": 0.9980359158990818,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.9696969696969697,
      "lo": 0.9146631979389799,
      "hi": 0.9896413604215459,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.9375,
      "lo": 0.7167126242970107,
      "hi": 0.9888806552353576,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.8604651162790697,
      "lo": 0.733313953488372,
      "hi": 0.9753086419753086,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.9795918367346939,
      "lo": 0.8930647847660838,
      "hi": 0.9963883274101746,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.9838709677419355,
      "lo": 0.9141327973931,
      "hi": 0.9971471328313782,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9299533801014687,
      "hi": 1,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.9714285714285714,
      "lo": 0.9016774388157609,
      "hi": 0.9921293880545587,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9524815747175658,
      "hi": 0.9999999999999999,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.9880952380952381,
      "lo": 0.935604562492286,
      "hi": 0.9978954169124508,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.978494623655914,
      "lo": 0.9249453736530886,
      "hi": 0.9940825001915952,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9524815747175658,
      "hi": 0.9999999999999999,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.9880952380952381,
      "lo": 0.935604562492286,
      "hi": 0.9978954169124508,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.978494623655914,
      "lo": 0.9249453736530886,
      "hi": 0.9940825001915952,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9552493763098998,
      "hi": 1,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.9887640449438202,
      "lo": 0.9390675378849535,
      "hi": 0.9980138167717437,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.9795918367346939,
      "lo": 0.9286178889362801,
      "hi": 0.994385385844965,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.9047619047619048,
      "lo": 0.7619047619047619,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.9230769230769231,
      "lo": 0.6668604907890041,
      "hi": 0.9862895787574435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.9565217391304348,
      "lo": 0.7900884492974114,
      "hi": 0.9922833338565469,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.8181818181818182,
      "lo": 0.5918135435992579,
      "hi": 0.9791666666666666,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.9894736842105263,
      "lo": 0.9427612985868637,
      "hi": 0.9981394237376521,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.9910714285714286,
      "lo": 0.9511515316911152,
      "hi": 0.9984221452967079,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.9375,
      "lo": 0.7167126242970107,
      "hi": 0.9888806552353576,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.9752066115702479,
      "lo": 0.9296356592312203,
      "hi": 0.9915326856947302,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.8604651162790697,
      "lo": 0.7380494505494507,
      "hi": 0.9663014981273408,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9557646903580262,
      "hi": 1,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.9888888888888889,
      "lo": 0.9397159168824657,
      "hi": 0.9980359158990818,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.9797979797979798,
      "lo": 0.9293096883284993,
      "hi": 0.9944422798892423,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.8536585365853658,
      "lo": 0.7,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0.9534883720930233,
      "lo": 0.8536585365853658,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.9830508474576272,
      "lo": 0.9100427403585771,
      "hi": 0.9970017660816444,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.9861111111111112,
      "lo": 0.9254339785252386,
      "hi": 0.9975440481170943,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.93982814785791,
      "hi": 0.9999999999999998,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.9753086419753086,
      "lo": 0.9143727407780347,
      "hi": 0.9932024125763359,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.7674418604651163,
      "lo": 0.5348837209302325,
      "hi": 0.9523809523809523,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0.9230769230769231,
      "lo": 0.6668604907890041,
      "hi": 0.9862895787574435,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9347150988829137,
      "hi": 1,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.9830508474576272,
      "lo": 0.9100427403585771,
      "hi": 0.9970017660816444,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9312077638761376,
      "hi": 1,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.9852941176470589,
      "lo": 0.9212902687183916,
      "hi": 0.9973993164238933,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.05128205128205128,
      "lo": 0.020121012473896145,
      "hi": 0.1245667654729449,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.674931129476584,
      "lo": 0.5872073936386459,
      "hi": 0.7518893594210516,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.05128205128205128,
      "lo": 0.020121012473896145,
      "hi": 0.1245667654729449,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.7166666666666667,
      "lo": 0.6216113048025036,
      "hi": 0.7956915126411359,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.4444444444444444,
      "lo": 0.24559518127005633,
      "hi": 0.6628358435795723,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0.5454545454545454,
      "lo": 0.280091537409322,
      "hi": 0.7872872837754024,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0.6833333333333333,
      "lo": 0.46474800533957883,
      "hi": 0.8428394367077209,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0.5873015873015873,
      "lo": 0.37973069999602327,
      "hi": 0.7678720109853527,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.058823529411764705,
      "lo": 0.023110765539635758,
      "hi": 0.1417168843310147,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.7003367003367003,
      "lo": 0.603998891251177,
      "hi": 0.7817080709169325,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.36666666666666664,
      "lo": 0.19352634117963496,
      "hi": 0.5827737009677836,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.5,
      "lo": 0.236593090512564,
      "hi": 0.7634069094874361,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.05970149253731343,
      "lo": 0.023459351139819028,
      "hi": 0.14369501041371535,
      "n": 67,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.7571428571428571,
      "lo": 0.6450496077036256,
      "hi": 0.8424813887710942,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.2588329669680317,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0.696969696969697,
      "lo": 0.40668539174663576,
      "hi": 0.8852895000538368,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.8666666666666666,
      "lo": 0.5589289935914743,
      "hi": 0.9708802865090735,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.06060606060606061,
      "lo": 0.023818614832318334,
      "hi": 0.14572908678564217,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.7383512544802866,
      "lo": 0.6408470053165358,
      "hi": 0.8169459056248232,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.06060606060606061,
      "lo": 0.023818614832318334,
      "hi": 0.14572908678564217,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.7383512544802866,
      "lo": 0.6408470053165358,
      "hi": 0.8169459056248232,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.5,
      "lo": 0.26799202452413634,
      "hi": 0.7320079754758637,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.06060606060606061,
      "lo": 0.023818614832318334,
      "hi": 0.14572908678564217,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.7142857142857143,
      "lo": 0.6180933267840759,
      "hi": 0.7943123917352038,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.5072463768115942,
      "lo": 0.317072536938337,
      "hi": 0.6953460627942656,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.3888888888888889,
      "lo": 0.2030524657216362,
      "hi": 0.613809583977621,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.05128205128205128,
      "lo": 0.020121012473896145,
      "hi": 0.1245667654729449,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.674931129476584,
      "lo": 0.5872073936386459,
      "hi": 0.7518893594210516,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.5,
      "lo": 0.26799202452413634,
      "hi": 0.7320079754758637,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.precision",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.5384615384615384,
      "lo": 0.29143795714506004,
      "hi": 0.7679393219046169,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.05970149253731343,
      "lo": 0.023459351139819028,
      "hi": 0.14369501041371535,
      "n": 67,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.7171717171717171,
      "lo": 0.6216388444158312,
      "hi": 0.7964804675143045,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0.55,
      "lo": 0.34208534245034233,
      "hi": 0.7418021417443759,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.05128205128205128,
      "lo": 0.020121012473896145,
      "hi": 0.1245667654729449,
      "n": 78,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.7489711934156378,
      "lo": 0.644746850784168,
      "hi": 0.8306496581157403,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "totals_add_up.recall",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.2727272727272727,
      "lo": 0.09746059290024889,
      "hi": 0.5656453011761291,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.5,
      "lo": 0.2992980081982123,
      "hi": 0.7007019918017877,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0.6666666666666667,
      "lo": 0.4003240999771466,
      "hi": 0.8569774425714541,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0.8666666666666666,
      "lo": 0.5589289935914743,
      "hi": 0.9708802865090735,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "checks",
      "metric": "false_alarm_rate",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.06060606060606061,
      "lo": 0.023818614832318334,
      "hi": 0.14572908678564217,
      "n": 66,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "checks",
      "metric": "coverage",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.7647058823529411,
      "lo": 0.6514483202805676,
      "hi": 0.8496550897970421,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9104938271604939,
      "lo": 0.8385648148148148,
      "hi": 0.9672878086419754,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.675,
      "lo": 0.525,
      "hi": 0.825,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.725,
      "lo": 0.6,
      "hi": 0.925,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.85,
      "lo": 0.65,
      "hi": 0.95,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.5456998118185507,
      "hi": 0.8192515477025347,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.037037037037037035,
      "lo": 0.012675114183298107,
      "hi": 0.10332311306893818,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.65,
      "lo": 0.49505880837257693,
      "hi": 0.7786547112682372,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0.6499999999999999,
      "lo": 0.43285427668523613,
      "hi": 0.8188081758989179,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0.5499999999999999,
      "lo": 0.3420853424503422,
      "hi": 0.7418021417443756,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.39062208887279953,
      "hi": 0.8618799089087867,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.39062208887279953,
      "hi": 0.8618799089087867,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.8790241448692153,
      "lo": 0.7892228370221328,
      "hi": 0.9544894366197183,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.7142857142857143,
      "lo": 0.5357142857142857,
      "hi": 0.8571428571428571,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.7142857142857143,
      "lo": 0.5357142857142857,
      "hi": 0.8928571428571429,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.7857142857142857,
      "lo": 0.5714285714285714,
      "hi": 0.9285714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.7142857142857143,
      "lo": 0.5294071156670428,
      "hi": 0.8474600394333092,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.04225352112676056,
      "lo": 0.014473260620475319,
      "hi": 0.11702416040484681,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.6428571428571429,
      "lo": 0.4583030651442781,
      "hi": 0.7929417049226233,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.8594117647058823,
      "lo": 0.7505661764705883,
      "hi": 0.9470588235294117,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.64,
      "lo": 0.44,
      "hi": 0.84,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.64,
      "lo": 0.44,
      "hi": 0.84,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.76,
      "lo": 0.48,
      "hi": 0.92,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.64,
      "lo": 0.44518497748164865,
      "hi": 0.7975211922554178,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.04411764705882353,
      "lo": 0.01511661970804156,
      "hi": 0.12187195182496394,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.56,
      "lo": 0.3706733186979878,
      "hi": 0.7333436111893266,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.8594117647058823,
      "lo": 0.7538161764705882,
      "hi": 0.9485367647058823,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.64,
      "lo": 0.44,
      "hi": 0.84,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.64,
      "lo": 0.48,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.76,
      "lo": 0.48,
      "hi": 0.88,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.64,
      "lo": 0.44518497748164865,
      "hi": 0.7975211922554178,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.04411764705882353,
      "lo": 0.01511661970804156,
      "hi": 0.12187195182496394,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.56,
      "lo": 0.3706733186979878,
      "hi": 0.7333436111893266,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.8823529411764706,
      "lo": 0.7965625,
      "hi": 0.9563786764705883,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.5,
      "hi": 0.8333333333333334,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.5333333333333333,
      "hi": 0.8674999999999955,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.8,
      "lo": 0.5666666666666667,
      "hi": 0.9333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.6777777777777777,
      "lo": 0.49885882940955356,
      "hi": 0.8163364085730351,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.04411764705882353,
      "lo": 0.01511661970804156,
      "hi": 0.12187195182496394,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.611111111111111,
      "lo": 0.4337683505833143,
      "hi": 0.7632286731558036,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 1,
      "lo": 1,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.7666666666666666,
      "lo": 0.45787114703720166,
      "hi": 0.9274446930359239,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.7666666666666666,
      "lo": 0.45787114703720166,
      "hi": 0.9274446930359239,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.9104938271604939,
      "lo": 0.8475270061728395,
      "hi": 0.966358024691358,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.675,
      "lo": 0.55,
      "hi": 0.85,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.725,
      "lo": 0.6,
      "hi": 0.925,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.85,
      "lo": 0.65,
      "hi": 0.95,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.5456998118185507,
      "hi": 0.8192515477025347,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.037037037037037035,
      "lo": 0.012675114183298107,
      "hi": 0.10332311306893818,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.65,
      "lo": 0.49505880837257693,
      "hi": 0.7786547112682372,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.8828502415458938,
      "lo": 0.7973248792270532,
      "hi": 0.9550724637681159,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.5,
      "hi": 0.8333333333333334,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.5333333333333333,
      "hi": 0.8666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.8,
      "lo": 0.5666666666666667,
      "hi": 0.9333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.6777777777777778,
      "lo": 0.4988588294095537,
      "hi": 0.8163364085730351,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.043478260869565216,
      "lo": 0.014895903896212308,
      "hi": 0.12021202749379145,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.6111111111111112,
      "lo": 0.4337683505833144,
      "hi": 0.7632286731558037,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.36779781217588203,
      "hi": 0.8730245878698215,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0.4666666666666666,
      "lo": 0.21293408575713324,
      "hi": 0.7389014342337259,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.04411764705882353,
      "lo": 0.01511661970804156,
      "hi": 0.12187195182496394,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0.85,
      "lo": 0.6395811352592431,
      "hi": 0.9476312541037835,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.45,
      "lo": 0.2581978582556243,
      "hi": 0.6579146575496577,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.45,
      "lo": 0.2581978582556243,
      "hi": 0.6579146575496577,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.037037037037037035,
      "lo": 0.012675114183298107,
      "hi": 0.10332311306893818,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.9574074074074074,
      "lo": 0.8907407407407407,
      "hi": 0.9975308641975309,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.5,
      "hi": 0.95,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.8,
      "lo": 0.6,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.95,
      "lo": 0.7,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.75,
      "lo": 0.531299122381256,
      "hi": 0.8881382985923343,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.75,
      "lo": 0.531299122381256,
      "hi": 0.8881382985923343,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.8537037037037037,
      "lo": 0.6968981481481482,
      "hi": 0.9827160493827161,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.6,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.6,
      "lo": 0.3,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.6333333333333333,
      "lo": 0.339777586667533,
      "hi": 0.8528803333690298,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.6333333333333333,
      "lo": 0.339777586667533,
      "hi": 0.8528803333690298,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.8734567901234568,
      "lo": 0.7104783950617284,
      "hi": 1,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.36779781217588203,
      "hi": 0.8730245878698215,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.4666666666666666,
      "lo": 0.21293408575713324,
      "hi": 0.7389014342337259,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.8796296296296297,
      "lo": 0.7744037598204265,
      "hi": 0.9660493827160493,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.5909090909090909,
      "lo": 0.4090909090909091,
      "hi": 0.8181818181818182,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.6818181818181818,
      "lo": 0.5,
      "hi": 0.9090909090909091,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.8181818181818182,
      "lo": 0.5454545454545454,
      "hi": 0.9545454545454546,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.6515151515151516,
      "lo": 0.44390149460931216,
      "hi": 0.814081876721409,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.5606060606060607,
      "lo": 0.3600271978878947,
      "hi": 0.7431661506443937,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.9482167352537723,
      "lo": 0.8696759259259259,
      "hi": 0.9965706447187929,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.7777777777777778,
      "lo": 0.5555555555555556,
      "hi": 0.9444444444444444,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.7777777777777778,
      "lo": 0.6111111111111112,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.8888888888888888,
      "lo": 0.6666666666666666,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.7592592592592592,
      "lo": 0.5286549245603085,
      "hi": 0.8986669594747578,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.7592592592592592,
      "lo": 0.5286549245603085,
      "hi": 0.8986669594747578,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.005952380952380952,
      "lo": 0.0004427241870828963,
      "hi": 0.0748917609040762,
      "n": 56,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.9682539682539684,
      "lo": 0.7958607110560711,
      "hi": 0.9958265569349456,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.09523809523809523,
      "lo": 0.02651876743807452,
      "hi": 0.2891413907391826,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.006802721088435374,
      "lo": 0.0005059980953141668,
      "hi": 0.08480817732626389,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.2588329669680317,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0.0606060606060606,
      "lo": 0.007990998723633791,
      "hi": 0.3406803964906971,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.0070921985815602835,
      "lo": 0.0005275397246634964,
      "hi": 0.0881427225362974,
      "n": 47,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.005649717514124294,
      "lo": 0.0004202046315038635,
      "hi": 0.07131787357294792,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "recall",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.9666666666666667,
      "lo": 0.8332960900859082,
      "hi": 0.9940914096183874,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "recall_exact",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.06666666666666667,
      "lo": 0.018477023791270378,
      "hi": 0.2132345836261692,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.0303030303030303,
      "lo": 0.003983156859253684,
      "hi": 0.19626839201551138,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "duplicates",
      "metric": "false_match_rate_genuine",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.007246376811594202,
      "lo": 0.000539013310440345,
      "hi": 0.08991029523766786,
      "n": 46,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.9256198347107438,
      "lo": 0.8646691146497353,
      "hi": 0.9603773160230725,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.0605757575757575,
      "lo": 0.03878044077134985,
      "hi": 0.11223374655647374,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "self-gemini",
      "value": 923.3333333333334,
      "lo": 402.5925925925925,
      "hi": 1580.0648148148146,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "self-gemini",
      "value": 350,
      "lo": 208.33333333333323,
      "hi": 491.66666666666674,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self-gemini",
      "value": 659,
      "lo": 168.94444444444443,
      "hi": 1348.013888888888,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self-gemini",
      "value": 34.99999999999999,
      "lo": 20.833333333333336,
      "hi": 49.166666666666686,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "self-gemini",
      "value": 2098.1481481481483,
      "lo": 1273.343621399178,
      "hi": 2996.9135802469145,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "self-gemini",
      "value": 1749.9999999999998,
      "lo": 1083.3333333333335,
      "hi": 2458.3333333333335,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "self-gemini",
      "value": 719.3333333333333,
      "lo": 226.45185185185196,
      "hi": 1369.261111111111,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "self-gemini",
      "value": 111.99999999999999,
      "lo": 69.3333333333333,
      "hi": 157.33333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "self-gemini",
      "value": 1169.3333333333333,
      "lo": 608.4703703703707,
      "hi": 1866.5319444444442,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "self-gemini",
      "value": 636.9999999999999,
      "lo": 394.33333333333337,
      "hi": 894.8333333333331,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "self-gemini",
      "value": 593.3333333333334,
      "lo": 324.24074074074076,
      "hi": 920.0185185185185,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "self-gemini",
      "value": 350,
      "lo": 216.6666666666668,
      "hi": 491.6666666666665,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "self-gemini",
      "value": 2976.6666666666665,
      "lo": 878.1481481481483,
      "hi": 5620,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "self-gemini",
      "value": 350,
      "lo": 216.66666666666657,
      "hi": 483.3333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "self-gemini",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "self-gemini",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "self-gemini",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "self-gemini",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "self-gemini",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "self-gemini",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "self-gemini",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.5,
      "lo": 0.2992980081982123,
      "hi": 0.7007019918017877,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.6416666666666667,
      "lo": 0.48677214277375147,
      "hi": 0.7717350702203507,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.65,
      "lo": 0.43285427668523624,
      "hi": 0.818808175898918,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.6,
      "lo": 0.31267376973365824,
      "hi": 0.8318196702937638,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "fakes_caught_with_proof",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.6666666666666666,
      "lo": 0.36779781217588203,
      "hi": 0.8730245878698215,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "proof",
      "metric": "genuine_with_proof_rate",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.16872427983539093,
      "lo": 0.10263418664644494,
      "hi": 0.264813433742933,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "self-gemini",
      "value": 4673,
      "lo": 4673,
      "hi": 4673,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "self-gemini",
      "value": 10221.8,
      "lo": 10221.8,
      "hi": 10221.8,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "self-gemini",
      "value": 23062.840000000007,
      "lo": 23062.840000000007,
      "hi": 23062.840000000007,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0.004384190397350995,
      "lo": 0.004384190397350995,
      "hi": 0.004384190397350995,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 4635,
      "lo": 4635,
      "hi": 4635,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 10231.099999999997,
      "lo": 10231.099999999997,
      "hi": 10231.099999999997,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 22930.380000000005,
      "lo": 22930.380000000005,
      "hi": 22930.380000000005,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0.004351375000000002,
      "lo": 0.004351375000000002,
      "hi": 0.004351375000000002,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 5346.5,
      "lo": 5346.5,
      "hi": 5346.5,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 9988.199999999997,
      "lo": 9988.199999999997,
      "hi": 9988.199999999997,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 20261.59999999999,
      "lo": 20261.59999999999,
      "hi": 20261.59999999999,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0.004660347222222221,
      "lo": 0.004660347222222221,
      "hi": 0.004660347222222221,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 5103,
      "lo": 5103,
      "hi": 5103,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 8875,
      "lo": 8875,
      "hi": 8875,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 14908.600000000006,
      "lo": 14908.600000000006,
      "hi": 14908.600000000006,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 0.004523107142857142,
      "lo": 0.004523107142857142,
      "hi": 0.004523107142857142,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 4986.5,
      "lo": 4986.5,
      "hi": 4986.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 8234.399999999996,
      "lo": 8234.399999999996,
      "hi": 8234.399999999996,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 16204.839999999951,
      "lo": 16204.839999999951,
      "hi": 16204.839999999951,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0.004581075,
      "lo": 0.004581075,
      "hi": 0.004581075,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 4900,
      "lo": 4900,
      "hi": 4900,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 8560.699999999999,
      "lo": 8560.699999999999,
      "hi": 8560.699999999999,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 10835.920000000038,
      "lo": 10835.920000000038,
      "hi": 10835.920000000038,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0.004451810000000001,
      "lo": 0.004451810000000001,
      "hi": 0.004451810000000001,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 4631.5,
      "lo": 4631.5,
      "hi": 4631.5,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 10328.35,
      "lo": 10328.35,
      "hi": 10328.35,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 23801.680000000033,
      "lo": 23801.680000000033,
      "hi": 23801.680000000033,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0.004347900000000002,
      "lo": 0.004347900000000002,
      "hi": 0.004347900000000002,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 4711,
      "lo": 4711,
      "hi": 4711,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 10154.899999999998,
      "lo": 10154.899999999998,
      "hi": 10154.899999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 11707.779999999999,
      "lo": 11707.779999999999,
      "hi": 11707.779999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 0.0046469,
      "lo": 0.0046469,
      "hi": 0.0046469,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 5004,
      "lo": 5004,
      "hi": 5004,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 8944.199999999995,
      "lo": 8944.199999999995,
      "hi": 8944.199999999995,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 12808.55999999998,
      "lo": 12808.55999999998,
      "hi": 12808.55999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0.004459625000000001,
      "lo": 0.004459625000000001,
      "hi": 0.004459625000000001,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 4840,
      "lo": 4840,
      "hi": 4840,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 9048.399999999996,
      "lo": 9048.399999999996,
      "hi": 9048.399999999996,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 10201.32,
      "lo": 10201.32,
      "hi": 10201.32,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0.004410575,
      "lo": 0.004410575,
      "hi": 0.004410575,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 4758.5,
      "lo": 4758.5,
      "hi": 4758.5,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 11299.499999999995,
      "lo": 11299.499999999995,
      "hi": 11299.499999999995,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 22930.38,
      "lo": 22930.38,
      "hi": 22930.38,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0.004382008333333331,
      "lo": 0.004382008333333331,
      "hi": 0.004382008333333331,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 4426.5,
      "lo": 4426.5,
      "hi": 4426.5,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 9757.349999999984,
      "lo": 9757.349999999984,
      "hi": 9757.349999999984,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 21199.34,
      "lo": 21199.34,
      "hi": 21199.34,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0.0043203285714285755,
      "lo": 0.0043203285714285755,
      "hi": 0.0043203285714285755,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 4503,
      "lo": 4503,
      "hi": 4503,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 12927.199999999986,
      "lo": 12927.199999999986,
      "hi": 12927.199999999986,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 23215.76,
      "lo": 23215.76,
      "hi": 23215.76,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0.004301409090909091,
      "lo": 0.004301409090909091,
      "hi": 0.004301409090909091,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 5013,
      "lo": 5013,
      "hi": 5013,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 6891.199999999998,
      "lo": 6891.199999999998,
      "hi": 6891.199999999998,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 19535.920000000013,
      "lo": 19535.920000000013,
      "hi": 19535.920000000013,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0.004751574999999999,
      "lo": 0.004751574999999999,
      "hi": 0.004751574999999999,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 4675,
      "lo": 4675,
      "hi": 4675,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 7028.799999999997,
      "lo": 7028.799999999997,
      "hi": 7028.799999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 8447.360000000002,
      "lo": 8447.360000000002,
      "hi": 8447.360000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 0.004336249999999999,
      "lo": 0.004336249999999999,
      "hi": 0.004336249999999999,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 4638,
      "lo": 4638,
      "hi": 4638,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 10354.199999999999,
      "lo": 10354.199999999999,
      "hi": 10354.199999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 23680.35999999999,
      "lo": 23680.35999999999,
      "hi": 23680.35999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0.004368829268292684,
      "lo": 0.004368829268292684,
      "hi": 0.004368829268292684,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 4675,
      "lo": 4675,
      "hi": 4675,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 7028.799999999997,
      "lo": 7028.799999999997,
      "hi": 7028.799999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 8447.360000000002,
      "lo": 8447.360000000002,
      "hi": 8447.360000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 0.004336249999999999,
      "lo": 0.004336249999999999,
      "hi": 0.004336249999999999,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 4638,
      "lo": 4638,
      "hi": 4638,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 10354.199999999999,
      "lo": 10354.199999999999,
      "hi": 10354.199999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 23680.35999999999,
      "lo": 23680.35999999999,
      "hi": 23680.35999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0.004368829268292684,
      "lo": 0.004368829268292684,
      "hi": 0.004368829268292684,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 4661,
      "lo": 4661,
      "hi": 4661,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 10365.949999999999,
      "lo": 10365.949999999999,
      "hi": 10365.949999999999,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 23478.16000000002,
      "lo": 23478.16000000002,
      "hi": 23478.16000000002,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0.004371921875000001,
      "lo": 0.004371921875000001,
      "hi": 0.004371921875000001,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "self-gemini",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 4780,
      "lo": 4780,
      "hi": 4780,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 7904.999999999989,
      "lo": 7904.999999999989,
      "hi": 7904.999999999989,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 9281.67999999999,
      "lo": 9281.67999999999,
      "hi": 9281.67999999999,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0.004452467391304348,
      "lo": 0.004452467391304348,
      "hi": 0.004452467391304348,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "self-gemini",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 4673,
      "lo": 4673,
      "hi": 4673,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 10221.8,
      "lo": 10221.8,
      "hi": 10221.8,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 23062.840000000007,
      "lo": 23062.840000000007,
      "hi": 23062.840000000007,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0.004384190397350995,
      "lo": 0.004384190397350995,
      "hi": 0.004384190397350995,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 4820,
      "lo": 4820,
      "hi": 4820,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 6793.249999999999,
      "lo": 6793.249999999999,
      "hi": 6793.249999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 7305.85,
      "lo": 7305.85,
      "hi": 7305.85,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 0.0044305625,
      "lo": 0.0044305625,
      "hi": 0.0044305625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 4829.5,
      "lo": 4829.5,
      "hi": 4829.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 5652.25,
      "lo": 5652.25,
      "hi": 5652.25,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 5900.85,
      "lo": 5900.85,
      "hi": 5900.85,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 0.0043814375,
      "lo": 0.0043814375,
      "hi": 0.0043814375,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 5452,
      "lo": 5452,
      "hi": 5452,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 9500.899999999998,
      "lo": 9500.899999999998,
      "hi": 9500.899999999998,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 20898.75999999998,
      "lo": 20898.75999999998,
      "hi": 20898.75999999998,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 0.004888027777777777,
      "lo": 0.004888027777777777,
      "hi": 0.004888027777777777,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 4655,
      "lo": 4655,
      "hi": 4655,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 10305.9,
      "lo": 10305.9,
      "hi": 10305.9,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 23437.719999999983,
      "lo": 23437.719999999983,
      "hi": 23437.719999999983,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0.004374372093023257,
      "lo": 0.004374372093023257,
      "hi": 0.004374372093023257,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 4675,
      "lo": 4675,
      "hi": 4675,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 7028.799999999997,
      "lo": 7028.799999999997,
      "hi": 7028.799999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 8447.360000000002,
      "lo": 8447.360000000002,
      "hi": 8447.360000000002,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 0.004336249999999999,
      "lo": 0.004336249999999999,
      "hi": 0.004336249999999999,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 4063.5,
      "lo": 4063.5,
      "hi": 4063.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 6003.7,
      "lo": 6003.7,
      "hi": 6003.7,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 6165.54,
      "lo": 6165.54,
      "hi": 6165.54,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 0.0042350416666666665,
      "lo": 0.0042350416666666665,
      "hi": 0.0042350416666666665,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 4670.5,
      "lo": 4670.5,
      "hi": 4670.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 5547,
      "lo": 5547,
      "hi": 5547,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 9180.759999999998,
      "lo": 9180.759999999998,
      "hi": 9180.759999999998,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 0.004367749999999999,
      "lo": 0.004367749999999999,
      "hi": 0.004367749999999999,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "self-gemini",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 5312,
      "lo": 5312,
      "hi": 5312,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 7722.899999999996,
      "lo": 7722.899999999996,
      "hi": 7722.899999999996,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 9785.379999999997,
      "lo": 9785.379999999997,
      "hi": 9785.379999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 0.004517750000000001,
      "lo": 0.004517750000000001,
      "hi": 0.004517750000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 5103,
      "lo": 5103,
      "hi": 5103,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 8875,
      "lo": 8875,
      "hi": 8875,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 14908.600000000006,
      "lo": 14908.600000000006,
      "hi": 14908.600000000006,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 0.004523107142857142,
      "lo": 0.004523107142857142,
      "hi": 0.004523107142857142,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 4956,
      "lo": 4956,
      "hi": 4956,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 7470.05,
      "lo": 7470.05,
      "hi": 7470.05,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 16162.359999999951,
      "lo": 16162.359999999951,
      "hi": 16162.359999999951,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0.004531262500000002,
      "lo": 0.004531262500000002,
      "hi": 0.004531262500000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 4548,
      "lo": 4548,
      "hi": 4548,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 10370.799999999997,
      "lo": 10370.799999999997,
      "hi": 10370.799999999997,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 23134.440000000002,
      "lo": 23134.440000000002,
      "hi": 23134.440000000002,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0.004335123873873876,
      "lo": 0.004335123873873876,
      "hi": 0.004335123873873876,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 5026,
      "lo": 5026,
      "hi": 5026,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 9804.899999999998,
      "lo": 9804.899999999998,
      "hi": 9804.899999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 12851.039999999979,
      "lo": 12851.039999999979,
      "hi": 12851.039999999979,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0.0045094374999999996,
      "lo": 0.0045094374999999996,
      "hi": 0.0045094374999999996,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 4736,
      "lo": 4736,
      "hi": 4736,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 6712.800000000003,
      "lo": 6712.800000000003,
      "hi": 6712.800000000003,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 8790.6,
      "lo": 8790.6,
      "hi": 8790.6,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0.004427057692307694,
      "lo": 0.004427057692307694,
      "hi": 0.004427057692307694,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 5244.5,
      "lo": 5244.5,
      "hi": 5244.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 8756.549999999997,
      "lo": 8756.549999999997,
      "hi": 8756.549999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 10049.710000000003,
      "lo": 10049.710000000003,
      "hi": 10049.710000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0.0046385625,
      "lo": 0.0046385625,
      "hi": 0.0046385625,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 4604,
      "lo": 4604,
      "hi": 4604,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 6505.699999999999,
      "lo": 6505.699999999999,
      "hi": 6505.699999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 7273.9400000000005,
      "lo": 7273.9400000000005,
      "hi": 7273.9400000000005,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 0.0043298125,
      "lo": 0.0043298125,
      "hi": 0.0043298125,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "self-gemini",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 5013,
      "lo": 5013,
      "hi": 5013,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 6891.199999999998,
      "lo": 6891.199999999998,
      "hi": 6891.199999999998,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 19535.920000000013,
      "lo": 19535.920000000013,
      "hi": 19535.920000000013,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0.004751574999999999,
      "lo": 0.004751574999999999,
      "hi": 0.004751574999999999,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 5066.5,
      "lo": 5066.5,
      "hi": 5066.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 6432.099999999996,
      "lo": 6432.099999999996,
      "hi": 6432.099999999996,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 8386.419999999995,
      "lo": 8386.419999999995,
      "hi": 8386.419999999995,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 0.004455458333333332,
      "lo": 0.004455458333333332,
      "hi": 0.004455458333333332,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 5167,
      "lo": 5167,
      "hi": 5167,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 8637,
      "lo": 8637,
      "hi": 8637,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 9934.6,
      "lo": 9934.6,
      "hi": 9934.6,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0.0044852500000000005,
      "lo": 0.0044852500000000005,
      "hi": 0.0044852500000000005,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 4644,
      "lo": 4644,
      "hi": 4644,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 10301,
      "lo": 10301,
      "hi": 10301,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 15193.800000000005,
      "lo": 15193.800000000005,
      "hi": 15193.800000000005,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 0.004437571428571429,
      "lo": 0.004437571428571429,
      "hi": 0.004437571428571429,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 4496.5,
      "lo": 4496.5,
      "hi": 4496.5,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 12925.49999999992,
      "lo": 12925.49999999992,
      "hi": 12925.49999999992,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 23405.869999999984,
      "lo": 23405.869999999984,
      "hi": 23405.869999999984,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0.004322928571428571,
      "lo": 0.004322928571428571,
      "hi": 0.004322928571428571,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 5033,
      "lo": 5033,
      "hi": 5033,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 7840.999999999996,
      "lo": 7840.999999999996,
      "hi": 7840.999999999996,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 9828.999999999998,
      "lo": 9828.999999999998,
      "hi": 9828.999999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 0.004429550000000001,
      "lo": 0.004429550000000001,
      "hi": 0.004429550000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 4747,
      "lo": 4747,
      "hi": 4747,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 10578.699999999983,
      "lo": 10578.699999999983,
      "hi": 10578.699999999983,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 20428.53999999999,
      "lo": 20428.53999999999,
      "hi": 20428.53999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 0.0042048,
      "lo": 0.0042048,
      "hi": 0.0042048,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 5094,
      "lo": 5094,
      "hi": 5094,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 8887.699999999999,
      "lo": 8887.699999999999,
      "hi": 8887.699999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 9559.14,
      "lo": 9559.14,
      "hi": 9559.14,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 0.0044882,
      "lo": 0.0044882,
      "hi": 0.0044882,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 4451,
      "lo": 4451,
      "hi": 4451,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 5476.1,
      "lo": 5476.1,
      "hi": 5476.1,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 5485.62,
      "lo": 5485.62,
      "hi": 5485.62,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 0.00431645,
      "lo": 0.00431645,
      "hi": 0.00431645,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 5897,
      "lo": 5897,
      "hi": 5897,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 19633.499999999993,
      "lo": 19633.499999999993,
      "hi": 19633.499999999993,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 22525.899999999998,
      "lo": 22525.899999999998,
      "hi": 22525.899999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 0.0042061500000000005,
      "lo": 0.0042061500000000005,
      "hi": 0.0042061500000000005,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 4711,
      "lo": 4711,
      "hi": 4711,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 10154.899999999998,
      "lo": 10154.899999999998,
      "hi": 10154.899999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 11707.779999999999,
      "lo": 11707.779999999999,
      "hi": 11707.779999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 0.01633333333333333,
      "lo": 0.01633333333333333,
      "hi": 0.01633333333333333,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 0.0046469,
      "lo": 0.0046469,
      "hi": 0.0046469,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "self-gemini",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9859649122807016,
      "lo": 0.9371692132513808,
      "hi": 0.9969867010277976,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9851190476190476,
      "lo": 0.9417384933586386,
      "hi": 0.9963251996656957,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8750000000000001,
      "lo": 0.6397717273424133,
      "hi": 0.9650225122567595,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9944903581267217,
      "lo": 0.959271484294787,
      "hi": 0.9992776050629409,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.953168044077135,
      "lo": 0.8996256649660488,
      "hi": 0.9788218291807271,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9457364341085271,
      "lo": 0.8849206349206349,
      "hi": 0.9882352941176471,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9822222222222221,
      "lo": 0.921271845462039,
      "hi": 0.9961811597878769,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9818840579710144,
      "lo": 0.9296147941856543,
      "hi": 0.9955241567202318,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8181818181818182,
      "lo": 0.523019438039156,
      "hi": 0.9486323102539149,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.95,
      "lo": 0.8882495307680808,
      "hi": 0.9784563208456319,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9642857142857143,
      "lo": 0.9166666666666666,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9629629629629631,
      "lo": 0.7679464317540228,
      "hi": 0.9951283611657391,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9629629629629631,
      "lo": 0.7679464317540228,
      "hi": 0.9951283611657391,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9833333333333334,
      "lo": 0.8121528279044053,
      "hi": 0.9987595193112028,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666668,
      "lo": 0.7873326750830553,
      "hi": 0.9956171774009802,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9500000000000002,
      "lo": 0.7638688065532582,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9487179487179487,
      "lo": 0.8958333333333334,
      "hi": 0.9878787878787879,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9835390946502056,
      "lo": 0.9268260532345567,
      "hi": 0.9964646871908851,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9814814814814814,
      "lo": 0.9281190549211727,
      "hi": 0.9954244167576237,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9932659932659932,
      "lo": 0.9505648842177655,
      "hi": 0.9991169638095968,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9427609427609427,
      "lo": 0.8783767582834183,
      "hi": 0.9740680404578657,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8750000000000001,
      "lo": 0.6397717273424133,
      "hi": 0.9650225122567595,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9,
      "lo": 0.6989663547715128,
      "hi": 0.9721335187862319,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9457364341085271,
      "lo": 0.8875489457831326,
      "hi": 0.9887671660424469,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9727891156462585,
      "lo": 0.8826896443704224,
      "hi": 0.9941471116047544,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9784946236559141,
      "lo": 0.905776570981073,
      "hi": 0.9953780266853556,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9299533801014687,
      "hi": 1,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.961904761904762,
      "lo": 0.8880377350599916,
      "hi": 0.9877123882371907,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9479769375897331,
      "hi": 1,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9333333333333332,
      "lo": 0.6349338104169441,
      "hi": 0.991204429701885,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9826839826839826,
      "lo": 0.9232146094426825,
      "hi": 0.9962805903928893,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9801587301587301,
      "lo": 0.9232245034642171,
      "hi": 0.995096614486784,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9928315412186379,
      "lo": 0.947504337011296,
      "hi": 0.9990599525291085,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9426523297491038,
      "lo": 0.8755687006758462,
      "hi": 0.9746181339295351,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9826839826839826,
      "lo": 0.9232146094426825,
      "hi": 0.9962805903928893,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9801587301587301,
      "lo": 0.9232245034642171,
      "hi": 0.995096614486784,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9486720478031097,
      "hi": 1,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9928315412186379,
      "lo": 0.947504337011296,
      "hi": 0.9990599525291085,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9426523297491038,
      "lo": 0.8755687006758462,
      "hi": 0.9746181339295351,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.960332497388265,
      "hi": 1,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9837398373983739,
      "lo": 0.9276764572931817,
      "hi": 0.9965078986489164,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9812734082397003,
      "lo": 0.9273470935642919,
      "hi": 0.9953728610210383,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9931972789115646,
      "lo": 0.9500798177936899,
      "hi": 0.9991079470522711,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9421768707482993,
      "lo": 0.8771952049971418,
      "hi": 0.9738007221061337,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9365079365079365,
      "lo": 0.8333333333333334,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9622800098783192,
      "hi": 0.9999999999999999,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9545454545454546,
      "lo": 0.8914082687338503,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9859649122807016,
      "lo": 0.9371692132513808,
      "hi": 0.9969867010277976,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9851190476190476,
      "lo": 0.9417384933586386,
      "hi": 0.9963251996656957,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9581729333351078,
      "hi": 0.9999999999999999,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8750000000000001,
      "lo": 0.6397717273424133,
      "hi": 0.9650225122567595,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9944903581267217,
      "lo": 0.959271484294787,
      "hi": 0.9992776050629409,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.953168044077135,
      "lo": 0.8996256649660488,
      "hi": 0.9788218291807271,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9457364341085271,
      "lo": 0.8850540503557746,
      "hi": 0.9885057471264368,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9839357429718875,
      "lo": 0.9285073245434474,
      "hi": 0.9965500665259674,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9814814814814814,
      "lo": 0.9281190549211727,
      "hi": 0.9954244167576237,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.950650220603614,
      "hi": 1,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9932659932659932,
      "lo": 0.9505648842177655,
      "hi": 0.9991169638095968,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9427609427609427,
      "lo": 0.8783767582834183,
      "hi": 0.9740680404578657,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9186991869918699,
      "lo": 0.811965811965812,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9626467879321726,
      "hi": 1,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9833333333333334,
      "lo": 0.8121528279044053,
      "hi": 0.9987595193112028,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9166666666666666,
      "lo": 0.7198571898005176,
      "hi": 0.9792051784887997,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9534883720930233,
      "lo": 0.8536585365853658,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9774011299435028,
      "lo": 0.9012935311709601,
      "hi": 0.9951422675915979,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9814814814814814,
      "lo": 0.9181661300687032,
      "hi": 0.9960216296532263,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.93982814785791,
      "hi": 0.9999999999999998,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9670781893004115,
      "lo": 0.9024692586862819,
      "hi": 0.9893903075970172,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9547219145675847,
      "hi": 1,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666668,
      "lo": 0.7873326750830553,
      "hi": 0.9956171774009802,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9333333333333332,
      "lo": 0.7414447301258664,
      "hi": 0.9855801328950236,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.937984496124031,
      "lo": 0.8771381578947369,
      "hi": 0.9851851851851852,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9666666666666666,
      "lo": 0.6767863445664513,
      "hi": 0.9975163755615184,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9333333333333332,
      "lo": 0.6349338104169441,
      "hi": 0.991204429701885,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9757575757575757,
      "lo": 0.8946078006966166,
      "hi": 0.9947877782404587,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9774011299435028,
      "lo": 0.9012935311709601,
      "hi": 0.9951422675915979,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9312077638761376,
      "hi": 1,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9607843137254901,
      "lo": 0.8849425202336564,
      "hi": 0.9873486010125531,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 1,
      "lo": 0.9465286634799296,
      "hi": 1,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8050925925925926,
      "lo": 0.7086149691358025,
      "hi": 0.8939814814814815,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.475,
      "lo": 0.325,
      "hi": 0.65,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.525,
      "lo": 0.375,
      "hi": 0.7,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.575,
      "lo": 0.4,
      "hi": 0.75,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4583333333333333,
      "lo": 0.3144491238835356,
      "hi": 0.6095193428829051,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.016460905349794237,
      "lo": 0.0035353128091148087,
      "hi": 0.07317394676544312,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3416666666666667,
      "lo": 0.21446830646154083,
      "hi": 0.4966118672509333,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4333333333333334,
      "lo": 0.24487520800487073,
      "hi": 0.6432748130688387,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3833333333333333,
      "lo": 0.2060660766067583,
      "hi": 0.5981964602722329,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8935185185185185,
      "lo": 0.7453703703703703,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5555555555555555,
      "lo": 0.29701927644834225,
      "hi": 0.7871480561455196,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3055555555555555,
      "lo": 0.1210211581599055,
      "hi": 0.584393177761577,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7945171026156942,
      "lo": 0.6790618712273642,
      "hi": 0.8963845573440644,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.42857142857142855,
      "lo": 0.25,
      "hi": 0.6080357142857093,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4642857142857143,
      "lo": 0.2857142857142857,
      "hi": 0.6428571428571429,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.7142857142857143,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4166666666666667,
      "lo": 0.2551857292776431,
      "hi": 0.5982548215166645,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.018779342723004695,
      "lo": 0.00403455081372734,
      "hi": 0.08292427641802158,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.35714285714285715,
      "lo": 0.2070582950773768,
      "hi": 0.5416969348557219,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7920588235294118,
      "lo": 0.6640808823529412,
      "hi": 0.9020588235294118,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.48,
      "lo": 0.28,
      "hi": 0.68,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.52,
      "lo": 0.32,
      "hi": 0.72,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4266666666666667,
      "lo": 0.2556657739363266,
      "hi": 0.6172024228680671,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0196078431372549,
      "lo": 0.004213033667745614,
      "hi": 0.0863770739691849,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3866666666666667,
      "lo": 0.22339378411025618,
      "hi": 0.5801297927692615,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7920588235294118,
      "lo": 0.6696838235294118,
      "hi": 0.9017720588235294,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.48,
      "lo": 0.28,
      "hi": 0.68,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.52,
      "lo": 0.32,
      "hi": 0.72,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4266666666666667,
      "lo": 0.2556657739363266,
      "hi": 0.6172024228680671,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0196078431372549,
      "lo": 0.004213033667745614,
      "hi": 0.0863770739691849,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3866666666666667,
      "lo": 0.22339378411025618,
      "hi": 0.5801297927692615,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7686274509803922,
      "lo": 0.6455698529411765,
      "hi": 0.8813848039215685,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.23333333333333334,
      "hi": 0.6,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666667,
      "lo": 0.3,
      "hi": 0.6666666666666666,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.3,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.38888888888888895,
      "lo": 0.23677132684419638,
      "hi": 0.5662316494166857,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0196078431372549,
      "lo": 0.004213033667745614,
      "hi": 0.0863770739691849,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3333333333333333,
      "lo": 0.19230498083676134,
      "hi": 0.5121994835545616,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9192307692307692,
      "lo": 0.7692307692307693,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.4,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6666666666666666,
      "lo": 0.36779781217588203,
      "hi": 0.8730245878698215,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.36666666666666664,
      "lo": 0.1471196666309701,
      "hi": 0.6602224133324669,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8050925925925926,
      "lo": 0.7024459876543211,
      "hi": 0.8868827160493827,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.475,
      "lo": 0.325,
      "hi": 0.625,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.525,
      "lo": 0.375,
      "hi": 0.7,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.575,
      "lo": 0.4,
      "hi": 0.75,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4583333333333333,
      "lo": 0.3144491238835356,
      "hi": 0.6095193428829051,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.016460905349794237,
      "lo": 0.0035353128091148087,
      "hi": 0.07317394676544312,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3416666666666667,
      "lo": 0.21446830646154083,
      "hi": 0.4966118672509333,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7577294685990338,
      "lo": 0.6408091787439614,
      "hi": 0.856286231884058,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.23333333333333334,
      "hi": 0.5666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.43333333333333335,
      "lo": 0.23333333333333334,
      "hi": 0.6,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666667,
      "lo": 0.26666666666666666,
      "hi": 0.6666666666666666,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.38888888888888895,
      "lo": 0.23677132684419638,
      "hi": 0.5662316494166857,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.01932367149758454,
      "lo": 0.004151810238993414,
      "hi": 0.08519463603937033,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.35555555555555557,
      "lo": 0.2098444897044988,
      "hi": 0.5340593794346478,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666666,
      "lo": 0.21293408575713324,
      "hi": 0.7389014342337259,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666666,
      "lo": 0.21293408575713324,
      "hi": 0.7389014342337259,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0196078431372549,
      "lo": 0.004213033667745614,
      "hi": 0.0863770739691849,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.38333333333333336,
      "lo": 0.20606607660675835,
      "hi": 0.5981964602722329,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.2833333333333333,
      "lo": 0.13402625504293345,
      "hi": 0.5024613134466217,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5333333333333333,
      "lo": 0.32763499420531195,
      "hi": 0.7282899952578333,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.21880653237281705,
      "hi": 0.6134184992377469,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.016460905349794237,
      "lo": 0.0035353128091148087,
      "hi": 0.07317394676544312,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7870370370370371,
      "lo": 0.6348533950617284,
      "hi": 0.909591049382716,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.3,
      "hi": 0.7,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.55,
      "lo": 0.35,
      "hi": 0.75,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.55,
      "lo": 0.34875000000000217,
      "hi": 0.75,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4833333333333333,
      "lo": 0.2854103181114389,
      "hi": 0.6866271871569883,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3,
      "lo": 0.1454772448676043,
      "hi": 0.5189728183535235,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7679012345679013,
      "lo": 0.5499537037037038,
      "hi": 0.9382870370370369,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.1,
      "hi": 0.7,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4,
      "lo": 0.16818032970623614,
      "hi": 0.6873262302663417,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8783950617283951,
      "lo": 0.7432098765432099,
      "hi": 0.9777777777777777,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.9,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7,
      "lo": 0.3,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666666,
      "lo": 0.21293408575713324,
      "hi": 0.7389014342337259,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.4666666666666666,
      "lo": 0.21293408575713324,
      "hi": 0.7389014342337259,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.6537598204264871,
      "lo": 0.5086910774410774,
      "hi": 0.7839506172839507,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.13636363636363635,
      "lo": 0,
      "hi": 0.3181818181818182,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.18181818181818182,
      "lo": 0.045454545454545456,
      "hi": 0.4090909090909091,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.2727272727272727,
      "lo": 0.09090909090909091,
      "hi": 0.5,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.13636363636363635,
      "lo": 0.04749003714055253,
      "hi": 0.33334987166571717,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.045454545454545456,
      "lo": 0.00806942762126385,
      "hi": 0.21798045838657332,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9900548696844993,
      "lo": 0.9670781893004116,
      "hi": 1,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8888888888888888,
      "lo": 0.7222222222222222,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9444444444444444,
      "lo": 0.8333333333333334,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9444444444444444,
      "lo": 0.8333333333333334,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.8518518518518517,
      "lo": 0.6286440113397694,
      "hi": 0.9512928312792491,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.7037037037037037,
      "lo": 0.4730553715656586,
      "hi": 0.8626975373190365,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9256198347107438,
      "lo": 0.8646691146497353,
      "hi": 0.9603773160230725,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.9917355371900827,
      "lo": 0.9546693563957512,
      "hi": 0.9985396266145802,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.10289256198347108,
      "lo": 0.08038085399449038,
      "hi": 0.14482369146005505,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 818.7037037037037,
      "lo": 510.86111111111126,
      "hi": 1228.5972222222217,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 658.3333333333334,
      "lo": 524.791666666667,
      "hi": 783.3333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:claude-haiku-5.5",
      "value": 333.7222222222222,
      "lo": 55,
      "hi": 741.4097222222221,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:claude-haiku-5.5",
      "value": 65.83333333333334,
      "lo": 53.333333333333336,
      "hi": 78.33333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:claude-haiku-5.5",
      "value": 2974.1769547325107,
      "lo": 2216.2551440329216,
      "hi": 3782.862654320987,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:claude-haiku-5.5",
      "value": 3291.666666666667,
      "lo": 2625.0000000000005,
      "hi": 3876.041666666662,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "diy:claude-haiku-5.5",
      "value": 450.37037037037044,
      "lo": 178.66666666666666,
      "hi": 804.6666666666666,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "diy:claude-haiku-5.5",
      "value": 210.66666666666666,
      "lo": 167.99999999999997,
      "hi": 250.66666666666666,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1262.8703703703704,
      "lo": 866.4680555555555,
      "hi": 1685.0504629629627,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1198.1666666666665,
      "lo": 970.6666666666666,
      "hi": 1425.6666666666667,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "diy:claude-haiku-5.5",
      "value": 672.0370370370371,
      "lo": 474.2407407407408,
      "hi": 886.4999999999998,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "diy:claude-haiku-5.5",
      "value": 658.3333333333334,
      "lo": 525.0000000000001,
      "hi": 775.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1731.2962962962963,
      "lo": 541.6666666666667,
      "hi": 3327.6435185185132,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "diy:claude-haiku-5.5",
      "value": 658.3333333333334,
      "lo": 525.0000000000001,
      "hi": 783.3333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:claude-haiku-5.5",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:claude-haiku-5.5",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "diy:claude-haiku-5.5",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "diy:claude-haiku-5.5",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.3833333333333333,
      "lo": 0.2060660766067583,
      "hi": 0.5981964602722329,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 8392,
      "lo": 8392,
      "hi": 8392,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 13410.4,
      "lo": 13410.4,
      "hi": 13410.4,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 16542.88000000001,
      "lo": 16542.88000000001,
      "hi": 16542.88000000001,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009646776158940402,
      "lo": 0.0009646776158940402,
      "hi": 0.0009646776158940402,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009646776158940402,
      "lo": 0.0009646776158940402,
      "hi": 0.0009646776158940402,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 8209.5,
      "lo": 8209.5,
      "hi": 8209.5,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 13007.399999999994,
      "lo": 13007.399999999994,
      "hi": 13007.399999999994,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 15554.150000000012,
      "lo": 15554.150000000012,
      "hi": 15554.150000000012,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009326900000000007,
      "lo": 0.0009326900000000007,
      "hi": 0.0009326900000000007,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009326900000000007,
      "lo": 0.0009326900000000007,
      "hi": 0.0009326900000000007,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 10266,
      "lo": 10266,
      "hi": 10266,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 13937.249999999996,
      "lo": 13937.249999999996,
      "hi": 13937.249999999996,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 14859.69,
      "lo": 14859.69,
      "hi": 14859.69,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011592824074074073,
      "lo": 0.0011592824074074073,
      "hi": 0.0011592824074074073,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011592824074074073,
      "lo": 0.0011592824074074073,
      "hi": 0.0011592824074074073,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 11027,
      "lo": 11027,
      "hi": 11027,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 13125,
      "lo": 13125,
      "hi": 13125,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 14167.400000000001,
      "lo": 14167.400000000001,
      "hi": 14167.400000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001213544761904762,
      "lo": 0.001213544761904762,
      "hi": 0.001213544761904762,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001213544761904762,
      "lo": 0.001213544761904762,
      "hi": 0.001213544761904762,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 8946,
      "lo": 8946,
      "hi": 8946,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 13724.649999999998,
      "lo": 13724.649999999998,
      "hi": 13724.649999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 14952.17,
      "lo": 14952.17,
      "hi": 14952.17,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010440382500000003,
      "lo": 0.0010440382500000003,
      "hi": 0.0010440382500000003,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010440382500000003,
      "lo": 0.0010440382500000003,
      "hi": 0.0010440382500000003,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 8860,
      "lo": 8860,
      "hi": 8860,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 13456.599999999997,
      "lo": 13456.599999999997,
      "hi": 13456.599999999997,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 15117.960000000012,
      "lo": 15117.960000000012,
      "hi": 15117.960000000012,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010138945999999995,
      "lo": 0.0010138945999999995,
      "hi": 0.0010138945999999995,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010138945999999995,
      "lo": 0.0010138945999999995,
      "hi": 0.0010138945999999995,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 8310.5,
      "lo": 8310.5,
      "hi": 8310.5,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 13260.550000000001,
      "lo": 13260.550000000001,
      "hi": 13260.550000000001,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 16170.180000000033,
      "lo": 16170.180000000033,
      "hi": 16170.180000000033,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000948541402777778,
      "lo": 0.000948541402777778,
      "hi": 0.000948541402777778,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000948541402777778,
      "lo": 0.000948541402777778,
      "hi": 0.000948541402777778,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 7626,
      "lo": 7626,
      "hi": 7626,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10330.5,
      "lo": 10330.5,
      "hi": 10330.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10344.5,
      "lo": 10344.5,
      "hi": 10344.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000927021,
      "lo": 0.000927021,
      "hi": 0.000927021,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000927021,
      "lo": 0.000927021,
      "hi": 0.000927021,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 8919.5,
      "lo": 8919.5,
      "hi": 8919.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 12906.5,
      "lo": 12906.5,
      "hi": 12906.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 15392.319999999992,
      "lo": 15392.319999999992,
      "hi": 15392.319999999992,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010681652500000001,
      "lo": 0.0010681652500000001,
      "hi": 0.0010681652500000001,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010681652500000001,
      "lo": 0.0010681652500000001,
      "hi": 0.0010681652500000001,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 7549,
      "lo": 7549,
      "hi": 7549,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 10454.399999999998,
      "lo": 10454.399999999998,
      "hi": 10454.399999999998,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 11251.02,
      "lo": 11251.02,
      "hi": 11251.02,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008252859999999998,
      "lo": 0.0008252859999999998,
      "hi": 0.0008252859999999998,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008252859999999998,
      "lo": 0.0008252859999999998,
      "hi": 0.0008252859999999998,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 8199.5,
      "lo": 8199.5,
      "hi": 8199.5,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 12427.399999999998,
      "lo": 12427.399999999998,
      "hi": 12427.399999999998,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 15301.07,
      "lo": 15301.07,
      "hi": 15301.07,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009142574444444443,
      "lo": 0.0009142574444444443,
      "hi": 0.0009142574444444443,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009142574444444443,
      "lo": 0.0009142574444444443,
      "hi": 0.0009142574444444443,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 8112.5,
      "lo": 8112.5,
      "hi": 8112.5,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 14330.549999999997,
      "lo": 14330.549999999997,
      "hi": 14330.549999999997,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 17020.149999999998,
      "lo": 17020.149999999998,
      "hi": 17020.149999999998,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009382152380952382,
      "lo": 0.0009382152380952382,
      "hi": 0.0009382152380952382,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009382152380952382,
      "lo": 0.0009382152380952382,
      "hi": 0.0009382152380952382,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 8517,
      "lo": 8517,
      "hi": 8517,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 12744.199999999999,
      "lo": 12744.199999999999,
      "hi": 12744.199999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 13420.96,
      "lo": 13420.96,
      "hi": 13420.96,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009381327272727272,
      "lo": 0.0009381327272727272,
      "hi": 0.0009381327272727272,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009381327272727272,
      "lo": 0.0009381327272727272,
      "hi": 0.0009381327272727272,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 11221.5,
      "lo": 11221.5,
      "hi": 11221.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 14810.5,
      "lo": 14810.5,
      "hi": 14810.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 14993.27,
      "lo": 14993.27,
      "hi": 14993.27,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012627905,
      "lo": 0.0012627905,
      "hi": 0.0012627905,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012627905,
      "lo": 0.0012627905,
      "hi": 0.0012627905,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 7172,
      "lo": 7172,
      "hi": 7172,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 11856.049999999996,
      "lo": 11856.049999999996,
      "hi": 11856.049999999996,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 13998.410000000003,
      "lo": 13998.410000000003,
      "hi": 13998.410000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008087916666666665,
      "lo": 0.0008087916666666665,
      "hi": 0.0008087916666666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008087916666666665,
      "lo": 0.0008087916666666665,
      "hi": 0.0008087916666666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 8389,
      "lo": 8389,
      "hi": 8389,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 13343.599999999995,
      "lo": 13343.599999999995,
      "hi": 13343.599999999995,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 16053.359999999991,
      "lo": 16053.359999999991,
      "hi": 16053.359999999991,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000957578197831979,
      "lo": 0.000957578197831979,
      "hi": 0.000957578197831979,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000957578197831979,
      "lo": 0.000957578197831979,
      "hi": 0.000957578197831979,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 7172,
      "lo": 7172,
      "hi": 7172,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 11856.049999999996,
      "lo": 11856.049999999996,
      "hi": 11856.049999999996,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 13998.410000000003,
      "lo": 13998.410000000003,
      "hi": 13998.410000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008087916666666665,
      "lo": 0.0008087916666666665,
      "hi": 0.0008087916666666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008087916666666665,
      "lo": 0.0008087916666666665,
      "hi": 0.0008087916666666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 8389,
      "lo": 8389,
      "hi": 8389,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 13343.599999999995,
      "lo": 13343.599999999995,
      "hi": 13343.599999999995,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 16053.359999999991,
      "lo": 16053.359999999991,
      "hi": 16053.359999999991,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000957578197831979,
      "lo": 0.000957578197831979,
      "hi": 0.000957578197831979,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000957578197831979,
      "lo": 0.000957578197831979,
      "hi": 0.000957578197831979,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 8355.5,
      "lo": 8355.5,
      "hi": 8355.5,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 13250.599999999999,
      "lo": 13250.599999999999,
      "hi": 13250.599999999999,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 15858.66000000002,
      "lo": 15858.66000000002,
      "hi": 15858.66000000002,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009554968619791671,
      "lo": 0.0009554968619791671,
      "hi": 0.0009554968619791671,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009554968619791671,
      "lo": 0.0009554968619791671,
      "hi": 0.0009554968619791671,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 8650,
      "lo": 8650,
      "hi": 8650,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 14417.199999999999,
      "lo": 14417.199999999999,
      "hi": 14417.199999999999,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 16469.92,
      "lo": 16469.92,
      "hi": 16469.92,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010157705072463765,
      "lo": 0.0010157705072463765,
      "hi": 0.0010157705072463765,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0010157705072463765,
      "lo": 0.0010157705072463765,
      "hi": 0.0010157705072463765,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 8392,
      "lo": 8392,
      "hi": 8392,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 13410.4,
      "lo": 13410.4,
      "hi": 13410.4,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 16542.88000000001,
      "lo": 16542.88000000001,
      "hi": 16542.88000000001,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009646776158940402,
      "lo": 0.0009646776158940402,
      "hi": 0.0009646776158940402,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009646776158940402,
      "lo": 0.0009646776158940402,
      "hi": 0.0009646776158940402,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 7773.5,
      "lo": 7773.5,
      "hi": 7773.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 12852.5,
      "lo": 12852.5,
      "hi": 12852.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 13015.3,
      "lo": 13015.3,
      "hi": 13015.3,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009418566666666667,
      "lo": 0.0009418566666666667,
      "hi": 0.0009418566666666667,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009418566666666667,
      "lo": 0.0009418566666666667,
      "hi": 0.0009418566666666667,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 8620.5,
      "lo": 8620.5,
      "hi": 8620.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 14084.199999999999,
      "lo": 14084.199999999999,
      "hi": 14084.199999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 14733.640000000001,
      "lo": 14733.640000000001,
      "hi": 14733.640000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009917004166666665,
      "lo": 0.0009917004166666665,
      "hi": 0.0009917004166666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009917004166666665,
      "lo": 0.0009917004166666665,
      "hi": 0.0009917004166666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 9423,
      "lo": 9423,
      "hi": 9423,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 14396.099999999999,
      "lo": 14396.099999999999,
      "hi": 14396.099999999999,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 14947.98,
      "lo": 14947.98,
      "hi": 14947.98,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011392785185185186,
      "lo": 0.0011392785185185186,
      "hi": 0.0011392785185185186,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011392785185185186,
      "lo": 0.0011392785185185186,
      "hi": 0.0011392785185185186,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 8341,
      "lo": 8341,
      "hi": 8341,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 13248.2,
      "lo": 13248.2,
      "hi": 13248.2,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 15819.719999999983,
      "lo": 15819.719999999983,
      "hi": 15819.719999999983,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009558043798449617,
      "lo": 0.0009558043798449617,
      "hi": 0.0009558043798449617,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009558043798449617,
      "lo": 0.0009558043798449617,
      "hi": 0.0009558043798449617,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 7172,
      "lo": 7172,
      "hi": 7172,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 11856.049999999996,
      "lo": 11856.049999999996,
      "hi": 11856.049999999996,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 13998.410000000003,
      "lo": 13998.410000000003,
      "hi": 13998.410000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008087916666666665,
      "lo": 0.0008087916666666665,
      "hi": 0.0008087916666666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008087916666666665,
      "lo": 0.0008087916666666665,
      "hi": 0.0008087916666666665,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 8781.5,
      "lo": 8781.5,
      "hi": 8781.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 13288.3,
      "lo": 13288.3,
      "hi": 13288.3,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 14051.259999999998,
      "lo": 14051.259999999998,
      "hi": 14051.259999999998,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009475844444444444,
      "lo": 0.0009475844444444444,
      "hi": 0.0009475844444444444,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009475844444444444,
      "lo": 0.0009475844444444444,
      "hi": 0.0009475844444444444,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 8400.5,
      "lo": 8400.5,
      "hi": 8400.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 12302.8,
      "lo": 12302.8,
      "hi": 12302.8,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 12493.57,
      "lo": 12493.57,
      "hi": 12493.57,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000990418125,
      "lo": 0.000990418125,
      "hi": 0.000990418125,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000990418125,
      "lo": 0.000990418125,
      "hi": 0.000990418125,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 8650,
      "lo": 8650,
      "hi": 8650,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 14026.199999999995,
      "lo": 14026.199999999995,
      "hi": 14026.199999999995,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 16229.239999999998,
      "lo": 16229.239999999998,
      "hi": 16229.239999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009890293333333332,
      "lo": 0.0009890293333333332,
      "hi": 0.0009890293333333332,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009890293333333332,
      "lo": 0.0009890293333333332,
      "hi": 0.0009890293333333332,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 11027,
      "lo": 11027,
      "hi": 11027,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 13125,
      "lo": 13125,
      "hi": 13125,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 14167.400000000001,
      "lo": 14167.400000000001,
      "hi": 14167.400000000001,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001213544761904762,
      "lo": 0.001213544761904762,
      "hi": 0.001213544761904762,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001213544761904762,
      "lo": 0.001213544761904762,
      "hi": 0.001213544761904762,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 8918,
      "lo": 8918,
      "hi": 8918,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 14715.5,
      "lo": 14715.5,
      "hi": 14715.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 15749.269999999993,
      "lo": 15749.269999999993,
      "hi": 15749.269999999993,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.00106092075,
      "lo": 0.00106092075,
      "hi": 0.00106092075,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0.00106092075,
      "lo": 0.00106092075,
      "hi": 0.00106092075,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 8161,
      "lo": 8161,
      "hi": 8161,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 13313.399999999996,
      "lo": 13313.399999999996,
      "hi": 13313.399999999996,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 16740.160000000003,
      "lo": 16740.160000000003,
      "hi": 16740.160000000003,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009317319819819824,
      "lo": 0.0009317319819819824,
      "hi": 0.0009317319819819824,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009317319819819824,
      "lo": 0.0009317319819819824,
      "hi": 0.0009317319819819824,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 8933.5,
      "lo": 8933.5,
      "hi": 8933.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 12912.099999999999,
      "lo": 12912.099999999999,
      "hi": 12912.099999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 13982.549999999997,
      "lo": 13982.549999999997,
      "hi": 13982.549999999997,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.00105128275,
      "lo": 0.00105128275,
      "hi": 0.00105128275,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0.00105128275,
      "lo": 0.00105128275,
      "hi": 0.00105128275,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 8209,
      "lo": 8209,
      "hi": 8209,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 14626.500000000002,
      "lo": 14626.500000000002,
      "hi": 14626.500000000002,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 15995.299999999997,
      "lo": 15995.299999999997,
      "hi": 15995.299999999997,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009581103846153847,
      "lo": 0.0009581103846153847,
      "hi": 0.0009581103846153847,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009581103846153847,
      "lo": 0.0009581103846153847,
      "hi": 0.0009581103846153847,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 7549,
      "lo": 7549,
      "hi": 7549,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 8806.9,
      "lo": 8806.9,
      "hi": 8806.9,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 8851.78,
      "lo": 8851.78,
      "hi": 8851.78,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007867445833333334,
      "lo": 0.0007867445833333334,
      "hi": 0.0007867445833333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007867445833333334,
      "lo": 0.0007867445833333334,
      "hi": 0.0007867445833333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 6255,
      "lo": 6255,
      "hi": 6255,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 9693.75,
      "lo": 9693.75,
      "hi": 9693.75,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 10052.35,
      "lo": 10052.35,
      "hi": 10052.35,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007467795833333334,
      "lo": 0.0007467795833333334,
      "hi": 0.0007467795833333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0007467795833333334,
      "lo": 0.0007467795833333334,
      "hi": 0.0007467795833333334,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 11221.5,
      "lo": 11221.5,
      "hi": 11221.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 14810.5,
      "lo": 14810.5,
      "hi": 14810.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 14993.27,
      "lo": 14993.27,
      "hi": 14993.27,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012627905,
      "lo": 0.0012627905,
      "hi": 0.0012627905,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0012627905,
      "lo": 0.0012627905,
      "hi": 0.0012627905,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 9640,
      "lo": 9640,
      "hi": 9640,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 12756.899999999998,
      "lo": 12756.899999999998,
      "hi": 12756.899999999998,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 14093.779999999997,
      "lo": 14093.779999999997,
      "hi": 14093.779999999997,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001113361111111111,
      "lo": 0.001113361111111111,
      "hi": 0.001113361111111111,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0.001113361111111111,
      "lo": 0.001113361111111111,
      "hi": 0.001113361111111111,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 10116,
      "lo": 10116,
      "hi": 10116,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 13125,
      "lo": 13125,
      "hi": 13125,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 16049.000000000004,
      "lo": 16049.000000000004,
      "hi": 16049.000000000004,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011109709523809523,
      "lo": 0.0011109709523809523,
      "hi": 0.0011109709523809523,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0011109709523809523,
      "lo": 0.0011109709523809523,
      "hi": 0.0011109709523809523,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 8638,
      "lo": 8638,
      "hi": 8638,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 11139,
      "lo": 11139,
      "hi": 11139,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 11303.8,
      "lo": 11303.8,
      "hi": 11303.8,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000986620238095238,
      "lo": 0.000986620238095238,
      "hi": 0.000986620238095238,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000986620238095238,
      "lo": 0.000986620238095238,
      "hi": 0.000986620238095238,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 8153,
      "lo": 8153,
      "hi": 8153,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 12822.399999999998,
      "lo": 12822.399999999998,
      "hi": 12822.399999999998,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 16946.71,
      "lo": 16946.71,
      "hi": 16946.71,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009282328061224487,
      "lo": 0.0009282328061224487,
      "hi": 0.0009282328061224487,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009282328061224487,
      "lo": 0.0009282328061224487,
      "hi": 0.0009282328061224487,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 8109,
      "lo": 8109,
      "hi": 8109,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 15650.099999999999,
      "lo": 15650.099999999999,
      "hi": 15650.099999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 16678.82,
      "lo": 16678.82,
      "hi": 16678.82,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009914649999999998,
      "lo": 0.0009914649999999998,
      "hi": 0.0009914649999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009914649999999998,
      "lo": 0.0009914649999999998,
      "hi": 0.0009914649999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 8269,
      "lo": 8269,
      "hi": 8269,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 9821.1,
      "lo": 9821.1,
      "hi": 9821.1,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 9965.02,
      "lo": 9965.02,
      "hi": 9965.02,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008352873333333334,
      "lo": 0.0008352873333333334,
      "hi": 0.0008352873333333334,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0008352873333333334,
      "lo": 0.0008352873333333334,
      "hi": 0.0008352873333333334,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 9353,
      "lo": 9353,
      "hi": 9353,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 12111.199999999999,
      "lo": 12111.199999999999,
      "hi": 12111.199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 12662.24,
      "lo": 12662.24,
      "hi": 12662.24,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009698209999999998,
      "lo": 0.0009698209999999998,
      "hi": 0.0009698209999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009698209999999998,
      "lo": 0.0009698209999999998,
      "hi": 0.0009698209999999998,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 7788,
      "lo": 7788,
      "hi": 7788,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 11143.199999999999,
      "lo": 11143.199999999999,
      "hi": 11143.199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 11789.439999999999,
      "lo": 11789.439999999999,
      "hi": 11789.439999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000846858,
      "lo": 0.000846858,
      "hi": 0.000846858,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000846858,
      "lo": 0.000846858,
      "hi": 0.000846858,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 8798,
      "lo": 8798,
      "hi": 8798,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 11521.199999999999,
      "lo": 11521.199999999999,
      "hi": 11521.199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 11881.84,
      "lo": 11881.84,
      "hi": 11881.84,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009150923333333334,
      "lo": 0.0009150923333333334,
      "hi": 0.0009150923333333334,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0.0009150923333333334,
      "lo": 0.0009150923333333334,
      "hi": 0.0009150923333333334,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 7626,
      "lo": 7626,
      "hi": 7626,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10330.5,
      "lo": 10330.5,
      "hi": 10330.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 10344.5,
      "lo": 10344.5,
      "hi": 10344.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000927021,
      "lo": 0.000927021,
      "hi": 0.000927021,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0.000927021,
      "lo": 0.000927021,
      "hi": 0.000927021,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "diy:claude-haiku-5.5",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9859649122807016,
      "lo": 0.9371692132513808,
      "hi": 0.9969867010277976,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9668386529330562,
      "hi": 1,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9962121212121212,
      "lo": 0.9511957419522293,
      "hi": 0.9997183055242792,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8541666666666667,
      "lo": 0.61583659599594,
      "hi": 0.955357963625501,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9889807162534434,
      "lo": 0.950233695496303,
      "hi": 0.9976351811666312,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9614325068870523,
      "lo": 0.9105926865022116,
      "hi": 0.9838751266867547,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9108527131782945,
      "lo": 0.8122605363984674,
      "hi": 0.9846743295019157,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9972451790633609,
      "lo": 0.9640940508491554,
      "hi": 0.9997951448559698,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9866666666666667,
      "lo": 0.9282663444557845,
      "hi": 0.9976424488609515,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9599186107143782,
      "hi": 1,
      "n": 92,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9500079920442688,
      "hi": 0.9999999999999998,
      "n": 73,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8181818181818182,
      "lo": 0.523019438039156,
      "hi": 0.9486323102539149,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.97,
      "lo": 0.9154806357094724,
      "hi": 0.9897454759759611,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9285714285714286,
      "lo": 0.806060606060606,
      "hi": 1,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9630065017930143,
      "hi": 1,
      "n": 100,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9444444444444444,
      "lo": 0.7424269921812741,
      "hi": 0.990124809021697,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9259259259259258,
      "lo": 0.7180678632488792,
      "hi": 0.9839609462373012,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8241207763533425,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.984126984126984,
      "lo": 0.8197054744620497,
      "hi": 0.9988186500710351,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8974358974358975,
      "lo": 0.7530864197530864,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8453609810751531,
      "hi": 1,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9835390946502056,
      "lo": 0.9268260532345567,
      "hi": 0.9964646871908851,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9590643744356734,
      "hi": 1,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9954954954954955,
      "lo": 0.9424208076176347,
      "hi": 0.9996649965841452,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9865319865319865,
      "lo": 0.939608228946637,
      "hi": 0.997108679175915,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9562289562289561,
      "lo": 0.8961310899009876,
      "hi": 0.9822435886499172,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9966329966329965,
      "lo": 0.9564147063138855,
      "hi": 0.9997496116658817,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8541666666666667,
      "lo": 0.61583659599594,
      "hi": 0.955357963625501,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8833333333333334,
      "lo": 0.6786711249982054,
      "hi": 0.9644662538279667,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9108527131782945,
      "lo": 0.8143849681020734,
      "hi": 0.9844961240310077,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.5958499732047615,
      "hi": 0.9821237869049271,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9727891156462586,
      "lo": 0.8826896443704225,
      "hi": 0.9941471116047543,
      "n": 49,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9416559278986275,
      "hi": 0.9999999999999999,
      "n": 62,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9934640522875818,
      "lo": 0.9182832734809443,
      "hi": 0.9995138532858647,
      "n": 51,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9952380952380953,
      "lo": 0.9393027381160545,
      "hi": 0.9996458476871096,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.980952380952381,
      "lo": 0.9159558711659866,
      "hi": 0.995907659277471,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9952380952380953,
      "lo": 0.9393027381160545,
      "hi": 0.9996458476871096,
      "n": 70,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9826839826839826,
      "lo": 0.9232146094426825,
      "hi": 0.9962805903928893,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.95626827158534,
      "hi": 0.9999999999999999,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9953051643192489,
      "lo": 0.9401134917950381,
      "hi": 0.9996508372493568,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9856630824372759,
      "lo": 0.9358743124031806,
      "hi": 0.9969217692893634,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9534050179211468,
      "lo": 0.8897505357137802,
      "hi": 0.9810886106633917,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9964157706093189,
      "lo": 0.9537149395960378,
      "hi": 0.9997334538682969,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9826839826839826,
      "lo": 0.9232146094426825,
      "hi": 0.9962805903928893,
      "n": 77,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.95626827158534,
      "hi": 0.9999999999999999,
      "n": 84,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9953051643192489,
      "lo": 0.9401134917950381,
      "hi": 0.9996508372493568,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9856630824372759,
      "lo": 0.9358743124031806,
      "hi": 0.9969217692893634,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9534050179211468,
      "lo": 0.8897505357137802,
      "hi": 0.9810886106633917,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9964157706093189,
      "lo": 0.9537149395960378,
      "hi": 0.9997334538682969,
      "n": 93,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9837398373983739,
      "lo": 0.9276764572931817,
      "hi": 0.9965078986489164,
      "n": 82,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9586234547637477,
      "hi": 1,
      "n": 89,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9954954954954955,
      "lo": 0.9424208076176347,
      "hi": 0.9996649965841452,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9863945578231291,
      "lo": 0.9390163998935291,
      "hi": 0.9970791199200738,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.95578231292517,
      "lo": 0.8951194264260135,
      "hi": 0.9820609907419783,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9206349206349206,
      "lo": 0.7999612403100776,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9965986394557822,
      "lo": 0.9559868312363212,
      "hi": 0.9997470561258187,
      "n": 98,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7846891972623643,
      "hi": 1,
      "n": 14,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9855072463768116,
      "lo": 0.8331247102869506,
      "hi": 0.998921471797418,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9015151515151515,
      "lo": 0.75,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8568833815495731,
      "hi": 1,
      "n": 23,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9859649122807016,
      "lo": 0.9371692132513808,
      "hi": 0.9969867010277976,
      "n": 95,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9668386529330562,
      "hi": 1,
      "n": 112,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9962121212121212,
      "lo": 0.9511957419522293,
      "hi": 0.9997183055242792,
      "n": 88,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.subtotal",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8541666666666667,
      "lo": 0.61583659599594,
      "hi": 0.955357963625501,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9889807162534434,
      "lo": 0.950233695496303,
      "hi": 0.9976351811666312,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.receipt_number",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7411670330319684,
      "hi": 1,
      "n": 11,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9614325068870523,
      "lo": 0.9105926865022116,
      "hi": 0.9838751266867547,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9108527131782945,
      "lo": 0.8216912459822273,
      "hi": 0.9844961240310077,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9972451790633609,
      "lo": 0.9640940508491554,
      "hi": 0.9997951448559698,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9839357429718875,
      "lo": 0.9285073245434474,
      "hi": 0.9965500665259674,
      "n": 83,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9590643744356734,
      "hi": 1,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9954954954954955,
      "lo": 0.9424208076176347,
      "hi": 0.9996649965841452,
      "n": 74,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9865319865319865,
      "lo": 0.939608228946637,
      "hi": 0.997108679175915,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9562289562289561,
      "lo": 0.8961310899009876,
      "hi": 0.9822435886499172,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9024390243902439,
      "lo": 0.7833333333333333,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9966329966329965,
      "lo": 0.9564147063138855,
      "hi": 0.9997496116658817,
      "n": 99,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8156818649911483,
      "hi": 1,
      "n": 17,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7575059933447592,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8833333333333334,
      "lo": 0.6786711249982054,
      "hi": 0.9644662538279667,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9534883720930233,
      "lo": 0.8536585365853658,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9774011299435028,
      "lo": 0.9012935311709601,
      "hi": 0.9951422675915979,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9493488274035422,
      "hi": 1,
      "n": 72,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9944444444444446,
      "lo": 0.9297988116076135,
      "hi": 0.9995868012740978,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9958847736625513,
      "lo": 0.9471701658972359,
      "hi": 0.9996939551348129,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9835390946502056,
      "lo": 0.9268260532345567,
      "hi": 0.9964646871908851,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9958847736625513,
      "lo": 0.9471701658972359,
      "hi": 0.9996939551348129,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8318207759473837,
      "hi": 1,
      "n": 19,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8063923194655637,
      "hi": 1,
      "n": 16,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.tax",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.95,
      "lo": 0.763868806553258,
      "hi": 0.9911185511992047,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "line_items_f1",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8682170542635659,
      "lo": 0.7121212121212122,
      "hi": 0.9859565375522814,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.8388748419471806,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7719046276458016,
      "hi": 0.9999999999999999,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.merchant",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9757575757575757,
      "lo": 0.8946078006966166,
      "hi": 0.9947877782404587,
      "n": 55,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.date",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.9388706294732116,
      "hi": 1,
      "n": 59,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.currency",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9935897435897437,
      "lo": 0.9197459966958835,
      "hi": 0.999523206104919,
      "n": 52,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "field_accuracy.total",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9950980392156862,
      "lo": 0.937613542532009,
      "hi": 0.9996354281687053,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "all_key_fields",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.980392156862745,
      "lo": 0.9136229260308151,
      "hi": 0.9957869663322545,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "extraction",
      "metric": "valid_json",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9950980392156862,
      "lo": 0.937613542532009,
      "hi": 0.9996354281687053,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8154320987654321,
      "lo": 0.7246836419753087,
      "hi": 0.892133487654321,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.1,
      "lo": 0.025,
      "hi": 0.7006249999999965,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.6,
      "lo": 0.45,
      "hi": 0.775,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.65,
      "lo": 0.5,
      "hi": 0.775,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5833333333333333,
      "lo": 0.4299143431347524,
      "hi": 0.7221487233323663,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5833333333333333,
      "lo": 0.4299143431347524,
      "hi": 0.7221487233323663,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.36666666666666664,
      "lo": 0.19352634117963496,
      "hi": 0.5827737009677836,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.36666666666666664,
      "lo": 0.19352634117963496,
      "hi": 0.5827737009677836,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9490740740740741,
      "lo": 0.8424768518518521,
      "hi": 1,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5833333333333334,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5833333333333334,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5833333333333334,
      "hi": 1,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5519691377470266,
      "hi": 0.9530348578161463,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.5519691377470266,
      "hi": 0.9530348578161463,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7542756539235412,
      "lo": 0.6438568913480885,
      "hi": 0.8586644869215292,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.6785714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.6785714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.32142857142857145,
      "hi": 0.6785714285714286,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4761904761904762,
      "lo": 0.30556744505147476,
      "hi": 0.6525584266040416,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4761904761904762,
      "lo": 0.30556744505147476,
      "hi": 0.6525584266040416,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7261764705882353,
      "lo": 0.6126323529411766,
      "hi": 0.8294191176470588,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4,
      "lo": 0.2,
      "hi": 0.6,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3733333333333333,
      "lo": 0.212875001908732,
      "hi": 0.5675337016624936,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3733333333333333,
      "lo": 0.212875001908732,
      "hi": 0.5675337016624936,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7261764705882353,
      "lo": 0.6111691176470588,
      "hi": 0.8335367647058823,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4,
      "lo": 0.24,
      "hi": 0.6,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.64,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.44,
      "lo": 0.24,
      "hi": 0.6,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3733333333333333,
      "lo": 0.212875001908732,
      "hi": 0.5675337016624936,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3733333333333333,
      "lo": 0.212875001908732,
      "hi": 0.5675337016624936,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7713235294117647,
      "lo": 0.6651899509803921,
      "hi": 0.8622610294117647,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4666666666666667,
      "lo": 0.3,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4444444444444445,
      "lo": 0.2832163663110796,
      "hi": 0.6182851218193613,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4444444444444445,
      "lo": 0.2832163663110796,
      "hi": 0.6182851218193613,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9423076923076923,
      "lo": 0.8038461538461539,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.2,
      "lo": 0,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.2,
      "lo": 0,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 1,
      "lo": 0.7224672001371107,
      "hi": 0.9999999999999999,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8154320987654321,
      "lo": 0.7314814814814815,
      "hi": 0.8927623456790122,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.1,
      "lo": 0.025,
      "hi": 0.725,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.6,
      "lo": 0.45,
      "hi": 0.775,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.65,
      "lo": 0.5,
      "hi": 0.8,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5833333333333333,
      "lo": 0.4299143431347524,
      "hi": 0.7221487233323663,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5833333333333333,
      "lo": 0.4299143431347524,
      "hi": 0.7221487233323663,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7707729468599034,
      "lo": 0.6678683574879227,
      "hi": 0.866183574879227,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4666666666666667,
      "lo": 0.3,
      "hi": 0.6666666666666666,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.3333333333333333,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5333333333333333,
      "lo": 0.36666666666666664,
      "hi": 0.7,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4444444444444445,
      "lo": 0.2832163663110796,
      "hi": 0.6182851218193613,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4444444444444445,
      "lo": 0.2832163663110796,
      "hi": 0.6182851218193613,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.07692307692307693,
      "lo": 0.013710421242556586,
      "hi": 0.3331395092109959,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4333333333333334,
      "lo": 0.190125658185213,
      "hi": 0.7135453817965056,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4333333333333334,
      "lo": 0.190125658185213,
      "hi": 0.7135453817965056,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.6,
      "lo": 0.3865815007622531,
      "hi": 0.781193467627183,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.6,
      "lo": 0.3865815007622531,
      "hi": 0.781193467627183,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5666666666666667,
      "lo": 0.3567251869311614,
      "hi": 0.7551247919951294,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5666666666666667,
      "lo": 0.3567251869311614,
      "hi": 0.7551247919951294,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.012345679012345678,
      "lo": 0.0021826500585387723,
      "hi": 0.06666881598048346,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9419753086419753,
      "lo": 0.879621913580247,
      "hi": 0.9950617283950617,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.1,
      "lo": 0,
      "hi": 0.95,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8,
      "lo": 0.65,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9,
      "lo": 0.75,
      "hi": 1,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8,
      "lo": 0.5839825677481064,
      "hi": 0.919342337420202,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8,
      "lo": 0.5839825677481064,
      "hi": 0.919342337420202,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.641358024691358,
      "lo": 0.4518055555555556,
      "hi": 0.812962962962963,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.5,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0,
      "hi": 0.6,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0,
      "hi": 0.6,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.3,
      "lo": 0.10779126740630099,
      "hi": 0.6032218525388546,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7364197530864197,
      "lo": 0.553070987654321,
      "hi": 0.908641975308642,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.2,
      "lo": 0,
      "hi": 0.7,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2,
      "hi": 0.8,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4333333333333334,
      "lo": 0.190125658185213,
      "hi": 0.7135453817965056,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.4333333333333334,
      "lo": 0.190125658185213,
      "hi": 0.7135453817965056,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7323232323232324,
      "lo": 0.6099817620650955,
      "hi": 0.8476430976430976,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.045454545454545456,
      "lo": 0,
      "hi": 0.6363636363636364,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.45454545454545453,
      "lo": 0.2727272727272727,
      "hi": 0.6818181818181818,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.5,
      "lo": 0.2727272727272727,
      "hi": 0.6818181818181818,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.45454545454545453,
      "lo": 0.2692029418081331,
      "hi": 0.6534020467926505,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.45454545454545453,
      "lo": 0.2692029418081331,
      "hi": 0.6534020467926505,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9170096021947873,
      "lo": 0.8367455418381345,
      "hi": 0.9849279835390946,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.16666666666666666,
      "lo": 0,
      "hi": 0.8888888888888888,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7777777777777778,
      "lo": 0.6111111111111112,
      "hi": 0.9444444444444444,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.8333333333333334,
      "lo": 0.6666666666666666,
      "hi": 1,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7407407407407408,
      "lo": 0.5098011521132653,
      "hi": 0.8869977402050109,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.7407407407407408,
      "lo": 0.5098011521132653,
      "hi": 0.8869977402050109,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9917355371900827,
      "lo": 0.9546693563957512,
      "hi": 0.9985396266145802,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.9917355371900827,
      "lo": 0.9546693563957512,
      "hi": 0.9985396266145802,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.10196132596685077,
      "lo": 0.06583045580110469,
      "hi": 0.15804615593578283,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 624.4444444444445,
      "lo": 308.33333333333337,
      "hi": 1106.6666666666665,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 624.4444444444445,
      "lo": 300.00000000000006,
      "hi": 1140,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:gemini-3.8-flash",
      "value": 251.33333333333334,
      "lo": 30.000000000000004,
      "hi": 678.1666666666667,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:gemini-3.8-flash",
      "value": 251.33333333333334,
      "lo": 30.000000000000004,
      "hi": 678.1875,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:gemini-3.8-flash",
      "value": 2282.716049382717,
      "lo": 1458.3333333333337,
      "hi": 3098.1481481481483,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:gemini-3.8-flash",
      "value": 2282.716049382717,
      "lo": 1449.1589506172843,
      "hi": 3148.9891975308633,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "diy:gemini-3.8-flash",
      "value": 341.11111111111114,
      "lo": 96.00000000000001,
      "hi": 783.3333333333334,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "diy:gemini-3.8-flash",
      "value": 341.11111111111114,
      "lo": 98.66666666666669,
      "hi": 780.6666666666666,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "diy:gemini-3.8-flash",
      "value": 966.1111111111112,
      "lo": 530.8333333333335,
      "hi": 1518.1666666666667,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "diy:gemini-3.8-flash",
      "value": 966.1111111111112,
      "lo": 546,
      "hi": 1543.9444444444446,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "diy:gemini-3.8-flash",
      "value": 514.4444444444445,
      "lo": 300.00000000000006,
      "hi": 791.1111111111111,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "diy:gemini-3.8-flash",
      "value": 514.4444444444445,
      "lo": 300.00000000000006,
      "hi": 784.9999999999999,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1308.8888888888887,
      "lo": 300.00000000000006,
      "hi": 3218.3333333333335,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1308.8888888888887,
      "lo": 300.00000000000006,
      "hi": 3193.3333333333335,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "diy:gemini-3.8-flash",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "diy:gemini-3.8-flash",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "diy:gemini-3.8-flash",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "diy:gemini-3.8-flash",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.36666666666666664,
      "lo": 0.19352634117963496,
      "hi": 0.5827737009677836,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 6369,
      "lo": 6369,
      "hi": 6369,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 15974.599999999999,
      "lo": 15974.599999999999,
      "hi": 15974.599999999999,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 20236.72,
      "lo": 20236.72,
      "hi": 20236.72,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004363488410596028,
      "lo": 0.004363488410596028,
      "hi": 0.004363488410596028,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004363488410596028,
      "lo": 0.004363488410596028,
      "hi": 0.004363488410596028,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 6108,
      "lo": 6108,
      "hi": 6108,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 12772.699999999993,
      "lo": 12772.699999999993,
      "hi": 12772.699999999993,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 18357.210000000003,
      "lo": 18357.210000000003,
      "hi": 18357.210000000003,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00400108653846154,
      "lo": 0.00400108653846154,
      "hi": 0.00400108653846154,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00400108653846154,
      "lo": 0.00400108653846154,
      "hi": 0.00400108653846154,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 11242,
      "lo": 11242,
      "hi": 11242,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 20898.04999999999,
      "lo": 20898.04999999999,
      "hi": 20898.04999999999,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 35484.98999999999,
      "lo": 35484.98999999999,
      "hi": 35484.98999999999,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006871499999999998,
      "lo": 0.006871499999999998,
      "hi": 0.006871499999999998,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006871499999999998,
      "lo": 0.006871499999999998,
      "hi": 0.006871499999999998,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 11132,
      "lo": 11132,
      "hi": 11132,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 22161,
      "lo": 22161,
      "hi": 22161,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 35753.000000000015,
      "lo": 35753.000000000015,
      "hi": 35753.000000000015,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0.007275678571428571,
      "lo": 0.007275678571428571,
      "hi": 0.007275678571428571,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0.007275678571428571,
      "lo": 0.007275678571428571,
      "hi": 0.007275678571428571,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 8990,
      "lo": 8990,
      "hi": 8990,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 17287.35,
      "lo": 17287.35,
      "hi": 17287.35,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 24889.679999999957,
      "lo": 24889.679999999957,
      "hi": 24889.679999999957,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0053912625,
      "lo": 0.0053912625,
      "hi": 0.0053912625,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0053912625,
      "lo": 0.0053912625,
      "hi": 0.0053912625,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 9534,
      "lo": 9534,
      "hi": 9534,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 18416.3,
      "lo": 18416.3,
      "hi": 18416.3,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 19736.260000000002,
      "lo": 19736.260000000002,
      "hi": 19736.260000000002,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0056504599999999995,
      "lo": 0.0056504599999999995,
      "hi": 0.0056504599999999995,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0056504599999999995,
      "lo": 0.0056504599999999995,
      "hi": 0.0056504599999999995,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 6108,
      "lo": 6108,
      "hi": 6108,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 13345.100000000004,
      "lo": 13345.100000000004,
      "hi": 13345.100000000004,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 19979.11000000001,
      "lo": 19979.11000000001,
      "hi": 19979.11000000001,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004079785416666668,
      "lo": 0.004079785416666668,
      "hi": 0.004079785416666668,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004079785416666668,
      "lo": 0.004079785416666668,
      "hi": 0.004079785416666668,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 5520,
      "lo": 5520,
      "hi": 5520,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 7933.5999999999985,
      "lo": 7933.5999999999985,
      "hi": 7933.5999999999985,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 8472.32,
      "lo": 8472.32,
      "hi": 8472.32,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037044000000000005,
      "lo": 0.0037044000000000005,
      "hi": 0.0037044000000000005,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037044000000000005,
      "lo": 0.0037044000000000005,
      "hi": 0.0037044000000000005,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 10290,
      "lo": 10290,
      "hi": 10290,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 19599.55,
      "lo": 19599.55,
      "hi": 19599.55,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 29126.899999999943,
      "lo": 29126.899999999943,
      "hi": 29126.899999999943,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006454249999999999,
      "lo": 0.006454249999999999,
      "hi": 0.006454249999999999,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006454249999999999,
      "lo": 0.006454249999999999,
      "hi": 0.006454249999999999,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 8113.5,
      "lo": 8113.5,
      "hi": 8113.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 16008.5,
      "lo": 16008.5,
      "hi": 16008.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 27545.570000000014,
      "lo": 27545.570000000014,
      "hi": 27545.570000000014,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00513645,
      "lo": 0.00513645,
      "hi": 0.00513645,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00513645,
      "lo": 0.00513645,
      "hi": 0.00513645,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 5735,
      "lo": 5735,
      "hi": 5735,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 8402.249999999998,
      "lo": 8402.249999999998,
      "hi": 8402.249999999998,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 9597.159999999998,
      "lo": 9597.159999999998,
      "hi": 9597.159999999998,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0035825916666666667,
      "lo": 0.0035825916666666667,
      "hi": 0.0035825916666666667,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0035825916666666667,
      "lo": 0.0035825916666666667,
      "hi": 0.0035825916666666667,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 5853.5,
      "lo": 5853.5,
      "hi": 5853.5,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 12816.699999999997,
      "lo": 12816.699999999997,
      "hi": 12816.699999999997,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 18879.01,
      "lo": 18879.01,
      "hi": 18879.01,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003876792857142857,
      "lo": 0.003876792857142857,
      "hi": 0.003876792857142857,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003876792857142857,
      "lo": 0.003876792857142857,
      "hi": 0.003876792857142857,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 6272,
      "lo": 6272,
      "hi": 6272,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 9605.599999999999,
      "lo": 9605.599999999999,
      "hi": 9605.599999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 11878.48,
      "lo": 11878.48,
      "hi": 11878.48,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003920295454545456,
      "lo": 0.003920295454545456,
      "hi": 0.003920295454545456,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003920295454545456,
      "lo": 0.003920295454545456,
      "hi": 0.003920295454545456,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 10414.5,
      "lo": 10414.5,
      "hi": 10414.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 17300.85,
      "lo": 17300.85,
      "hi": 17300.85,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 19068.83,
      "lo": 19068.83,
      "hi": 19068.83,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0056460749999999995,
      "lo": 0.0056460749999999995,
      "hi": 0.0056460749999999995,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0056460749999999995,
      "lo": 0.0056460749999999995,
      "hi": 0.0056460749999999995,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 6883.5,
      "lo": 6883.5,
      "hi": 6883.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 13759.199999999999,
      "lo": 13759.199999999999,
      "hi": 13759.199999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 14875.04,
      "lo": 14875.04,
      "hi": 14875.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635875,
      "lo": 0.004635875,
      "hi": 0.004635875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635875,
      "lo": 0.004635875,
      "hi": 0.004635875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 6063,
      "lo": 6063,
      "hi": 6063,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 14121,
      "lo": 14121,
      "hi": 14121,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 20230.48,
      "lo": 20230.48,
      "hi": 20230.48,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00407941463414634,
      "lo": 0.00407941463414634,
      "hi": 0.00407941463414634,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00407941463414634,
      "lo": 0.00407941463414634,
      "hi": 0.00407941463414634,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 6883.5,
      "lo": 6883.5,
      "hi": 6883.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 13759.199999999999,
      "lo": 13759.199999999999,
      "hi": 13759.199999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 14875.04,
      "lo": 14875.04,
      "hi": 14875.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635875,
      "lo": 0.004635875,
      "hi": 0.004635875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635875,
      "lo": 0.004635875,
      "hi": 0.004635875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 6063,
      "lo": 6063,
      "hi": 6063,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 14121,
      "lo": 14121,
      "hi": 14121,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 20230.48,
      "lo": 20230.48,
      "hi": 20230.48,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00407941463414634,
      "lo": 0.00407941463414634,
      "hi": 0.00407941463414634,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00407941463414634,
      "lo": 0.00407941463414634,
      "hi": 0.00407941463414634,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 6132.5,
      "lo": 6132.5,
      "hi": 6132.5,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 15346.599999999959,
      "lo": 15346.599999999959,
      "hi": 15346.599999999959,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 20224.63,
      "lo": 20224.63,
      "hi": 20224.63,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004164300781250001,
      "lo": 0.004164300781250001,
      "hi": 0.004164300781250001,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004164300781250001,
      "lo": 0.004164300781250001,
      "hi": 0.004164300781250001,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 9097,
      "lo": 9097,
      "hi": 9097,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 17721.39999999999,
      "lo": 17721.39999999999,
      "hi": 17721.39999999999,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 20151.599999999973,
      "lo": 20151.599999999973,
      "hi": 20151.599999999973,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005472010869565217,
      "lo": 0.005472010869565217,
      "hi": 0.005472010869565217,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005472010869565217,
      "lo": 0.005472010869565217,
      "hi": 0.005472010869565217,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 6369,
      "lo": 6369,
      "hi": 6369,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 15974.599999999999,
      "lo": 15974.599999999999,
      "hi": 15974.599999999999,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 20236.72,
      "lo": 20236.72,
      "hi": 20236.72,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004363488410596028,
      "lo": 0.004363488410596028,
      "hi": 0.004363488410596028,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004363488410596028,
      "lo": 0.004363488410596028,
      "hi": 0.004363488410596028,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 6377,
      "lo": 6377,
      "hi": 6377,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 13145.949999999997,
      "lo": 13145.949999999997,
      "hi": 13145.949999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 15482.790000000003,
      "lo": 15482.790000000003,
      "hi": 15482.790000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004184875,
      "lo": 0.004184875,
      "hi": 0.004184875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004184875,
      "lo": 0.004184875,
      "hi": 0.004184875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 6492,
      "lo": 6492,
      "hi": 6492,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 9507.149999999998,
      "lo": 9507.149999999998,
      "hi": 9507.149999999998,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 10425.43,
      "lo": 10425.43,
      "hi": 10425.43,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003807,
      "lo": 0.003807,
      "hi": 0.003807,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003807,
      "lo": 0.003807,
      "hi": 0.003807,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 12200,
      "lo": 12200,
      "hi": 12200,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 19044.1,
      "lo": 19044.1,
      "hi": 19044.1,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 28997.519999999982,
      "lo": 28997.519999999982,
      "hi": 28997.519999999982,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0072509166666666685,
      "lo": 0.0072509166666666685,
      "hi": 0.0072509166666666685,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0072509166666666685,
      "lo": 0.0072509166666666685,
      "hi": 0.0072509166666666685,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 6139,
      "lo": 6139,
      "hi": 6139,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 13979.399999999994,
      "lo": 13979.399999999994,
      "hi": 13979.399999999994,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 20223.46,
      "lo": 20223.46,
      "hi": 20223.46,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004137955426356589,
      "lo": 0.004137955426356589,
      "hi": 0.004137955426356589,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004137955426356589,
      "lo": 0.004137955426356589,
      "hi": 0.004137955426356589,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 6883.5,
      "lo": 6883.5,
      "hi": 6883.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 13759.199999999999,
      "lo": 13759.199999999999,
      "hi": 13759.199999999999,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 14875.04,
      "lo": 14875.04,
      "hi": 14875.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635875,
      "lo": 0.004635875,
      "hi": 0.004635875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0.004635875,
      "lo": 0.004635875,
      "hi": 0.004635875,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 8739,
      "lo": 8739,
      "hi": 8739,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 14730.899999999994,
      "lo": 14730.899999999994,
      "hi": 14730.899999999994,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 17604.579999999994,
      "lo": 17604.579999999994,
      "hi": 17604.579999999994,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0048600833333333334,
      "lo": 0.0048600833333333334,
      "hi": 0.0048600833333333334,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0048600833333333334,
      "lo": 0.0048600833333333334,
      "hi": 0.0048600833333333334,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 9208.5,
      "lo": 9208.5,
      "hi": 9208.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 13942.349999999999,
      "lo": 13942.349999999999,
      "hi": 13942.349999999999,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 16494.01,
      "lo": 16494.01,
      "hi": 16494.01,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005437843750000001,
      "lo": 0.005437843750000001,
      "hi": 0.005437843750000001,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005437843750000001,
      "lo": 0.005437843750000001,
      "hi": 0.005437843750000001,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 12090,
      "lo": 12090,
      "hi": 12090,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 18913.899999999998,
      "lo": 18913.899999999998,
      "hi": 18913.899999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 19436.38,
      "lo": 19436.38,
      "hi": 19436.38,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006930500000000002,
      "lo": 0.006930500000000002,
      "hi": 0.006930500000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0.006930500000000002,
      "lo": 0.006930500000000002,
      "hi": 0.006930500000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 11132,
      "lo": 11132,
      "hi": 11132,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 22161,
      "lo": 22161,
      "hi": 22161,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 35753.000000000015,
      "lo": 35753.000000000015,
      "hi": 35753.000000000015,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.007275678571428571,
      "lo": 0.007275678571428571,
      "hi": 0.007275678571428571,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0.007275678571428571,
      "lo": 0.007275678571428571,
      "hi": 0.007275678571428571,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 9725,
      "lo": 9725,
      "hi": 9725,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 18810.34999999999,
      "lo": 18810.34999999999,
      "hi": 18810.34999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 35069.96999999998,
      "lo": 35069.96999999998,
      "hi": 35069.96999999998,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0059280125,
      "lo": 0.0059280125,
      "hi": 0.0059280125,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0059280125,
      "lo": 0.0059280125,
      "hi": 0.0059280125,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 5838,
      "lo": 5838,
      "hi": 5838,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 11473.399999999992,
      "lo": 11473.399999999992,
      "hi": 11473.399999999992,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 17888.44000000001,
      "lo": 17888.44000000001,
      "hi": 17888.44000000001,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003801590090090089,
      "lo": 0.003801590090090089,
      "hi": 0.003801590090090089,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0.003801590090090089,
      "lo": 0.003801590090090089,
      "hi": 0.003801590090090089,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 10297,
      "lo": 10297,
      "hi": 10297,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 19057.8,
      "lo": 19057.8,
      "hi": 19057.8,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 19963.12,
      "lo": 19963.12,
      "hi": 19963.12,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0059175,
      "lo": 0.0059175,
      "hi": 0.0059175,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0059175,
      "lo": 0.0059175,
      "hi": 0.0059175,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 7761,
      "lo": 7761,
      "hi": 7761,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 18384.100000000002,
      "lo": 18384.100000000002,
      "hi": 18384.100000000002,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 21293.09999999999,
      "lo": 21293.09999999999,
      "hi": 21293.09999999999,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005005673076923077,
      "lo": 0.005005673076923077,
      "hi": 0.005005673076923077,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005005673076923077,
      "lo": 0.005005673076923077,
      "hi": 0.005005673076923077,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 10723,
      "lo": 10723,
      "hi": 10723,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 23342.149999999987,
      "lo": 23342.149999999987,
      "hi": 23342.149999999987,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 30455.63000000001,
      "lo": 30455.63000000001,
      "hi": 30455.63000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0066628749999999995,
      "lo": 0.0066628749999999995,
      "hi": 0.0066628749999999995,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0066628749999999995,
      "lo": 0.0066628749999999995,
      "hi": 0.0066628749999999995,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 5798,
      "lo": 5798,
      "hi": 5798,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 13481.9,
      "lo": 13481.9,
      "hi": 13481.9,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 13632.380000000001,
      "lo": 13632.380000000001,
      "hi": 13632.380000000001,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0043035,
      "lo": 0.0043035,
      "hi": 0.0043035,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0043035,
      "lo": 0.0043035,
      "hi": 0.0043035,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 10414.5,
      "lo": 10414.5,
      "hi": 10414.5,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 17300.85,
      "lo": 17300.85,
      "hi": 17300.85,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 19068.83,
      "lo": 19068.83,
      "hi": 19068.83,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0056460749999999995,
      "lo": 0.0056460749999999995,
      "hi": 0.0056460749999999995,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0056460749999999995,
      "lo": 0.0056460749999999995,
      "hi": 0.0056460749999999995,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 10115.5,
      "lo": 10115.5,
      "hi": 10115.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 19664.649999999998,
      "lo": 19664.649999999998,
      "hi": 19664.649999999998,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 20107.329999999998,
      "lo": 20107.329999999998,
      "hi": 20107.329999999998,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0064102916666666674,
      "lo": 0.0064102916666666674,
      "hi": 0.0064102916666666674,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0064102916666666674,
      "lo": 0.0064102916666666674,
      "hi": 0.0064102916666666674,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 11308,
      "lo": 11308,
      "hi": 11308,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 22161,
      "lo": 22161,
      "hi": 22161,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 35753.000000000015,
      "lo": 35753.000000000015,
      "hi": 35753.000000000015,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0075806785714285715,
      "lo": 0.0075806785714285715,
      "hi": 0.0075806785714285715,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0075806785714285715,
      "lo": 0.0075806785714285715,
      "hi": 0.0075806785714285715,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 8885,
      "lo": 8885,
      "hi": 8885,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 12833,
      "lo": 12833,
      "hi": 12833,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 13303.4,
      "lo": 13303.4,
      "hi": 13303.4,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005365500000000001,
      "lo": 0.005365500000000001,
      "hi": 0.005365500000000001,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0.005365500000000001,
      "lo": 0.005365500000000001,
      "hi": 0.005365500000000001,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 5791,
      "lo": 5791,
      "hi": 5791,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 9582.999999999976,
      "lo": 9582.999999999976,
      "hi": 9582.999999999976,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 16075.589999999997,
      "lo": 16075.589999999997,
      "hi": 16075.589999999997,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0036418647959183667,
      "lo": 0.0036418647959183667,
      "hi": 0.0036418647959183667,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0036418647959183667,
      "lo": 0.0036418647959183667,
      "hi": 0.0036418647959183667,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 5535,
      "lo": 5535,
      "hi": 5535,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 8413.099999999999,
      "lo": 8413.099999999999,
      "hi": 8413.099999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 9072.22,
      "lo": 9072.22,
      "hi": 9072.22,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00360505,
      "lo": 0.00360505,
      "hi": 0.00360505,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0.00360505,
      "lo": 0.00360505,
      "hi": 0.00360505,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 5326,
      "lo": 5326,
      "hi": 5326,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 7024.799999999999,
      "lo": 7024.799999999999,
      "hi": 7024.799999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 7565.759999999999,
      "lo": 7565.759999999999,
      "hi": 7565.759999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0033117999999999997,
      "lo": 0.0033117999999999997,
      "hi": 0.0033117999999999997,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0033117999999999997,
      "lo": 0.0033117999999999997,
      "hi": 0.0033117999999999997,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 5840,
      "lo": 5840,
      "hi": 5840,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 8742.099999999995,
      "lo": 8742.099999999995,
      "hi": 8742.099999999995,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 11103.619999999997,
      "lo": 11103.619999999997,
      "hi": 11103.619999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037122,
      "lo": 0.0037122,
      "hi": 0.0037122,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037122,
      "lo": 0.0037122,
      "hi": 0.0037122,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 5832,
      "lo": 5832,
      "hi": 5832,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 7746.199999999997,
      "lo": 7746.199999999997,
      "hi": 7746.199999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 9019.64,
      "lo": 9019.64,
      "hi": 9019.64,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0036022,
      "lo": 0.0036022,
      "hi": 0.0036022,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0036022,
      "lo": 0.0036022,
      "hi": 0.0036022,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 5831,
      "lo": 5831,
      "hi": 5831,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 8455.9,
      "lo": 8455.9,
      "hi": 8455.9,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 9023.18,
      "lo": 9023.18,
      "hi": 9023.18,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0035599000000000004,
      "lo": 0.0035599000000000004,
      "hi": 0.0035599000000000004,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0035599000000000004,
      "lo": 0.0035599000000000004,
      "hi": 0.0035599000000000004,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 5520,
      "lo": 5520,
      "hi": 5520,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 7933.5999999999985,
      "lo": 7933.5999999999985,
      "hi": 7933.5999999999985,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 8472.32,
      "lo": 8472.32,
      "hi": 8472.32,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037044000000000005,
      "lo": 0.0037044000000000005,
      "hi": 0.0037044000000000005,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0.0037044000000000005,
      "lo": 0.0037044000000000005,
      "hi": 0.0037044000000000005,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "diy:gemini-3.8-flash",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.6479938271604938,
      "lo": 0.5361111111111111,
      "hi": 0.7547878086419754,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.125,
      "hi": 0.425,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.3,
      "lo": 0.175,
      "hi": 0.475,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.35,
      "lo": 0.225,
      "hi": 0.55,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.225,
      "lo": 0.12316091323540743,
      "hi": 0.37503096742310027,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.225,
      "lo": 0.12316091323540743,
      "hi": 0.37503096742310027,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.16112515805281938,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.16112515805281938,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.8333333333333334,
      "lo": 0.6388888888888888,
      "hi": 0.9722222222222222,
      "n": 21,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 0.9166666666666666,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 0.9166666666666666,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.6666666666666666,
      "lo": 0.4166666666666667,
      "hi": 0.9166666666666666,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.5833333333333334,
      "lo": 0.31951131254954973,
      "hi": 0.8067396863412435,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.5870221327967807,
      "lo": 0.44893737424547286,
      "hi": 0.7190769617706237,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.10714285714285714,
      "lo": 0,
      "hi": 0.2857142857142857,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.17857142857142858,
      "lo": 0.03571428571428571,
      "hi": 0.35714285714285715,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.07142857142857142,
      "hi": 0.4294642857142808,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.07142857142857142,
      "lo": 0.019812064115305755,
      "hi": 0.22645362568399052,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.07142857142857142,
      "lo": 0.019812064115305755,
      "hi": 0.22645362568399052,
      "n": 28,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.05132795219689034,
      "n": 71,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.5258823529411765,
      "lo": 0.37969117647058825,
      "hi": 0.6655882352941176,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.04,
      "lo": 0,
      "hi": 0.24,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.12,
      "lo": 0,
      "hi": 0.36,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.04,
      "hi": 0.4,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13319225093904846,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13319225093904846,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.5258823529411765,
      "lo": 0.3796691176470589,
      "hi": 0.6647132352941176,
      "n": 93,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.04,
      "lo": 0,
      "hi": 0.24,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.12,
      "lo": 0,
      "hi": 0.32,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.04,
      "hi": 0.4,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13319225093904846,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13319225093904846,
      "n": 25,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.5482843137254902,
      "lo": 0.4124877450980392,
      "hi": 0.6806678921568626,
      "n": 98,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.06666666666666667,
      "lo": 0,
      "hi": 0.23333333333333334,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.13333333333333333,
      "lo": 0.03333333333333333,
      "hi": 0.3333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.06666666666666667,
      "hi": 0.4,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.03333333333333333,
      "lo": 0.005908590381612455,
      "hi": 0.16670390991409173,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.03333333333333333,
      "lo": 0.005908590381612455,
      "hi": 0.16670390991409173,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.9230769230769231,
      "lo": 0.7692307692307693,
      "hi": 1,
      "n": 23,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.5,
      "hi": 1,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.49016247153664183,
      "hi": 0.9433178485456247,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.8,
      "lo": 0.49016247153664183,
      "hi": 0.9433178485456247,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.6479938271604938,
      "lo": 0.5340779320987655,
      "hi": 0.757739197530864,
      "n": 121,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.15,
      "hi": 0.425,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.3,
      "lo": 0.175,
      "hi": 0.475,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.35,
      "lo": 0.2,
      "hi": 0.55,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.225,
      "lo": 0.12316091323540743,
      "hi": 0.37503096742310027,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.225,
      "lo": 0.12316091323540743,
      "hi": 0.37503096742310027,
      "n": 40,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.5785024154589372,
      "lo": 0.4438405797101451,
      "hi": 0.7091847826086956,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.13333333333333333,
      "lo": 0.03333333333333333,
      "hi": 0.3333333333333333,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.06666666666666667,
      "hi": 0.4,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.26666666666666666,
      "lo": 0.1,
      "hi": 0.4666666666666667,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0.03459988874733419,
      "hi": 0.25621082579184085,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0.03459988874733419,
      "hi": 0.25621082579184085,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.22809537235419838,
      "n": 13,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.053471336520070537,
      "n": 68,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.11186170140766569,
      "hi": 0.468700877618744,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.25,
      "lo": 0.11186170140766569,
      "hi": 0.468700877618744,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.08065766257979806,
      "hi": 0.41601743225189364,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0.08065766257979806,
      "hi": 0.41601743225189364,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_5",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "false_flag_rate_at_risk_0_7",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.045278085432415204,
      "n": 81,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.7280864197530864,
      "lo": 0.5681867283950618,
      "hi": 0.8651311728395061,
      "n": 101,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.45,
      "lo": 0.25,
      "hi": 0.6512499999999932,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.45,
      "lo": 0.25,
      "hi": 0.7,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.5,
      "lo": 0.3,
      "hi": 0.7,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.45,
      "lo": 0.2581978582556243,
      "hi": 0.6579146575496577,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.45,
      "lo": 0.2581978582556243,
      "hi": 0.6579146575496577,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.6407407407407407,
      "lo": 0.44012345679012344,
      "hi": 0.8327314814814814,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0,
      "hi": 0.4,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.2,
      "lo": 0,
      "hi": 0.6,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.3,
      "lo": 0,
      "hi": 0.6,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.49506172839506174,
      "lo": 0.3012191358024692,
      "hi": 0.6858179012345678,
      "n": 91,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.3,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0,
      "hi": 0.3,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.1,
      "lo": 0,
      "hi": 0.5,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.2775327998628892,
      "n": 10,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.6554433221099888,
      "lo": 0.5193602693602694,
      "hi": 0.7895693041526375,
      "n": 103,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.09090909090909091,
      "hi": 0.45454545454545453,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.09090909090909091,
      "hi": 0.45454545454545453,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.13636363636363635,
      "hi": 0.5,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.13150760287989469,
      "hi": 0.4815173401240238,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2727272727272727,
      "lo": 0.13150760287989469,
      "hi": 0.4815173401240238,
      "n": 22,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "auc",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.6388888888888888,
      "lo": 0.4639574759945131,
      "hi": 0.8079646776406034,
      "n": 99,
      "unit": "auc",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_1",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.2222222222222222,
      "lo": 0.05555555555555555,
      "hi": 0.5,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_5",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.3333333333333333,
      "lo": 0.16666666666666666,
      "hi": 0.6111111111111112,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_fpr_10",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.4444444444444444,
      "lo": 0.2222222222222222,
      "hi": 0.6666666666666666,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_5",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.16666666666666666,
      "lo": 0.05836576805861446,
      "hi": 0.39222038103915724,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "authenticity",
      "metric": "detection_at_risk_0_7",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.16666666666666666,
      "lo": 0.05836576805861446,
      "hi": 0.39222038103915724,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "decision_consistency",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "total_consistency",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 1,
      "lo": 0.9692293020525218,
      "hi": 1,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "decisions",
      "metric": "calibration_error",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.18347107438016522,
      "lo": 0.14495661157024786,
      "hi": 0.2177727272727272,
      "n": 121,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 625,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 650,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_0_1pct",
      "target": "decision:gpt-6-luna",
      "value": 77.50000000000001,
      "lo": 65,
      "hi": 90.00000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_0_1pct",
      "target": "decision:gpt-6-luna",
      "value": 77.50000000000001,
      "lo": 65,
      "hi": 90.00000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fakes_5pct",
      "target": "decision:gpt-6-luna",
      "value": 3875.000000000001,
      "lo": 3250,
      "hi": 4500.000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fakes_5pct",
      "target": "decision:gpt-6-luna",
      "value": 3875.000000000001,
      "lo": 3250,
      "hi": 4500.000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_32usd",
      "target": "decision:gpt-6-luna",
      "value": 248.00000000000003,
      "lo": 207.80000000000038,
      "hi": 288.00000000000006,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_32usd",
      "target": "decision:gpt-6-luna",
      "value": 248.00000000000003,
      "lo": 208.00000000000003,
      "hi": 288.00000000000006,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=fake_182usd",
      "target": "decision:gpt-6-luna",
      "value": 1410.5,
      "lo": 1183,
      "hi": 1638.0000000000002,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=fake_182usd",
      "target": "decision:gpt-6-luna",
      "value": 1410.5,
      "lo": 1183,
      "hi": 1638.0000000000002,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_8usd",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 650,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_8usd",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 650,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_5",
      "stratum": "assumption=review_73usd",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 650,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "expected_cost_per_1000_at_risk_0_7",
      "stratum": "assumption=review_73usd",
      "target": "decision:gpt-6-luna",
      "value": 775.0000000000001,
      "lo": 650,
      "hi": 900.0000000000001,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_0_1pct",
      "target": "decision:gpt-6-luna",
      "value": 100,
      "lo": 100,
      "hi": 100,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fakes_5pct",
      "target": "decision:gpt-6-luna",
      "value": 5000,
      "lo": 5000,
      "hi": 5000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_32usd",
      "target": "decision:gpt-6-luna",
      "value": 320,
      "lo": 320,
      "hi": 320,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=fake_182usd",
      "target": "decision:gpt-6-luna",
      "value": 1820,
      "lo": 1820,
      "hi": 1820,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_8usd",
      "target": "decision:gpt-6-luna",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "decisions",
      "metric": "approve_all_cost_per_1000",
      "stratum": "assumption=review_73usd",
      "target": "decision:gpt-6-luna",
      "value": 1000,
      "lo": 1000,
      "hi": 1000,
      "n": 121,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "evidence",
      "metric": "edited_field_named",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.16112515805281938,
      "n": 20,
      "unit": "rate",
      "higherIsBetter": true
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 358,
      "lo": 358,
      "hi": 358,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 556.5999999999999,
      "lo": 556.5999999999999,
      "hi": 556.5999999999999,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 862.5200000000009,
      "lo": 862.5200000000009,
      "hi": 862.5200000000009,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "all",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 359.5,
      "lo": 359.5,
      "hi": 359.5,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 547.3499999999992,
      "lo": 547.3499999999992,
      "hi": 547.3499999999992,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 844.3900000000007,
      "lo": 844.3900000000007,
      "hi": 844.3900000000007,
      "n": 390,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016913846153846185,
      "lo": 0.00016913846153846185,
      "hi": 0.00016913846153846185,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016913846153846185,
      "lo": 0.00016913846153846185,
      "hi": 0.00016913846153846185,
      "n": 390,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=consistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009753820311850517,
      "n": 390,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 357.5,
      "lo": 357.5,
      "hi": 357.5,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 585.9499999999996,
      "lo": 585.9499999999996,
      "hi": 585.9499999999996,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 842.2999999999995,
      "lo": 842.2999999999995,
      "hi": 842.2999999999995,
      "n": 54,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016527777777777783,
      "lo": 0.00016527777777777783,
      "hi": 0.00016527777777777783,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0.00016527777777777783,
      "lo": 0.00016527777777777783,
      "hi": 0.00016527777777777783,
      "n": 54,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmetic=inconsistent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.0664135880908964,
      "n": 54,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 368,
      "lo": 368,
      "hi": 368,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 522,
      "lo": 522,
      "hi": 522,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 943.6000000000004,
      "lo": 943.6000000000004,
      "hi": 943.6000000000004,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "arithmeticError=totals",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 348,
      "lo": 348,
      "hi": 348,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 561.2499999999999,
      "lo": 561.2499999999999,
      "hi": 561.2499999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 645.43,
      "lo": 645.43,
      "hi": 645.43,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.00016975,
      "lo": 0.00016975,
      "hi": 0.00016975,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.00016975,
      "lo": 0.00016975,
      "hi": 0.00016975,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "base=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 387,
      "lo": 387,
      "hi": 387,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 523.8,
      "lo": 523.8,
      "hi": 523.8,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 779.6400000000019,
      "lo": 779.6400000000019,
      "hi": 779.6400000000019,
      "n": 75,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.0001894800000000001,
      "lo": 0.0001894800000000001,
      "hi": 0.0001894800000000001,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0.0001894800000000001,
      "lo": 0.0001894800000000001,
      "hi": 0.0001894800000000001,
      "n": 75,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=photo",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.04872384248280587,
      "n": 75,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 349,
      "lo": 349,
      "hi": 349,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 529.45,
      "lo": 529.45,
      "hi": 529.45,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 687.7900000000004,
      "lo": 687.7900000000004,
      "hi": 687.7900000000004,
      "n": 360,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.00016482500000000036,
      "lo": 0.00016482500000000036,
      "hi": 0.00016482500000000036,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0.00016482500000000036,
      "lo": 0.00016482500000000036,
      "hi": 0.00016482500000000036,
      "n": 360,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=scan",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010558056888693507,
      "n": 360,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 364,
      "lo": 364,
      "hi": 364,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 527.0999999999999,
      "lo": 527.0999999999999,
      "hi": 527.0999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 592.6199999999999,
      "lo": 592.6199999999999,
      "hi": 592.6199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "capture=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 375.5,
      "lo": 375.5,
      "hi": 375.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 570.05,
      "lo": 570.05,
      "hi": 570.05,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 834.2399999999988,
      "lo": 834.2399999999988,
      "hi": 834.2399999999988,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.0001762999999999999,
      "lo": 0.0001762999999999999,
      "hi": 0.0001762999999999999,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0.0001762999999999999,
      "lo": 0.0001762999999999999,
      "hi": 0.0001762999999999999,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_full",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 378,
      "lo": 378,
      "hi": 378,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 561.6999999999997,
      "lo": 561.6999999999997,
      "hi": 561.6999999999997,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 626.72,
      "lo": 626.72,
      "hi": 626.72,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.0001798000000000001,
      "lo": 0.0001798000000000001,
      "hi": 0.0001798000000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0.0001798000000000001,
      "lo": 0.0001798000000000001,
      "hi": 0.0001798000000000001,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=ai_inpaint",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 348,
      "lo": 348,
      "hi": 348,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 478.94999999999993,
      "lo": 478.94999999999993,
      "hi": 478.94999999999993,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 665.76,
      "lo": 665.76,
      "hi": 665.76,
      "n": 90,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0.00015826666666666673,
      "lo": 0.00015826666666666673,
      "hi": 0.00015826666666666673,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0.00015826666666666673,
      "lo": 0.00015826666666666673,
      "hi": 0.00015826666666666673,
      "n": 90,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=duplicate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.04093562556432678,
      "n": 90,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 354.5,
      "lo": 354.5,
      "hi": 354.5,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 561.5999999999998,
      "lo": 561.5999999999998,
      "hi": 561.5999999999998,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 936.2299999999998,
      "lo": 936.2299999999998,
      "hi": 936.2299999999998,
      "n": 210,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0.000168557142857143,
      "lo": 0.000168557142857143,
      "hi": 0.000168557142857143,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0.000168557142857143,
      "lo": 0.000168557142857143,
      "hi": 0.000168557142857143,
      "n": 210,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=genuine",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.017964050759283236,
      "n": 210,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 380,
      "lo": 380,
      "hi": 380,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 494,
      "lo": 494,
      "hi": 494,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 634.3599999999999,
      "lo": 634.3599999999999,
      "hi": 634.3599999999999,
      "n": 33,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0.0001742727272727273,
      "lo": 0.0001742727272727273,
      "hi": 0.0001742727272727273,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0.0001742727272727273,
      "lo": 0.0001742727272727273,
      "hi": 0.0001742727272727273,
      "n": 33,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=hard_negative",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.10426999754245206,
      "n": 33,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 335,
      "lo": 335,
      "hi": 335,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 500.94999999999965,
      "lo": 500.94999999999965,
      "hi": 500.94999999999965,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 630.0000000000001,
      "lo": 630.0000000000001,
      "hi": 630.0000000000001,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "class=manual_edit",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 439,
      "lo": 439,
      "hi": 439,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 508.2,
      "lo": 508.2,
      "hi": 508.2,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 524.04,
      "lo": 524.04,
      "hi": 524.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=JP",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 349,
      "lo": 349,
      "hi": 349,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 527.8,
      "lo": 527.8,
      "hi": 527.8,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 686.0799999999999,
      "lo": 686.0799999999999,
      "hi": 686.0799999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "country=MY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 439,
      "lo": 439,
      "hi": 439,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 508.2,
      "lo": 508.2,
      "hi": 508.2,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 524.04,
      "lo": 524.04,
      "hi": 524.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=JPY",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 349,
      "lo": 349,
      "hi": 349,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 527.8,
      "lo": 527.8,
      "hi": 527.8,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 686.0799999999999,
      "lo": 686.0799999999999,
      "hi": 686.0799999999999,
      "n": 369,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0.000165756097560976,
      "lo": 0.000165756097560976,
      "hi": 0.000165756097560976,
      "n": 369,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "currency=MYR",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.010303196519090837,
      "n": 369,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 351,
      "lo": 351,
      "hi": 351,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 536.6499999999996,
      "lo": 536.6499999999996,
      "hi": 536.6499999999996,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 687.3800000000002,
      "lo": 687.3800000000002,
      "hi": 687.3800000000002,
      "n": 384,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.00016628125000000044,
      "lo": 0.00016628125000000044,
      "hi": 0.00016628125000000044,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0.00016628125000000044,
      "lo": 0.00016628125000000044,
      "hi": 0.00016628125000000044,
      "n": 384,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=old",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 8.673617379884035e-19,
      "hi": 0.009904714241677031,
      "n": 384,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 386,
      "lo": 386,
      "hi": 386,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 733.7999999999985,
      "lo": 733.7999999999985,
      "hi": 733.7999999999985,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 1031.9999999999998,
      "lo": 1031.9999999999998,
      "hi": 1031.9999999999998,
      "n": 69,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.00017830434782608703,
      "lo": 0.00017830434782608703,
      "hi": 0.00017830434782608703,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0.00017830434782608703,
      "lo": 0.00017830434782608703,
      "hi": 0.00017830434782608703,
      "n": 69,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "dateEra=recent",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 3.469446951953614e-18,
      "hi": 0.05273725818905173,
      "n": 69,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 358,
      "lo": 358,
      "hi": 358,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 556.5999999999999,
      "lo": 556.5999999999999,
      "hi": 556.5999999999999,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 862.5200000000009,
      "lo": 862.5200000000009,
      "hi": 862.5200000000009,
      "n": 453,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0.0001681125827814572,
      "lo": 0.0001681125827814572,
      "hi": 0.0001681125827814572,
      "n": 453,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "docType=receipt",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.008408735123582253,
      "n": 453,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 347,
      "lo": 347,
      "hi": 347,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 410.2,
      "lo": 410.2,
      "hi": 410.2,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 426.04,
      "lo": 426.04,
      "hi": 426.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999998,
      "lo": 0.00017774999999999998,
      "hi": 0.00017774999999999998,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999998,
      "lo": 0.00017774999999999998,
      "hi": 0.00017774999999999998,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=date",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 336,
      "lo": 336,
      "hi": 336,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 402.7,
      "lo": 402.7,
      "hi": 402.7,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 405.34000000000003,
      "lo": 405.34000000000003,
      "hi": 405.34000000000003,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0.00017675000000000004,
      "lo": 0.00017675000000000004,
      "hi": 0.00017675000000000004,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0.00017675000000000004,
      "lo": 0.00017675000000000004,
      "hi": 0.00017675000000000004,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=items+total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 342,
      "lo": 342,
      "hi": 342,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 612.9,
      "lo": 612.9,
      "hi": 612.9,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 653.02,
      "lo": 653.02,
      "hi": 653.02,
      "n": 27,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0.00016099999999999998,
      "lo": 0.00016099999999999998,
      "hi": 0.00016099999999999998,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0.00016099999999999998,
      "lo": 0.00016099999999999998,
      "hi": 0.00016099999999999998,
      "n": 27,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "editedField=total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.12455502974186705,
      "n": 27,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 351,
      "lo": 351,
      "hi": 351,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 528.0999999999999,
      "lo": 528.0999999999999,
      "hi": 528.0999999999999,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 682.6599999999997,
      "lo": 682.6599999999997,
      "hi": 682.6599999999997,
      "n": 387,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.00016654263565891517,
      "lo": 0.00016654263565891517,
      "hi": 0.00016654263565891517,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0.00016654263565891517,
      "lo": 0.00016654263565891517,
      "hi": 0.00016654263565891517,
      "n": 387,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=en",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.009828688164979105,
      "n": 387,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 439,
      "lo": 439,
      "hi": 439,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 508.2,
      "lo": 508.2,
      "hi": 508.2,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 524.04,
      "lo": 524.04,
      "hi": 524.04,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0.00021300000000000005,
      "lo": 0.00021300000000000005,
      "hi": 0.00021300000000000005,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=ja",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 371,
      "lo": 371,
      "hi": 371,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 448.5499999999999,
      "lo": 448.5499999999999,
      "hi": 448.5499999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 487.3099999999999,
      "lo": 487.3099999999999,
      "hi": 487.3099999999999,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0.00016900000000000002,
      "lo": 0.00016900000000000002,
      "hi": 0.00016900000000000002,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0.00016900000000000002,
      "lo": 0.00016900000000000002,
      "hi": 0.00016900000000000002,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "lang=zh",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 376.5,
      "lo": 376.5,
      "hi": 376.5,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 563.2499999999999,
      "lo": 563.2499999999999,
      "hi": 563.2499999999999,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 570.77,
      "lo": 570.77,
      "hi": 570.77,
      "n": 24,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999993,
      "lo": 0.00017774999999999993,
      "hi": 0.00017774999999999993,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0.00017774999999999993,
      "lo": 0.00017774999999999993,
      "hi": 0.00017774999999999993,
      "n": 24,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=explicit_amounts",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 1.3877787807814457e-17,
      "hi": 0.13797620467498017,
      "n": 24,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 382,
      "lo": 382,
      "hi": 382,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 547.7999999999998,
      "lo": 547.7999999999998,
      "hi": 547.7999999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 657.56,
      "lo": 657.56,
      "hi": 657.56,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0.00017919999999999996,
      "lo": 0.00017919999999999996,
      "hi": 0.00017919999999999996,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0.00017919999999999996,
      "lo": 0.00017919999999999996,
      "hi": 0.00017919999999999996,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=free",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 368,
      "lo": 368,
      "hi": 368,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 522,
      "lo": 522,
      "hi": 522,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 943.6000000000004,
      "lo": 943.6000000000004,
      "hi": 943.6000000000004,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0.0001725714285714285,
      "lo": 0.0001725714285714285,
      "hi": 0.0001725714285714285,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "prompt=target_total",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 380.5,
      "lo": 380.5,
      "hi": 380.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 572.6499999999999,
      "lo": 572.6499999999999,
      "hi": 572.6499999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 805.3299999999986,
      "lo": 805.3299999999986,
      "hi": 805.3299999999986,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.00017940000000000002,
      "lo": 0.00017940000000000002,
      "hi": 0.00017940000000000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0.00017940000000000002,
      "lo": 0.00017940000000000002,
      "hi": 0.00017940000000000002,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=intact",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 354,
      "lo": 354,
      "hi": 354,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 532.5999999999998,
      "lo": 532.5999999999998,
      "hi": 532.5999999999998,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 872.3200000000004,
      "lo": 872.3200000000004,
      "hi": 872.3200000000004,
      "n": 333,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0.0001663423423423424,
      "lo": 0.0001663423423423424,
      "hi": 0.0001663423423423424,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0.0001663423423423424,
      "lo": 0.0001663423423423424,
      "hi": 0.0001663423423423424,
      "n": 333,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=none",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.011404352760326315,
      "n": 333,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 356.5,
      "lo": 356.5,
      "hi": 356.5,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 523.8499999999999,
      "lo": 523.8499999999999,
      "hi": 523.8499999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 669.6599999999999,
      "lo": 669.6599999999999,
      "hi": 669.6599999999999,
      "n": 60,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.00016665000000000004,
      "lo": 0.00016665000000000004,
      "hi": 0.00016665000000000004,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0.00016665000000000004,
      "lo": 0.00016665000000000004,
      "hi": 0.00016665000000000004,
      "n": 60,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "provenance=stripped",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.06017185214208986,
      "n": 60,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 394,
      "lo": 394,
      "hi": 394,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 849.2000000000002,
      "lo": 849.2000000000002,
      "hi": 849.2000000000002,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 992.4599999999998,
      "lo": 992.4599999999998,
      "hi": 992.4599999999998,
      "n": 39,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0.0001780769230769231,
      "lo": 0.0001780769230769231,
      "hi": 0.0001780769230769231,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0.0001780769230769231,
      "lo": 0.0001780769230769231,
      "hi": 0.0001780769230769231,
      "n": 39,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=commons",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.08966685370757144,
      "n": 39,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 339,
      "lo": 339,
      "hi": 339,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 435.59999999999997,
      "lo": 435.59999999999997,
      "hi": 435.59999999999997,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 465.52000000000004,
      "lo": 465.52000000000004,
      "hi": 465.52000000000004,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.0001595,
      "lo": 0.0001595,
      "hi": 0.0001595,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.0001595,
      "lo": 0.0001595,
      "hi": 0.0001595,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 398.5,
      "lo": 398.5,
      "hi": 398.5,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 618.4,
      "lo": 618.4,
      "hi": 618.4,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 632.48,
      "lo": 632.48,
      "hi": 632.48,
      "n": 12,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0.0002105,
      "lo": 0.0002105,
      "hi": 0.0002105,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0.0002105,
      "lo": 0.0002105,
      "hi": 0.0002105,
      "n": 12,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:gpt-image-2.5-sunburst",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 2.7755575615628914e-17,
      "hi": 0.24249400665524085,
      "n": 12,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 335,
      "lo": 335,
      "hi": 335,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 500.94999999999965,
      "lo": 500.94999999999965,
      "hi": 500.94999999999965,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 630.0000000000001,
      "lo": 630.0000000000001,
      "hi": 630.0000000000001,
      "n": 30,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0.0001597,
      "lo": 0.0001597,
      "hi": 0.0001597,
      "n": 30,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=edited:sharp-patch",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.11351339317396876,
      "n": 30,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 363.5,
      "lo": 363.5,
      "hi": 363.5,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 588.0999999999998,
      "lo": 588.0999999999998,
      "hi": 588.0999999999998,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 665.6199999999998,
      "lo": 665.6199999999998,
      "hi": 665.6199999999998,
      "n": 18,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0.00015599999999999994,
      "lo": 0.00015599999999999994,
      "hi": 0.00015599999999999994,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0.00015599999999999994,
      "lo": 0.00015599999999999994,
      "hi": 0.00015599999999999994,
      "n": 18,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:flux-3-image",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.17587922364665765,
      "n": 18,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 368,
      "lo": 368,
      "hi": 368,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 485,
      "lo": 485,
      "hi": 485,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 553,
      "lo": 553,
      "hi": 553,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.00016199999999999995,
      "lo": 0.00016199999999999995,
      "hi": 0.00016199999999999995,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0.00016199999999999995,
      "lo": 0.00016199999999999995,
      "hi": 0.00016199999999999995,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gemini-nano-banana-2.1",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 401,
      "lo": 401,
      "hi": 401,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 522,
      "lo": 522,
      "hi": 522,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 943.6000000000004,
      "lo": 943.6000000000004,
      "hi": 943.6000000000004,
      "n": 21,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0.00020799999999999993,
      "lo": 0.00020799999999999993,
      "hi": 0.00020799999999999993,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0.00020799999999999993,
      "lo": 0.00020799999999999993,
      "hi": 0.00020799999999999993,
      "n": 21,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=generated:gpt-image-2.5-flare",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.154639018924847,
      "n": 21,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 349,
      "lo": 349,
      "hi": 349,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 512.9999999999993,
      "lo": 512.9999999999993,
      "hi": 512.9999999999993,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 702.2899999999997,
      "lo": 702.2899999999997,
      "hi": 702.2899999999997,
      "n": 294,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.0001647857142857145,
      "lo": 0.0001647857142857145,
      "hi": 0.0001647857142857145,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0.0001647857142857145,
      "lo": 0.0001647857142857145,
      "hi": 0.0001647857142857145,
      "n": 294,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "source=sroie",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.012897663192708011,
      "n": 294,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 330,
      "lo": 330,
      "hi": 330,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 445.5,
      "lo": 445.5,
      "hi": 445.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 459.5,
      "lo": 459.5,
      "hi": 459.5,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0.00015000000000000001,
      "lo": 0.00015000000000000001,
      "hi": 0.00015000000000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0.00015000000000000001,
      "lo": 0.00015000000000000001,
      "hi": 0.00015000000000000001,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=crop",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 331,
      "lo": 331,
      "hi": 331,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 477.7999999999997,
      "lo": 477.7999999999997,
      "hi": 477.7999999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 626.7599999999999,
      "lo": 626.7599999999999,
      "hi": 626.7599999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0.00017760000000000003,
      "lo": 0.00017760000000000003,
      "hi": 0.00017760000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0.00017760000000000003,
      "lo": 0.00017760000000000003,
      "hi": 0.00017760000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=jpeg",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 374,
      "lo": 374,
      "hi": 374,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 436.09999999999997,
      "lo": 436.09999999999997,
      "hi": 436.09999999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 445.62,
      "lo": 445.62,
      "hi": 445.62,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0.00019360000000000002,
      "lo": 0.00019360000000000002,
      "hi": 0.00019360000000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0.00019360000000000002,
      "lo": 0.00019360000000000002,
      "hi": 0.00019360000000000002,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rephoto",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 231,
      "lo": 231,
      "hi": 231,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 392.59999999999997,
      "lo": 392.59999999999997,
      "hi": 392.59999999999997,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 399.32,
      "lo": 399.32,
      "hi": 399.32,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0.0000826,
      "lo": 0.0000826,
      "hi": 0.0000826,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0.0000826,
      "lo": 0.0000826,
      "hi": 0.0000826,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=resize",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 349,
      "lo": 349,
      "hi": 349,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 574.2999999999998,
      "lo": 574.2999999999998,
      "hi": 574.2999999999998,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 658.8599999999999,
      "lo": 658.8599999999999,
      "hi": 658.8599999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0.00019180000000000003,
      "lo": 0.00019180000000000003,
      "hi": 0.00019180000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0.00019180000000000003,
      "lo": 0.00019180000000000003,
      "hi": 0.00019180000000000003,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=rotate",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p50_ms",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 364,
      "lo": 364,
      "hi": 364,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p95_ms",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 527.0999999999999,
      "lo": 527.0999999999999,
      "hi": 527.0999999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "latency_p99_ms",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 592.6199999999999,
      "lo": 592.6199999999999,
      "hi": 592.6199999999999,
      "n": 15,
      "unit": "ms",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "model_cost_per_check_usd",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0.000154,
      "lo": 0.000154,
      "hi": 0.000154,
      "n": 15,
      "unit": "usd",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "error_rate",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "refusal_rate",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    },
    {
      "task": "operations",
      "metric": "timeout_rate",
      "stratum": "transform=screenshot",
      "target": "decision:gpt-6-luna",
      "value": 0,
      "lo": 0,
      "hi": 0.20388330103584862,
      "n": 15,
      "unit": "rate",
      "higherIsBetter": false
    }
  ],
  "findings": {
    "losses": [
      "decisions, same decision in every repetition: Receipt Audit on Gemini 3.8 Flash 92.6% [86.5%–96%] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake 100% [96.9%–100%] (n=121).",
      "operations, cost per check to the caller: Receipt Audit (Claude Haiku 5.5) $0.016 (n=453) vs Claude Haiku 5.5, plain prompt $0.00096 (n=453).",
      "operations, cost per check to the caller: Receipt Audit (Claude Haiku 5.5) $0.016 (n=453) vs Gemini 3.8 Flash, plain prompt $0.0044 (n=453).",
      "operations, cost per check to the caller: Receipt Audit (Claude Haiku 5.5) $0.016 (n=453) vs OpenAI decision model (gpt-6-luna), asked if it's fake $0.00017 (n=453).",
      "operations, cost per check to the caller: Receipt Audit on Gemini 3.8 Flash $0.016 (n=453) vs Claude Haiku 5.5, plain prompt $0.00096 (n=453).",
      "operations, cost per check to the caller: Receipt Audit on Gemini 3.8 Flash $0.016 (n=453) vs Gemini 3.8 Flash, plain prompt $0.0044 (n=453).",
      "operations, cost per check to the caller: Receipt Audit on Gemini 3.8 Flash $0.016 (n=453) vs OpenAI decision model (gpt-6-luna), asked if it's fake $0.00017 (n=453).",
      "operations, model cost per check: Receipt Audit (Claude Haiku 5.5) $0.0011 (n=453) vs OpenAI decision model (gpt-6-luna), asked if it's fake $0.00017 (n=453).",
      "operations, model cost per check: Receipt Audit on Gemini 3.8 Flash $0.0044 (n=453) vs Claude Haiku 5.5, plain prompt $0.00096 (n=453).",
      "operations, model cost per check: Receipt Audit on Gemini 3.8 Flash $0.0044 (n=453) vs OpenAI decision model (gpt-6-luna), asked if it's fake $0.00017 (n=453).",
      "operations, median latency: Receipt Audit (Claude Haiku 5.5) 4,700 ms (n=453) vs OpenAI decision model (gpt-6-luna), asked if it's fake 358 ms (n=453).",
      "operations, median latency: Receipt Audit on Gemini 3.8 Flash 4,673 ms (n=453) vs OpenAI decision model (gpt-6-luna), asked if it's fake 358 ms (n=453)."
    ],
    "wins": [
      "extraction, documents with every labelled field right: Receipt Audit (Claude Haiku 5.5) 97.2% [92.6%–99%] (n=121); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "extraction, documents with every labelled field right: Receipt Audit on Gemini 3.8 Flash 97.5% [93%–99.2%] (n=121); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "extraction, total read right: Receipt Audit (Claude Haiku 5.5) 99.7% [96.4%–100%] (n=121); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "extraction, total read right: Receipt Audit on Gemini 3.8 Flash 100% [96.9%–100%] (n=121); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "extraction, line-item F1: Receipt Audit (Claude Haiku 5.5) 95% [89.7%–99.2%] (n=20); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "extraction, line-item F1: Receipt Audit on Gemini 3.8 Flash 86% [72.6%–96.6%] (n=20); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "authenticity, ROC AUC, genuine vs fake: Receipt Audit (Claude Haiku 5.5) 0.875 [0.796–0.945] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake 0.648 [0.536–0.755] (n=121).",
      "authenticity, ROC AUC, genuine vs fake: Receipt Audit on Gemini 3.8 Flash 0.910 [0.839–0.967] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake 0.648 [0.536–0.755] (n=121).",
      "authenticity, fakes caught at a 5% false-flag rate: Receipt Audit (Claude Haiku 5.5) 67.5% [52.5%–87.5%] (n=40) vs OpenAI decision model (gpt-6-luna), asked if it's fake 30% [17.5%–47.5%] (n=40).",
      "authenticity, fakes caught at a 5% false-flag rate: Receipt Audit on Gemini 3.8 Flash 72.5% [60%–92.5%] (n=40) vs OpenAI decision model (gpt-6-luna), asked if it's fake 30% [17.5%–47.5%] (n=40).",
      "authenticity, fakes whose amounts add up, caught at a 5% false-flag rate (arithmetic=consistent): Receipt Audit (Claude Haiku 5.5) 68.2% [50%–86.4%] (n=22) vs Claude Haiku 5.5, plain prompt 18.2% [4.5%–40.9%] (n=22).",
      "authenticity, fakes whose amounts add up, caught at a 5% false-flag rate (arithmetic=consistent): Receipt Audit (Claude Haiku 5.5) 68.2% [50%–86.4%] (n=22) vs OpenAI decision model (gpt-6-luna), asked if it's fake 27.3% [9.1%–45.5%] (n=22).",
      "authenticity, fakes whose amounts add up, caught at a 5% false-flag rate (arithmetic=consistent): Receipt Audit on Gemini 3.8 Flash 68.2% [50%–90.9%] (n=22) vs Claude Haiku 5.5, plain prompt 18.2% [4.5%–40.9%] (n=22).",
      "authenticity, fakes whose amounts add up, caught at a 5% false-flag rate (arithmetic=consistent): Receipt Audit on Gemini 3.8 Flash 68.2% [50%–90.9%] (n=22) vs OpenAI decision model (gpt-6-luna), asked if it's fake 27.3% [9.1%–45.5%] (n=22).",
      "duplicates, resubmitted copies recognised: Receipt Audit (Claude Haiku 5.5) 97.8% [85%–99.7%] (n=30); Claude Haiku 5.5, plain prompt can't do this task.",
      "duplicates, resubmitted copies recognised: Receipt Audit (Claude Haiku 5.5) 97.8% [85%–99.7%] (n=30); Gemini 3.8 Flash, plain prompt can't do this task.",
      "duplicates, resubmitted copies recognised: Receipt Audit (Claude Haiku 5.5) 97.8% [85%–99.7%] (n=30); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "duplicates, resubmitted copies recognised: Receipt Audit on Gemini 3.8 Flash 96.7% [83.3%–99.4%] (n=30); Claude Haiku 5.5, plain prompt can't do this task.",
      "duplicates, resubmitted copies recognised: Receipt Audit on Gemini 3.8 Flash 96.7% [83.3%–99.4%] (n=30); Gemini 3.8 Flash, plain prompt can't do this task.",
      "duplicates, resubmitted copies recognised: Receipt Audit on Gemini 3.8 Flash 96.7% [83.3%–99.4%] (n=30); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "decisions, calibration error of the risk score: Receipt Audit (Claude Haiku 5.5) 7.3% [5%–12.6%] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake 18.3% [14.5%–21.8%] (n=121).",
      "decisions, calibration error of the risk score: Receipt Audit on Gemini 3.8 Flash 6.1% [3.9%–11.2%] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake 18.3% [14.5%–21.8%] (n=121).",
      "evidence, edited fakes flagged with the edited field named: Receipt Audit (Claude Haiku 5.5) 33.3% [16.9%–55.1%] (n=20) vs OpenAI decision model (gpt-6-luna), asked if it's fake 0% [0%–16.1%] (n=20).",
      "evidence, edited fakes flagged with the edited field named: Receipt Audit on Gemini 3.8 Flash 50% [29.9%–70.1%] (n=20) vs OpenAI decision model (gpt-6-luna), asked if it's fake 0% [0%–16.1%] (n=20).",
      "proof, fakes caught with verifiable evidence: Receipt Audit (Claude Haiku 5.5) 55% [39.8%–69.3%] (n=40); Claude Haiku 5.5, plain prompt can't do this task.",
      "proof, fakes caught with verifiable evidence: Receipt Audit (Claude Haiku 5.5) 55% [39.8%–69.3%] (n=40); Gemini 3.8 Flash, plain prompt can't do this task.",
      "proof, fakes caught with verifiable evidence: Receipt Audit (Claude Haiku 5.5) 55% [39.8%–69.3%] (n=40); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "proof, fakes caught with verifiable evidence: Receipt Audit on Gemini 3.8 Flash 64.2% [48.7%–77.2%] (n=40); Claude Haiku 5.5, plain prompt can't do this task.",
      "proof, fakes caught with verifiable evidence: Receipt Audit on Gemini 3.8 Flash 64.2% [48.7%–77.2%] (n=40); Gemini 3.8 Flash, plain prompt can't do this task.",
      "proof, fakes caught with verifiable evidence: Receipt Audit on Gemini 3.8 Flash 64.2% [48.7%–77.2%] (n=40); OpenAI decision model (gpt-6-luna), asked if it's fake can't do this task.",
      "operations, model cost per check: Receipt Audit (Claude Haiku 5.5) $0.0011 (n=453) vs Gemini 3.8 Flash, plain prompt $0.0044 (n=453).",
      "operations, median latency: Receipt Audit (Claude Haiku 5.5) 4,700 ms (n=453) vs Claude Haiku 5.5, plain prompt 8,392 ms (n=453).",
      "operations, median latency: Receipt Audit (Claude Haiku 5.5) 4,700 ms (n=453) vs Gemini 3.8 Flash, plain prompt 6,369 ms (n=453).",
      "operations, median latency: Receipt Audit on Gemini 3.8 Flash 4,673 ms (n=453) vs Claude Haiku 5.5, plain prompt 8,392 ms (n=453).",
      "operations, median latency: Receipt Audit on Gemini 3.8 Flash 4,673 ms (n=453) vs Gemini 3.8 Flash, plain prompt 6,369 ms (n=453)."
    ],
    "ties": [
      "extraction, documents with every labelled field right: Receipt Audit (Claude Haiku 5.5) 97.2% [92.6%–99%] (n=121) vs Claude Haiku 5.5, plain prompt 95.3% [90%–97.9%] (n=121).",
      "extraction, documents with every labelled field right: Receipt Audit (Claude Haiku 5.5) 97.2% [92.6%–99%] (n=121) vs Gemini 3.8 Flash, plain prompt 96.1% [91.1%–98.4%] (n=121).",
      "extraction, documents with every labelled field right: Receipt Audit on Gemini 3.8 Flash 97.5% [93%–99.2%] (n=121) vs Claude Haiku 5.5, plain prompt 95.3% [90%–97.9%] (n=121).",
      "extraction, documents with every labelled field right: Receipt Audit on Gemini 3.8 Flash 97.5% [93%–99.2%] (n=121) vs Gemini 3.8 Flash, plain prompt 96.1% [91.1%–98.4%] (n=121).",
      "extraction, total read right: Receipt Audit (Claude Haiku 5.5) 99.7% [96.4%–100%] (n=121) vs Claude Haiku 5.5, plain prompt 99.4% [95.9%–99.9%] (n=121).",
      "extraction, total read right: Receipt Audit (Claude Haiku 5.5) 99.7% [96.4%–100%] (n=121) vs Gemini 3.8 Flash, plain prompt 98.9% [95%–99.8%] (n=121).",
      "extraction, total read right: Receipt Audit on Gemini 3.8 Flash 100% [96.9%–100%] (n=121) vs Claude Haiku 5.5, plain prompt 99.4% [95.9%–99.9%] (n=121).",
      "extraction, total read right: Receipt Audit on Gemini 3.8 Flash 100% [96.9%–100%] (n=121) vs Gemini 3.8 Flash, plain prompt 98.9% [95%–99.8%] (n=121).",
      "extraction, line-item F1: Receipt Audit (Claude Haiku 5.5) 95% [89.7%–99.2%] (n=20) vs Claude Haiku 5.5, plain prompt 94.6% [88.5%–98.8%] (n=20).",
      "extraction, line-item F1: Receipt Audit (Claude Haiku 5.5) 95% [89.7%–99.2%] (n=20) vs Gemini 3.8 Flash, plain prompt 91.1% [81.2%–98.5%] (n=20).",
      "extraction, line-item F1: Receipt Audit on Gemini 3.8 Flash 86% [72.6%–96.6%] (n=20) vs Claude Haiku 5.5, plain prompt 94.6% [88.5%–98.8%] (n=20).",
      "extraction, line-item F1: Receipt Audit on Gemini 3.8 Flash 86% [72.6%–96.6%] (n=20) vs Gemini 3.8 Flash, plain prompt 91.1% [81.2%–98.5%] (n=20).",
      "authenticity, ROC AUC, genuine vs fake: Receipt Audit (Claude Haiku 5.5) 0.875 [0.796–0.945] (n=121) vs Claude Haiku 5.5, plain prompt 0.805 [0.709–0.894] (n=121).",
      "authenticity, ROC AUC, genuine vs fake: Receipt Audit (Claude Haiku 5.5) 0.875 [0.796–0.945] (n=121) vs Gemini 3.8 Flash, plain prompt 0.815 [0.725–0.892] (n=121).",
      "authenticity, ROC AUC, genuine vs fake: Receipt Audit on Gemini 3.8 Flash 0.910 [0.839–0.967] (n=121) vs Claude Haiku 5.5, plain prompt 0.805 [0.709–0.894] (n=121).",
      "authenticity, ROC AUC, genuine vs fake: Receipt Audit on Gemini 3.8 Flash 0.910 [0.839–0.967] (n=121) vs Gemini 3.8 Flash, plain prompt 0.815 [0.725–0.892] (n=121).",
      "authenticity, fakes caught at a 5% false-flag rate: Receipt Audit (Claude Haiku 5.5) 67.5% [52.5%–87.5%] (n=40) vs Claude Haiku 5.5, plain prompt 52.5% [37.5%–70%] (n=40).",
      "authenticity, fakes caught at a 5% false-flag rate: Receipt Audit (Claude Haiku 5.5) 67.5% [52.5%–87.5%] (n=40) vs Gemini 3.8 Flash, plain prompt 60% [45%–77.5%] (n=40).",
      "authenticity, fakes caught at a 5% false-flag rate: Receipt Audit on Gemini 3.8 Flash 72.5% [60%–92.5%] (n=40) vs Claude Haiku 5.5, plain prompt 52.5% [37.5%–70%] (n=40).",
      "authenticity, fakes caught at a 5% false-flag rate: Receipt Audit on Gemini 3.8 Flash 72.5% [60%–92.5%] (n=40) vs Gemini 3.8 Flash, plain prompt 60% [45%–77.5%] (n=40).",
      "authenticity, fakes whose amounts add up, caught at a 5% false-flag rate (arithmetic=consistent): Receipt Audit (Claude Haiku 5.5) 68.2% [50%–86.4%] (n=22) vs Gemini 3.8 Flash, plain prompt 45.5% [27.3%–68.2%] (n=22).",
      "authenticity, fakes whose amounts add up, caught at a 5% false-flag rate (arithmetic=consistent): Receipt Audit on Gemini 3.8 Flash 68.2% [50%–90.9%] (n=22) vs Gemini 3.8 Flash, plain prompt 45.5% [27.3%–68.2%] (n=22).",
      "authenticity, genuine receipts flagged at risk ≥ 0.5: Receipt Audit (Claude Haiku 5.5) 2.5% [0.7%–8.6%] (n=81) vs Claude Haiku 5.5, plain prompt 1.6% [0.4%–7.3%] (n=81).",
      "authenticity, genuine receipts flagged at risk ≥ 0.5: Receipt Audit (Claude Haiku 5.5) 2.5% [0.7%–8.6%] (n=81) vs Gemini 3.8 Flash, plain prompt 1.2% [0.2%–6.7%] (n=81).",
      "authenticity, genuine receipts flagged at risk ≥ 0.5: Receipt Audit (Claude Haiku 5.5) 2.5% [0.7%–8.6%] (n=81) vs OpenAI decision model (gpt-6-luna), asked if it's fake 0% [0%–4.5%] (n=81).",
      "authenticity, genuine receipts flagged at risk ≥ 0.5: Receipt Audit on Gemini 3.8 Flash 3.7% [1.3%–10.3%] (n=81) vs Claude Haiku 5.5, plain prompt 1.6% [0.4%–7.3%] (n=81).",
      "authenticity, genuine receipts flagged at risk ≥ 0.5: Receipt Audit on Gemini 3.8 Flash 3.7% [1.3%–10.3%] (n=81) vs Gemini 3.8 Flash, plain prompt 1.2% [0.2%–6.7%] (n=81).",
      "authenticity, genuine receipts flagged at risk ≥ 0.5: Receipt Audit on Gemini 3.8 Flash 3.7% [1.3%–10.3%] (n=81) vs OpenAI decision model (gpt-6-luna), asked if it's fake 0% [0%–4.5%] (n=81).",
      "decisions, same decision in every repetition: Receipt Audit (Claude Haiku 5.5) 96.7% [91.8%–98.7%] (n=121) vs Claude Haiku 5.5, plain prompt 92.6% [86.5%–96%] (n=121).",
      "decisions, same decision in every repetition: Receipt Audit (Claude Haiku 5.5) 96.7% [91.8%–98.7%] (n=121) vs Gemini 3.8 Flash, plain prompt 99.2% [95.5%–99.9%] (n=121).",
      "decisions, same decision in every repetition: Receipt Audit (Claude Haiku 5.5) 96.7% [91.8%–98.7%] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake 100% [96.9%–100%] (n=121).",
      "decisions, same decision in every repetition: Receipt Audit on Gemini 3.8 Flash 92.6% [86.5%–96%] (n=121) vs Claude Haiku 5.5, plain prompt 92.6% [86.5%–96%] (n=121).",
      "decisions, same decision in every repetition: Receipt Audit on Gemini 3.8 Flash 92.6% [86.5%–96%] (n=121) vs Gemini 3.8 Flash, plain prompt 99.2% [95.5%–99.9%] (n=121).",
      "decisions, calibration error of the risk score: Receipt Audit (Claude Haiku 5.5) 7.3% [5%–12.6%] (n=121) vs Claude Haiku 5.5, plain prompt 10.3% [8%–14.5%] (n=121).",
      "decisions, calibration error of the risk score: Receipt Audit (Claude Haiku 5.5) 7.3% [5%–12.6%] (n=121) vs Gemini 3.8 Flash, plain prompt 10.2% [6.6%–15.8%] (n=121).",
      "decisions, calibration error of the risk score: Receipt Audit on Gemini 3.8 Flash 6.1% [3.9%–11.2%] (n=121) vs Claude Haiku 5.5, plain prompt 10.3% [8%–14.5%] (n=121).",
      "decisions, calibration error of the risk score: Receipt Audit on Gemini 3.8 Flash 6.1% [3.9%–11.2%] (n=121) vs Gemini 3.8 Flash, plain prompt 10.2% [6.6%–15.8%] (n=121).",
      "decisions, expected cost of decisions per 1,000 receipts at risk ≥ 0.5: Receipt Audit (Claude Haiku 5.5) $815.556 [$369.194–$1400.370] (n=121) vs Claude Haiku 5.5, plain prompt $818.704 [$510.861–$1228.597] (n=121).",
      "decisions, expected cost of decisions per 1,000 receipts at risk ≥ 0.5: Receipt Audit (Claude Haiku 5.5) $815.556 [$369.194–$1400.370] (n=121) vs Gemini 3.8 Flash, plain prompt $624.444 [$308.333–$1106.667] (n=121).",
      "decisions, expected cost of decisions per 1,000 receipts at risk ≥ 0.5: Receipt Audit (Claude Haiku 5.5) $815.556 [$369.194–$1400.370] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake $775.000 [$625.000–$900.000] (n=121).",
      "decisions, expected cost of decisions per 1,000 receipts at risk ≥ 0.5: Receipt Audit on Gemini 3.8 Flash $923.333 [$402.593–$1580.065] (n=121) vs Claude Haiku 5.5, plain prompt $818.704 [$510.861–$1228.597] (n=121).",
      "decisions, expected cost of decisions per 1,000 receipts at risk ≥ 0.5: Receipt Audit on Gemini 3.8 Flash $923.333 [$402.593–$1580.065] (n=121) vs Gemini 3.8 Flash, plain prompt $624.444 [$308.333–$1106.667] (n=121).",
      "decisions, expected cost of decisions per 1,000 receipts at risk ≥ 0.5: Receipt Audit on Gemini 3.8 Flash $923.333 [$402.593–$1580.065] (n=121) vs OpenAI decision model (gpt-6-luna), asked if it's fake $775.000 [$625.000–$900.000] (n=121).",
      "evidence, edited fakes flagged with the edited field named: Receipt Audit (Claude Haiku 5.5) 33.3% [16.9%–55.1%] (n=20) vs Claude Haiku 5.5, plain prompt 38.3% [20.6%–59.8%] (n=20).",
      "evidence, edited fakes flagged with the edited field named: Receipt Audit (Claude Haiku 5.5) 33.3% [16.9%–55.1%] (n=20) vs Gemini 3.8 Flash, plain prompt 36.7% [19.4%–58.3%] (n=20).",
      "evidence, edited fakes flagged with the edited field named: Receipt Audit on Gemini 3.8 Flash 50% [29.9%–70.1%] (n=20) vs Claude Haiku 5.5, plain prompt 38.3% [20.6%–59.8%] (n=20).",
      "evidence, edited fakes flagged with the edited field named: Receipt Audit on Gemini 3.8 Flash 50% [29.9%–70.1%] (n=20) vs Gemini 3.8 Flash, plain prompt 36.7% [19.4%–58.3%] (n=20).",
      "operations, model cost per check: Receipt Audit (Claude Haiku 5.5) $0.0011 (n=453) vs Claude Haiku 5.5, plain prompt $0.00096 (n=453).",
      "operations, model cost per check: Receipt Audit on Gemini 3.8 Flash $0.0044 (n=453) vs Gemini 3.8 Flash, plain prompt $0.0044 (n=453)."
    ]
  },
  "datasets": [
    {
      "name": "SROIE (ICDAR 2019 scanned receipts), Voxel51/scanned_receipts mirror",
      "license": "CC-BY-4.0",
      "url": "https://huggingface.co/datasets/Voxel51/scanned_receipts",
      "cases": 98
    },
    {
      "name": "RA-Bench fakes from SROIE",
      "license": "CC-BY-4.0",
      "url": "https://huggingface.co/datasets/Voxel51/scanned_receipts",
      "cases": 20
    },
    {
      "name": "RA-Bench generated fakes",
      "license": "CC-BY-4.0",
      "url": null,
      "cases": 20
    },
    {
      "name": "Wikimedia Commons (Naha Mama Pavilionz)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:JP_%E6%97%A5%E6%9C%AC_Japan_%E6%B2%96%E7%B9%A9_OKINAWA_Family_Cuisine_Restaurant_January_2025_R12S_01.jpg",
      "cases": 2
    },
    {
      "name": "Wikimedia Commons (NORTLAUKAU 26088 JP)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:JP_%E6%97%A5%E6%9C%AC_Japan_%E6%B2%96%E7%B9%A9_OKINAWA_Route_253_%E6%B5%A6%E8%A5%BF_Chome_Yoshinoya_Restaurant_%E7%89%9B%E4%B8%BC%E9%A3%AF_Beef_slice_rice_bowl_February_2026_N13P_05.jpg",
      "cases": 2
    },
    {
      "name": "Wikimedia Commons (Solomon203)",
      "license": "CC BY-SA 4.0",
      "url": "https://commons.wikimedia.org/wiki/File:FamilyMart_Keelung_Baifu_Store_e-invoice_WJ90244062.jpg",
      "cases": 2
    },
    {
      "name": "Wikimedia Commons (Aw58)",
      "license": "CC BY-SA 4.0",
      "url": "https://commons.wikimedia.org/wiki/File:Paragon_fiskalny_-_12.07.2024.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (Grandmaster Huon)",
      "license": "Public domain",
      "url": "https://commons.wikimedia.org/wiki/File:Grocery_Store_Receipt_in_Vienna.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (Lantus)",
      "license": "Public domain",
      "url": "https://commons.wikimedia.org/wiki/File:Migros_Kassenzettel_2025.pdf",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (LIman TADU Foo RUBB)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:SZ_%E6%B7%B1%E5%9C%B3_Shenzhen_%E9%BE%8D%E5%B4%97_Longgang_%E4%BA%94%E5%92%8C%E8%B7%AF_118_Wuhe_Road_%E6%B5%B7%E8%BE%BE%E5%92%8C%E6%88%90%E8%B4%AD%E7%89%A9%E4%B8%AD%E5%BF%83_HaiDa_HeCheng_Shopping_Mall_shop_%E6%B5%81%E6%B5%AA%E6%B3%A1%E6%B3%A1%E7%83%A4%E8%82%89_LiuLang_PaoPao_Korean_BBQ_Buffet_Restaurant_bill_n_rules_November_2025_R12S_01.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (Sakurakat)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:Bill_Vishwanand_2026-01-28.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (TaiZiThee 832)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:SZ_%E6%B7%B1%E5%9C%B3_Shenzhen_%E5%AF%B6%E5%AE%89%E4%B8%AD%E5%BF%83_BaoAn_%E5%89%B5%E6%A5%AD%E4%B8%80%E8%B7%AF_Chuangye_1st_Road_mall_AEON_Supermarket_bill_December_2024_R12S_01.jpg",
      "cases": 1
    },
    {
      "name": "Wikimedia Commons (YEING Luwem Hai Wangs)",
      "license": "CC0",
      "url": "https://commons.wikimedia.org/wiki/File:SZ_%E6%B7%B1%E5%9C%B3_Shenzhen_%E7%A6%8F%E7%94%B0_Futian_%E9%87%91%E7%94%B0%E8%B7%AF_Jintian_Road_%E4%B8%83%E9%AE%AE%E8%B6%85%E5%B8%82_Seven_Fresh_Supermarket_checkout_bill_February_2024_R12S_20.jpg",
      "cases": 1
    }
  ],
  "limitations": [
    "Preliminary: small samples, so intervals are wide. Read the intervals, not the point estimates.",
    "Public cases come from datasets that are probably in the models' training data.",
    "The DIY baselines use one plain prompt; a stronger prompt would do better. A strong-prompt baseline comes later.",
    "DIY targets have no memory across checks and no deterministic checks: those tasks are marked not supported, not scored as zero.",
    "Our engine runs in process, so its latency has no network hop to receiptaudit.com; DIY latency includes the round trip to the model.",
    "Costs are model tokens at list price on the price date; no infrastructure cost is included.",
    "When the Claude baseline's config says transport claude-code-cli, it ran through Claude Code's CLI on a subscription: thinking is adaptive and can't be fully turned off, its cost is what the same tokens cost through the API, and its latency includes the CLI's start-up.",
    "The duplicate network starts empty for each repetition: it only knows the run's own earlier cases, not production traffic."
  ],
  "examples": [],
  "methodology": "RA-Bench 0.2.0. These definitions, thresholds and exclusions were written before the run and change only in a new suite version.\n\nWho and what. Receipt Audit runs this benchmark on its own product. Every target gets the same cases, the same files, the same timeout (180 s per attempt by default) and the same scoring; only the target changes. A target is our engine (\"self\", in process, with the duplicate network on an empty in-memory backend that lives for one repetition) or an agent's own model asked with one plain prompt (\"diy\"). DIY targets get the same file preparation as our engine (upright, at most 3072 px and 3.75 MB) so that API size limits don't count against them. Transport failures (network errors, HTTP 408, 429 and 5xx) are retried up to 3 times with exponential backoff; nothing else is retried, and a wrong answer is a result. Models are pinned: no fallback to another model.\n\nUnits and intervals. A case run several times counts once, with the share of its runs that succeeded. Rates carry a 95% Wilson interval over cases (operations rates: over calls). ROC AUC, detection at a fixed false-flag rate and line-item F1 carry a 95% percentile bootstrap interval (2000 resamples, genuine receipts and fakes resampled separately, seeded per row so a re-scored run gives the same interval). Latency and cost have no interval. Every row reports n. Rows are given for all cases and for every stratum (a \"dimension=value\" tag on the case, or a label-derived group) with at least 10 cases.\n\nWhich cases count. Extraction, checks and authenticity use base cases only: cases that aren't a transform of another case (no lineage). Duplicate transforms count only for the duplicates task. Operations use every call.\n\nExtraction. Scored only on fields the label covers; a field labelled null means the document doesn't show it, and only a null answer is right. Merchant name: lowercase, accents stripped, \"&\" read as \"and\", punctuation dropped, then a match at edit-distance similarity ≥ 0.9. Date: the exact ISO date (YYYY-MM-DD). Subtotal, tax total and total: within 0.01. Currency: the exact ISO 4217 code. Receipt number: equal after keeping only letters and digits, lowercased. \"All fields right\": every labelled scalar field of the document right in that run (line items excluded). Line-item F1: labelled and extracted items paired one to one when descriptions are at least 0.8 alike (same normalisation) and totals match within 0.01, micro-averaged over all documents. Valid output: the call succeeded and returned readable fields. A failed call or an unreadable answer gets every field wrong.\n\nChecks. totals_add_up is scored against the label \"the printed amounts add up\". A positive is a document whose amounts don't add up; the check flags it when it reports failed. Recall over documents that don't add up; precision over documents it flagged; false alarms over genuine documents that do add up; coverage is the share of documents where the check ran (a check that couldn't run isn't output). Targets without deterministic checks report this task as not supported.\n\nAuthenticity (genuine vs fake). Higher risk means more likely fake. ROC AUC uses each target's risk as the score; a result without a risk scores 0.5 (no opinion), ties count half. Detection at a 1%, 5% and 10% false-flag rate: the share of fakes flagged by the lowest threshold that flags at most that share of genuine receipts (ties at the threshold are all flagged). At the documented thresholds risk ≥ 0.5 and risk ≥ 0.7: the share of fakes flagged (detection) and of genuine receipts flagged (false flags); a result without a risk is never flagged. Strata from the labels: each fake class (\"class=ai_full\", …) and fakes whose amounts add up or don't (\"arithmetic=consistent\", \"arithmetic=inconsistent\"), each compared with every genuine receipt; and provenance metadata (\"provenance=intact\", \"stripped\", \"none\"), genuine receipts and fakes alike.\n\nDuplicates. Every case is submitted by a different account, so a repeat is \"someone else submitted this receipt before\". Recall: the share of duplicate transforms (re-encoded, cropped, re-shot copies of an earlier case) the target recognised as seen before; exact recall counts only matches on the identical image hash. False matches: the share of distinct receipts reported as seen before, for hard negatives (different receipts that look alike: same merchant, template or day; \"false_match_rate\") and for the other genuine receipts (\"false_match_rate_genuine\"). Originals always run before their transforms. Targets without memory across checks (DIY prompts) report the task as not supported, not as zero.\n\nDecisions. A decision is the yes/no a caller acts on: flagged when risk ≥ 0.5. Consistency: over base cases run at least twice, the share whose decision is the same in every repetition; total consistency, the share whose extracted total is the same (within 0.01, or absent) in every repetition. Calibration error: expected calibration error of risk against \"is fake\" over every run with a risk, 10 equal-width bins, weighted by run count (lower is better; it depends on this set's share of fakes). Expected cost per 1,000 receipts at risk ≥ 0.5 and ≥ 0.7: 1000 × ((1 − p) × false-flag rate × C_review + p × (1 − detection) × C_miss). Defaults, each from a cited, graded source (research/41-benchmark-cost-model.md): p = 1% of submitted receipts are fake (SAP Concur's share of receipts flagged as AI-generated; no study measures the true share, so this is the best available assumption, not a measurement); C_miss = $100, the face value of a missed fake (AppZen's mean AI-generated fake, 12 months to May 2026); C_review = $17, one false flag's review (18 minutes, GBTA, at a loaded auditor wage of $57.47/h, BLS). At these defaults one point of false-flag rate costs as much as about 17 points of detection. The sweep varies one assumption at a time over its published spread (\"assumption=…\": fakes 0.1% and 5%; a missed fake $32 and $182; a review $8 and $73). Approving everything costs 1000 × p × C_miss ($1000 at the defaults), reported as its own row: a detector above it loses money under those assumptions. The formula counts only mistakes (it treats reviewing a fake that was rightly flagged as free) and leaves out unmeasured costs: an employee's time and trust after a false flag, and repeat fraud or tax penalties after a miss. This set has far more fakes than real submissions, so the cost re-weights the measured rates by p rather than using the set's own mix.\n\nEvidence. A yes/no is easy to get from any model; a reviewer also needs to know what is wrong. Edited field named: over fakes whose label names the edited field (AI-inpainted and hand-edited fakes), the share of runs that flag the receipt and whose first 3 reasons point at that field. A reason points at a field through an explicit \"@field\" tag, a deterministic check about it (an arithmetic check points at the total and subtotal), or, for free-text reasons, a pre-registered keyword (total, amount due; subtotal; tax, VAT, GST; date; merchant, store, vendor, logo, name; item, line, quantity, price).\n\nVerifiable evidence. A finding is proof of tampering when a caller can check it without trusting a model and it shows the document was generated or changed: an AI-generator, AI source-type or receipt/invoice-generator tag read from the file, PDF modification records, a thumbnail that doesn't match the image, a photo taken before the printed purchase date, printed amounts that don't add up (with the numbers), or a duplicate-network match. Other file facts (an editor or office tool, missing camera data) and plausibility or policy checks (tax rate, the receipt's age, currency) are real but don't show tampering, and don't count. A model's visual judgement is an opinion, however confident. Fakes caught with proof: the share of fakes flagged with at least one proof among their reasons. Genuine receipts with proof: the guard against false proof (lower is better). Only targets that can return verifiable findings report this task; a plain prompt returns opinions by construction and reports it as not supported.\n\nOperations. Latency: wall time of the final attempt of each successful call, measured by the harness (p50, p95, p99). Cost per check is what the caller pays for one check: for Receipt Audit, the list price of its smallest credit pack per check; for a DIY baseline, its model tokens × the AI Gateway list price on the run's price date. Model cost per check is the model tokens × that list price for every target, our engine's own model call included (infrastructure not included). Both are averaged over successful calls. Error, refusal and timeout rates over all calls.\n\nFindings. Each of our targets is compared with each baseline on the headline rows of every task (stratum \"all\"): a win or a loss only when the 95% intervals don't overlap, otherwise a tie; for latency and cost, which have no interval, only when one value is at least 1.2 times the other. A comparison resting on fewer than 10 cases (or calls) on either side is always a tie. A task a baseline can't do by construction is reported as such, not as a score of zero.",
  "reproduce": {
    "repo": null,
    "command": "cd apps/receipt-check && nub run bench run --cases benchmarks/receipt-audit/heldout-cases.jsonl --split private --targets self,self-gemini,diy:claude-haiku-5.5,diy:gemini-3.8-flash,decision:gpt-6-luna --reps 3"
  },
  "history": [
    {
      "runId": "20261012T203648Z-44a89a",
      "ranAt": "2026-10-12T20:47:27.588Z",
      "url": "https://receiptaudit.com/benchmarks/runs/20261012T203648Z-44a89a.json"
    }
  ]
}