interval_check

Whether a claimed value falls inside the interval a simulation produced, for a cohort you declare exactly as you declare it to `simulate`. Verdicts: `inside`, `outside`, `unresolved` when the interval spans the quantity's whole admissible range so any claim would have passed, `out_of_domain` when the claim is not a value the quantity can take, `too_few_answered` below thirty answered draws. There is no tolerance parameter: the interval is the verdict, and `level` widens it by a stated confidence rather than an unstated fudge. An `inside` verdict is about a model whose inputs YOU declared and never about the world, which is why every answer carries `interpretation_note` and the cohort's `basis`. A driver's NAME is a string identity rather than an interval and is refused here by name; `claim_check` decides that one. It refuses rather than guessing, and these are the kinds it returns, so you can read them before spending a call: simulation/bad-input, simulation/no-such-quantity, simulation/not-an-interval-quantity, simulation/cohort-id-mismatch, simulation/estimator-fault, simulation/cohort-vintage-moved.

Use this form for new arguments. Follow concrete links for known values. Fetch-only readers may be unable to submit new URLs.

Exact input contract

{
  "additionalProperties": false,
  "properties": {
    "claimed": {
      "description": "The number being checked. Required; this world ships no default, because a checker with a default claim checks a sentence nobody wrote.",
      "type": "number"
    },
    "cohort": {
      "description": "Optional. The cohort id you believe these arguments describe. It is recomputed from the recipe and must match, so quoting it makes 'this verdict is about the same cohort as that figure' a fact rather than a label. A mismatch refuses.",
      "type": "string"
    },
    "draws": {
      "description": "How many times to run it. Required; this tool ships no default. Every draw is a real call to the world's own estimator, and the refusal names the ceiling if you cross it.",
      "minimum": 1,
      "type": "integer"
    },
    "fixed": {
      "description": "Literal values passed unchanged to every draw. A key here and in over at once is refused.",
      "type": "object"
    },
    "label": {
      "description": "A name for your own use. It is not part of the cohort id, so renaming a cohort does not make it a different one.",
      "type": "string"
    },
    "level": {
      "description": "Confidence level for the interval, strictly inside 0.5 and 1.0. Defaults to 0.95. This is the only knob: there is no tolerance.",
      "type": "number"
    },
    "over": {
      "description": "The inputs that vary, each mapped to its declared distribution. Non-empty, always. Shapes: {\"shape\":\"point\",\"value\":v}, {\"shape\":\"uniform\",\"low\":a,\"high\":b}, {\"shape\":\"triangular\",\"low\":a,\"mode\":m,\"high\":b}, {\"shape\":\"categorical\",\"weights\":[[value,weight],...]}. A point belongs here rather than in fixed when you want it reported as pinned rather than as absent. There is no normal and no beta: both need a function IEEE 754 does not require to be correctly rounded, and a draw that differs in its last bit between two machines cannot replay.",
      "type": "object"
    },
    "quantity": {
      "description": "What is being checked. One of `answered_rate`, `refusal_rate:<kind>`, `figure:<path>.mean`, or `first_order_index:<input>`. A name this cohort did not produce is refused with a list of the names it did.",
      "type": "string"
    },
    "seed": {
      "description": "The seed every draw is addressed from. Required; this tool ships no default, because a defaulted seed is a declared input nobody declared and the seed is what a cohort's identity is about. The same seed and the same declaration give the same draws on any machine.",
      "minimum": 0,
      "type": "integer"
    },
    "template": {
      "description": "The records a wildcard path is resolved against, with the addressed field left out. Supply it whenever an input in over is written name[*].field.",
      "type": "object"
    },
    "tool": {
      "description": "The tool to run, named exactly as this world declares it. A runtime tool is refused: simulating a check decides nothing. Name one this world does not declare and the refusal lists the ones it does.",
      "type": "string"
    }
  },
  "required": [
    "tool",
    "draws",
    "seed",
    "over",
    "quantity",
    "claimed"
  ],
  "type": "object"
}

Ready links