Skip to main content

Identification and Assumptions

Defining an estimand does not guarantee that data identify it. Identification is the logical step of expressing a causal quantity uniquely in terms of the observed-data distribution under stated assumptions. Estimation then learns that observed-data quantity from a finite sample.

Prerequisites​

Complete Estimands: ATE, ATT, and CATE and Causal Graphs and DAGs.

Learning goals​

  • Separate identification from estimation and sampling precision.
  • Build an identification argument from substantive assumptions.
  • Recognize when the available data do not identify the target effect.

An identification argument​

Target the Study Sprint ATE. Suppose LL is a sufficient set of pre-assignment common causes, treatment and outcome are measured consistently, there is no relevant interference, conditional exchangeability holds, and both assignments occur at every target value of LL. Then

E[Y(1)−Y(0)]=∑l{E[Y∣A=1,L=l]−E[Y∣A=0,L=l]}P(L=l).E[Y(1)-Y(0)] =\sum_l\{E[Y\mid A=1,L=l]-E[Y\mid A=0,L=l]\}P(L=l).

The right side contains observed-data quantities. Standardization, outcome regression, matching, or weighting may estimate it, but these methods share the same substantive identification burden. Agreement among them can reveal some modeling problems; it cannot prove no unmeasured confounding.

A practical assumption ledger​

AssumptionWhy it is needed hereEvidence to examineWhat evidence cannot prove
ConsistencyLinks recorded assignment to Y(a)Y(a)Program protocol and implementation recordsThat all hidden versions are irrelevant
Conditional exchangeabilityMakes groups substitute for missing outcomesAssignment process, DAG, baseline knowledgeNo unmeasured common causes
PositivitySupplies comparisons within target strataAssignment frequencies and propensity distributionsSupport outside observed combinations
Interference definitionMakes the unit-level contrast meaningfulClass structure and resource constraintsAbsence of all spillovers
Measurement and selectionLinks constructs to columns and analyzed sampleValidation, missingness, data provenancePerfect validity from reliability alone

Assumptions and limits​

An assumption is not a ceremonial caveat. It connects a causal target to a design, measurement process, and formula. If an assumption is implausible, narrow the population, redefine the treatment, use another design, measure additional causes, model spillovers, or report that the effect is not identified.

Identification is not statistical significance​

A huge sample can make an associational estimate precise around the wrong quantity. A randomized but tiny study may identify an effect while estimating it imprecisely. Bias from a failed causal assumption and sampling uncertainty are different problems; confidence intervals generally quantify only the latter under the fitted analysis.

Sensitivity analyses ask how conclusions change under explicit departures from assumptions. They do not transform an unknowable assumption into a testable fact, and they should be aligned with the estimand and plausible failure mode.

Common mistakes​

  • Presenting covariate adjustment as the identification argument.
  • Claiming “causal” because the sample is large or the p-value is small.
  • Using balance after adjustment as proof of balance on unmeasured causes.
  • Hiding positivity violations behind model extrapolation.
  • Listing assumptions without explaining how each links the data to the estimand.

Practice​

Take the adjustment formula above and annotate every equality with the assumption it uses. Then imagine motivation was unmeasured: state honestly what remains descriptive or associational and what new design or data could help.

Next steps​

Randomized vs. Observational Evidence compares two assignment mechanisms without treating either as automatic proof.

Primary sources​

Checked 2026-10-15: Hernán and Robins, Causal Inference: What If, Greenland, Pearl, and Robins, “Causal Diagrams for Epidemiologic Research”, and ICH E9(R1).