VerifiedEvidence: highv1.0.0

Selection Model

A missing data modelling approach explicitly modelling the process by which observations become missing, alongside the model for the outcome itself.

Last reviewedDarrin Baines IP Ltd

Concept Architecture

Concept


Theoretically, Selection Model is a statistical framework for analysing incomplete data by jointly modelling the outcome process and the mechanism determining whether observations are observed or missing. It factorises the joint distribution of outcomes and missingness into the marginal distribution of the outcomes and the conditional distribution of missingness given the outcomes. Selection models are particularly important for sensitivity analysis under Missing Not at Random assumptions, where the probability of missingness depends on unobserved outcomes after conditioning on observed data.

Mathematically, a Selection Model represents the joint distribution of outcome data and missingness indicators as the product of an outcome model and a missingness model. The outcome component may be specified using regression, longitudinal, survival, or generalised linear models, while the missingness mechanism is commonly represented using logistic or probit regression. Because Missing Not at Random models are generally not identified from observed data alone, estimation requires identifying restrictions, exclusion restrictions, distributional assumptions, or sensitivity parameters.

In practice, Selection Models are estimated using maximum likelihood, Bayesian methods, numerical integration, or simulation-based procedures. In health economics they are used to examine the sensitivity of treatment-effect, cost, utility, and quality-adjusted life-year estimates to informative dropout, non-response, and other forms of non-random missingness in clinical trials and observational studies.

Purpose


Used to model outcomes jointly with the probability of observation, assess departures from Missing At Random assumptions, and quantify the effect of informative missingness on clinical and economic estimates.

Mathematical Formulae

Primary Formula

f(Y, R | X) = f(Y | X) ? P(R | Y, X)

where:

  • Y = outcome data
  • R = missingness indicator or pattern
  • X = observed covariates
  • f(Y | X) = outcome model
  • P(R | Y, X) = missingness model

Supporting Formulae

A common logistic missingness model is:

logit[P(R? = 1 | Y?, X?)] = �? + �?Y? + �?X?

where:

logit(p) = ln[p � (1 ? p)]

Observed-data likelihood:

L(?, �) = ? ? f(Y? | X?; ?) ? P(R? | Y?, X?; �) dY????

For the Heckman sample-selection model:

Y? = X?? + �?

S?* = Z?? + u?

S? = 1 if S?* > 0

Corr(�?, u?) = ?

Related Mathematical Methods

  • Missing Not at Random
  • Pattern Mixture Model
  • Shared Parameter Model
  • Heckman Selection Model
  • Maximum Likelihood Estimation
  • Bayesian Estimation
  • Logistic Regression
  • Sensitivity Analysis

Example

A trial-based economic evaluation records 12-month QALYs, but participants with poor health outcomes are more likely to withdraw before completing follow-up.

The outcome model is:

QALY? = ?? + ??Treatment? + ??BaselineUtility? + �?

The missingness model is:

logit[P(R? = 1)] = �? + �?QALY? + �?Treatment?

A negative estimate of �? indicates that participants with lower unobserved QALYs are less likely to provide complete follow-up data. The jointly estimated treatment effect can then be compared with the estimate obtained under Missing At Random assumptions to assess the sensitivity of the economic conclusions to informative dropout.


Excel Implementation

FunctionExample FormulaHealth Economics Application
EXP=1/(1+EXP(-(A2+B2*C2+D2*E2)))Calculate the modelled probability that an outcome is observed.
LN=LN(F2/(1-F2))Convert an observation probability to the logit scale.
IF=IF(B2="",0,1)Create a missingness indicator for cost, utility, or QALY outcomes.
SUMPRODUCT=SUMPRODUCT(LogLikelihoodRange)Aggregate observation-level log-likelihood contributions.
SOLVERMaximise TotalLogLikelihood by changing ParameterCellsEstimate simplified selection-model parameters by numerical optimisation.

VBA (Optional)

Automate construction of missingness indicators, likelihood evaluation, and sensitivity analyses across alternative selection-model parameters.


Sources

  • Heckman JJ. Sample Selection Bias as a Specification Error. Econometrica. 1979.
  • Diggle P, Kenward MG. Informative Drop-Out in Longitudinal Data Analysis. Journal of the Royal Statistical Society: Series C. 1994.
  • Little RJA, Rubin DB. Statistical Analysis with Missing Data. 3rd ed.
  • Molenberghs G, Kenward MG. Missing Data in Clinical Studies.
  • Carpenter JR, Kenward MG. Multiple Imputation and its Application.
  • Faria R, Gomes M, Epstein D, White IR. A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted within Randomised Controlled Trials. Pharmacoeconomics. 2014.
  • NICE. Health Technology Evaluations: The Manual.

Library

Publications

1
  • Book

    Bayesian Methods in Health Economics — Gianluca Baio, 1st Edition ed., 2012 (Chapman & Hall / CRC Press)

    An overview of Bayesian statistical methods for the analysis of health economic data, covering economic evaluation concepts, statistical cost-effectiveness analysis, Bayesian computation and MCMC, and applied health economic evaluation.

Frequently Asked Questions (6)

  • What is a selection model?

    A missing data modelling approach explicitly modelling the process by which observations become missing, alongside the model for the outcome itself.

    Source: Heckman 1979

  • What does a selection model make explicit about missing data?

    A selection model makes explicit the process by which data come to be missing, fitting a model for the outcome together with a model for the probability that each value is observed. By describing how missingness depends on the underlying values, it can accommodate data missing not at random, where the chance of a gap depends on what would have been recorded. This contrasts with a pattern-mixture model, which instead stratifies by the observed missingness pattern. Modelling why data go missing is its approach. Little and Rubin (2002) describe this.

    Source: Little & Rubin 2002

  • How does a selection model work?

    A selection model works by specifying two linked components: a model for the outcome, and a model for the probability that an observation is missing, which may depend on the outcome value itself, including when it is unobserved. These are combined so that the missingness mechanism is accounted for in estimating the outcome. So a selection model works by jointly modelling the outcome and the selection, or missingness, process, which allows the dependence of missingness on the values to be represented, and this makes it suitable for missing not at random data, though it relies on assumptions about the missingness model that cannot be fully verified.

    Source: Heckman 1979

  • When is a selection model used?

    A selection model is used when data may be missing not at random, so that the probability of missingness depends on the unobserved values, and the analyst wishes to model the missingness process explicitly to account for it. So a selection model is used to address missing not at random situations, particularly in sensitivity analyses, since it can represent a dependence of missingness on the values themselves that standard methods assuming missing at random cannot, though its results depend on the assumed form of the missingness model, which is untestable, meaning it is used to explore the impact of missing not at random assumptions rather than to provide a definitive correction.

    Source: Heckman 1979

  • How does a selection model differ from a pattern-mixture model?

    A selection model and a pattern-mixture model are two frameworks for missing not at random data that factor the joint distribution of the outcome and missingness differently: the selection model models the missingness as depending on the outcome, while the pattern-mixture model conditions the outcome on the missingness pattern. So the two differ in how they decompose the relationship between outcomes and missingness, with the selection model modelling the probability of missingness given the values and the pattern-mixture model stratifying by missingness pattern, and both make untestable assumptions, so they are often used together in sensitivity analyses to examine missing not at random possibilities from complementary directions.

    Source: Heckman 1979

  • What are the limitations of a selection model?

    The limitations of a selection model include its reliance on assumptions about the form of the missingness model, which cannot be verified from the data and can strongly influence the results; and its sensitivity to misspecification, since an incorrect selection model can bias the estimates. So a selection model is used with caution, since its conclusions depend on untestable assumptions about how missingness relates to the values, which is why it is applied mainly in sensitivity analyses that examine a range of assumptions rather than as a definitive method, and why its results are interpreted as exploring the possible impact of missing not at random rather than as reliably correcting for it.

    Source: Heckman 1979

Trust Record

Verified by Dr Darrin Baines

British health economist

Professional identity: darrinbaines.org

Verification date: 24 Dec 2025

Content version: 1.0.0

Canonical Identity

Term code
HE-ES-SA-191

Stable URI · Machine-readable · Resolvable · CC BY 4.0