VerifiedEvidence: highv1.0.0

Likelihood Ratio Test

A statistical test comparing the fit of two nested models by their ratio of likelihoods, used to judge whether added parameters improve fit.

Last reviewedDarrin Baines IP Ltd

Concept Architecture

Concept

Theoretically, Likelihood Ratio Test is a hypothesis test used to compare the goodness of fit of two nested statistical models by evaluating whether the addition of one or more parameters significantly improves model fit. It is founded on likelihood theory, whereby competing models are compared according to the probability of observing the available data under each model. In health economics, the likelihood ratio test is widely used during regression modelling, survival analysis, generalised linear modelling and other likelihood-based statistical analyses to determine whether additional explanatory variables or model structures are justified.

Mathematically, the likelihood ratio test compares the maximum likelihood values of a restricted model and a more general unrestricted model. The test statistic is based on twice the difference in their log-likelihoods and, under regularity conditions and the null hypothesis, follows an asymptotic chi-square distribution with degrees of freedom equal to the difference in the number of estimated parameters. Larger test statistics indicate stronger evidence that the unrestricted model provides a significantly better fit.

In practice, analysts estimate both nested models using maximum likelihood estimation, calculate the likelihood ratio statistic and compare it with the appropriate chi-square distribution or corresponding p-value. Within health economics, the test is commonly applied when evaluating alternative survival models, selecting regression covariates, comparing disease progression models and validating statistical models used to estimate costs, utilities or transition probabilities.


Purpose

Used to determine whether a more complex nested statistical model provides a significantly better fit to observed data than a simpler model, thereby supporting model selection and validation in health economic analyses.


Mathematical Formulae

Primary Formula

LR = ?2[ln L? ? ln L?]

where:

  • L? = maximum likelihood of the restricted model
  • L? = maximum likelihood of the unrestricted model

Under the null hypothesis,

LR ? ?�?df?

where

df = p? ? p?

  • p? = number of parameters in the unrestricted model
  • p? = number of parameters in the restricted model

Supporting Formulae

p-value:

p = P(?�?df? � LR)

Related Mathematical Methods

  • Maximum likelihood estimation
  • Nested model comparison
  • Chi-square hypothesis testing
  • Logistic regression
  • Generalised linear models
  • Survival analysis
  • Akaike Information Criterion
  • Bayesian Information Criterion

Example

A health economist compares two nested logistic regression models predicting hospital admission.

The restricted model contains age and sex only, with

ln L? = ?482.3

The unrestricted model additionally includes comorbidity score, with

ln L? = ?474.6

The likelihood ratio statistic is

LR = ?2(?482.3 + 474.6) = 15.4

The unrestricted model estimates one additional parameter, so

df = 1

The corresponding p-value is less than 0.001, indicating that inclusion of comorbidity significantly improves model fit.


Excel Implementation

FunctionExample FormulaHealth Economics Application
CHISQ.DIST.RT=CHISQ.DIST.RT(B2,B3)Calculates the p-value from the likelihood ratio statistic and degrees of freedom.
LN=LN(B2)Calculates log-likelihood values where required.
ABS=ABS(B2-B3)Examines differences in log-likelihoods between competing models.
IF=IF(CHISQ.DIST.RT(B2,B3)<0.05,""Improved model"",""No significant improvement"")Determines whether the unrestricted model significantly improves fit.

VBA (Optional)

Automate estimation of nested models, calculation of likelihood ratio statistics and production of model comparison reports.


Sources

  • Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed.
  • Briggs A, Claxton K, Sculpher M. Decision Modelling for Health Economic Evaluation.
  • Casella G, Berger RL. Statistical Inference. 2nd ed.
  • Dobson AJ, Barnett AG. An Introduction to Generalized Linear Models. 4th ed.
  • Harrell FE. Regression Modeling Strategies. 2nd ed.
  • Wilks SS. The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses. Annals of Mathematical Statistics. 1938;9:60?62.

Library

Publications

1
  • Journal article

    Model Transparency and Validation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-7 — Eddy, Hollingworth, Caro, Tsevat, McDonald & Wong, Task Force Report 7 ed., 2012 (Value in Health / Medical Decision Making)

    Best-practice guidance on model transparency and validation, defining face, internal, external and predictive validation and setting out how models should be documented for scrutiny.

Frequently Asked Questions (6)

  • What is the likelihood ratio test?

    A statistical test comparing the fit of two nested models by their ratio of likelihoods, used to judge whether added parameters improve fit.

    Source: Neyman & Pearson 1933

  • Why does the likelihood ratio test require nested models?

    The likelihood ratio test compares a simpler model against a more complex one that contains it, differing only by added parameters, which is what nested means. Because the simpler model is a special case of the larger, the test can attribute any improvement in fit purely to the extra parameters and judge whether it exceeds what chance would give. Applied to models that are not nested, the comparison has no such clean interpretation, so the test does not apply. Nesting is the condition for its validity. Cox and Hinkley (1974) set out the test.

    Source: Cox & Hinkley 1974

  • How does the likelihood ratio test work?

    The likelihood ratio test works by fitting both the smaller, restricted model and the larger model that includes it as a special case, computing the maximised likelihood of each, and forming a statistic from the ratio of the likelihoods, typically twice the difference in their log-likelihoods. Under the null hypothesis that the restriction holds, this statistic follows a chi-squared distribution with degrees of freedom equal to the number of added parameters. A large value leads to rejecting the restriction in favour of the larger model.

    Source: Neyman & Pearson 1933

  • When is the likelihood ratio test used?

    The likelihood ratio test is used to compare two nested models, where one is obtained from the other by imposing restrictions, to decide whether the additional parameters improve fit enough to be justified. It is applied in choosing between simpler and more complex models, testing whether added terms are warranted, for instance in regression or survival modelling. The test requires the models to be nested and fitted to the same data, so it is suited to formally assessing whether extra parameters significantly enhance fit.

    Source: Fisher 1922

  • How is the likelihood ratio test interpreted?

    The likelihood ratio test is interpreted through its statistic and the associated p-value: a large statistic and small p-value indicate that the larger model fits significantly better, so the added parameters are justified, while a small statistic suggests the extra parameters do not improve fit enough to reject the simpler model. Failing to reject favours the simpler model on grounds of parsimony. As with hypothesis tests generally, interpretation depends on the significance level and on the models being correctly specified and nested.

    Source: Neyman & Pearson 1933

  • How does the likelihood ratio test differ from information criteria?

    The likelihood ratio test and information criteria such as the Akaike and Bayesian criteria both compare models but differ in approach. The likelihood ratio test formally tests whether added parameters significantly improve fit between nested models, giving a p-value. Information criteria compare models, which need not be nested, by balancing fit against a penalty for complexity, selecting the best without a significance test. The likelihood ratio test decides whether extra parameters are warranted statistically, while information criteria rank models by an overall trade-off of fit and parsimony.

    Source: Akaike 1974

Trust Record

Verified by Dr Darrin Baines

British health economist

Professional identity: darrinbaines.org

Verification date: 15 Oct 2025

Content version: 1.0.0

Canonical Identity

Term code
HE-EM-MV-037

Stable URI · Machine-readable · Resolvable · CC BY 4.0