Concept Architecture
Concept
Theoretically, Likelihood Ratio Test is a hypothesis test used to compare the goodness of fit of two nested statistical models by evaluating whether the addition of one or more parameters significantly improves model fit. It is founded on likelihood theory, whereby competing models are compared according to the probability of observing the available data under each model. In health economics, the likelihood ratio test is widely used during regression modelling, survival analysis, generalised linear modelling and other likelihood-based statistical analyses to determine whether additional explanatory variables or model structures are justified.
Mathematically, the likelihood ratio test compares the maximum likelihood values of a restricted model and a more general unrestricted model. The test statistic is based on twice the difference in their log-likelihoods and, under regularity conditions and the null hypothesis, follows an asymptotic chi-square distribution with degrees of freedom equal to the difference in the number of estimated parameters. Larger test statistics indicate stronger evidence that the unrestricted model provides a significantly better fit.
In practice, analysts estimate both nested models using maximum likelihood estimation, calculate the likelihood ratio statistic and compare it with the appropriate chi-square distribution or corresponding p-value. Within health economics, the test is commonly applied when evaluating alternative survival models, selecting regression covariates, comparing disease progression models and validating statistical models used to estimate costs, utilities or transition probabilities.
Purpose
Used to determine whether a more complex nested statistical model provides a significantly better fit to observed data than a simpler model, thereby supporting model selection and validation in health economic analyses.
Mathematical Formulae
Primary Formula
LR = ?2[ln L? ? ln L?]
where:
- L? = maximum likelihood of the restricted model
- L? = maximum likelihood of the unrestricted model
Under the null hypothesis,
LR ? ?�?df?
where
df = p? ? p?
- p? = number of parameters in the unrestricted model
- p? = number of parameters in the restricted model
Supporting Formulae
p-value:
p = P(?�?df? � LR)
Related Mathematical Methods
- Maximum likelihood estimation
- Nested model comparison
- Chi-square hypothesis testing
- Logistic regression
- Generalised linear models
- Survival analysis
- Akaike Information Criterion
- Bayesian Information Criterion
Example
A health economist compares two nested logistic regression models predicting hospital admission.
The restricted model contains age and sex only, with
ln L? = ?482.3
The unrestricted model additionally includes comorbidity score, with
ln L? = ?474.6
The likelihood ratio statistic is
LR = ?2(?482.3 + 474.6) = 15.4
The unrestricted model estimates one additional parameter, so
df = 1
The corresponding p-value is less than 0.001, indicating that inclusion of comorbidity significantly improves model fit.
Excel Implementation
| Function | Example Formula | Health Economics Application |
|---|---|---|
| CHISQ.DIST.RT | =CHISQ.DIST.RT(B2,B3) | Calculates the p-value from the likelihood ratio statistic and degrees of freedom. |
| LN | =LN(B2) | Calculates log-likelihood values where required. |
| ABS | =ABS(B2-B3) | Examines differences in log-likelihoods between competing models. |
| IF | =IF(CHISQ.DIST.RT(B2,B3)<0.05,""Improved model"",""No significant improvement"") | Determines whether the unrestricted model significantly improves fit. |
VBA (Optional)
Automate estimation of nested models, calculation of likelihood ratio statistics and production of model comparison reports.
Sources
- Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed.
- Briggs A, Claxton K, Sculpher M. Decision Modelling for Health Economic Evaluation.
- Casella G, Berger RL. Statistical Inference. 2nd ed.
- Dobson AJ, Barnett AG. An Introduction to Generalized Linear Models. 4th ed.
- Harrell FE. Regression Modeling Strategies. 2nd ed.
- Wilks SS. The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses. Annals of Mathematical Statistics. 1938;9:60?62.
Related Concepts (2)
Library
Publications
1
Model Transparency and Validation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-7 — Eddy, Hollingworth, Caro, Tsevat, McDonald & Wong, Task Force Report 7 ed., 2012 (Value in Health / Medical Decision Making)
Best-practice guidance on model transparency and validation, defining face, internal, external and predictive validation and setting out how models should be documented for scrutiny.
Journal ArticleView source →
Frequently Asked Questions (6)
What is the likelihood ratio test?
A statistical test comparing the fit of two nested models by their ratio of likelihoods, used to judge whether added parameters improve fit.
Source: Neyman & Pearson 1933
Why does the likelihood ratio test require nested models?
The likelihood ratio test compares a simpler model against a more complex one that contains it, differing only by added parameters, which is what nested means. Because the simpler model is a special case of the larger, the test can attribute any improvement in fit purely to the extra parameters and judge whether it exceeds what chance would give. Applied to models that are not nested, the comparison has no such clean interpretation, so the test does not apply. Nesting is the condition for its validity. Cox and Hinkley (1974) set out the test.
Source: Cox & Hinkley 1974
How does the likelihood ratio test work?
The likelihood ratio test works by fitting both the smaller, restricted model and the larger model that includes it as a special case, computing the maximised likelihood of each, and forming a statistic from the ratio of the likelihoods, typically twice the difference in their log-likelihoods. Under the null hypothesis that the restriction holds, this statistic follows a chi-squared distribution with degrees of freedom equal to the number of added parameters. A large value leads to rejecting the restriction in favour of the larger model.
Source: Neyman & Pearson 1933
When is the likelihood ratio test used?
The likelihood ratio test is used to compare two nested models, where one is obtained from the other by imposing restrictions, to decide whether the additional parameters improve fit enough to be justified. It is applied in choosing between simpler and more complex models, testing whether added terms are warranted, for instance in regression or survival modelling. The test requires the models to be nested and fitted to the same data, so it is suited to formally assessing whether extra parameters significantly enhance fit.
Source: Fisher 1922
How is the likelihood ratio test interpreted?
The likelihood ratio test is interpreted through its statistic and the associated p-value: a large statistic and small p-value indicate that the larger model fits significantly better, so the added parameters are justified, while a small statistic suggests the extra parameters do not improve fit enough to reject the simpler model. Failing to reject favours the simpler model on grounds of parsimony. As with hypothesis tests generally, interpretation depends on the significance level and on the models being correctly specified and nested.
Source: Neyman & Pearson 1933
How does the likelihood ratio test differ from information criteria?
The likelihood ratio test and information criteria such as the Akaike and Bayesian criteria both compare models but differ in approach. The likelihood ratio test formally tests whether added parameters significantly improve fit between nested models, giving a p-value. Information criteria compare models, which need not be nested, by balancing fit against a penalty for complexity, selecting the best without a significance test. The likelihood ratio test decides whether extra parameters are warranted statistically, while information criteria rank models by an overall trade-off of fit and parsimony.
Source: Akaike 1974
Trust Record
Verified by Dr Darrin Baines
British health economist
Professional identity: darrinbaines.org
Verification date: 15 Oct 2025
Content version: 1.0.0
Canonical Identity
- Term code
- HE-EM-MV-037
Stable URI · Machine-readable · Resolvable · CC BY 4.0