Author-reviewedEvidence: highv1.0.0

Eigenvalue

An eigenvalue describes how a matrix scales a particular direction without changing that direction.

Last reviewed byDr Darrin Baines

Concept Architecture

What an eigenvalue reveals about a matrix

That direction is represented by an eigenvector, and together the pair can reveal long-run behaviour, dominant patterns and numerical stability that are difficult to see from individual matrix entries. This page explains the defining equation, shows how eigenvalues are calculated and interpreted, and connects them to state-transition models, covariance structures and other health-economic applications.

Eigenvalues are properties of square matrices. They summarise selected transformations produced by a matrix; they do not replace the underlying model, its assumptions or the interpretation of its rows and columns.

The equation that defines an eigenvalue

Suppose a square matrix (A) transforms a non-zero vector (v). If the result points in the same or exactly opposite direction as (v), differing only by a scalar multiplier, then (v) is an eigenvector of (A) and that multiplier is its eigenvalue. The defining equation is:

Av=λvAv=\lambda v

where:

  • (A) is an (n \times n) square matrix.
  • (v) is a non-zero eigenvector.
  • (\lambda) is the eigenvalue associated with (v).

The value of (\lambda) determines how the transformation changes the eigenvector:

EigenvalueEffect on the associated eigenvector
(\lambda>1)The vector is stretched in the same direction.
(0<\lambda<1)The vector is contracted in the same direction.
(\lambda=1)The vector is unchanged.
(\lambda=0)The vector is mapped to the zero vector.
(\lambda<0)The vector reverses direction and is scaled by (
Complex (\lambda)The transformation includes rotational or oscillatory behaviour when interpreted over the real plane.

How eigenvalues are calculated

The defining equation can be rearranged so that the eigenvalue problem becomes a condition on a determinant. A non-zero solution for (v) exists only when (A-\lambda I) is singular. This produces the characteristic equation:

det⁡(A−λI)=0\det(A-\lambda I)=0

The polynomial (\det(A-\lambda I)) is the characteristic polynomial, and its roots are the eigenvalues of (A). Once an eigenvalue is known, its associated eigenvectors are found by solving:

(A−λI)v=0(A-\lambda I)v=0

For a (2\times2) matrix:

A=[abcd]A= \begin{bmatrix} a & b \\ c & d \end{bmatrix}

the characteristic equation is:

λ2−(a+d)λ+(ad−bc)=0\lambda^2-(a+d)\lambda+(ad-bc)=0

The coefficient (a+d) is the trace of (A), and (ad-bc) is its determinant. Therefore, counting algebraic multiplicity, the sum of the eigenvalues equals the trace and their product equals the determinant.

A worked two-state calculation

Consider a two-state transition matrix in which each row represents a current state and each column represents a next state. The calculation illustrates both how to obtain the eigenvalues and why one eigenvalue of a stochastic transition matrix is typically one. It also shows how the other eigenvalue governs the rate at which the effect of the initial state distribution diminishes.

Let:

P=[0.80.20.10.9]P= \begin{bmatrix} 0.8 & 0.2 \\ 0.1 & 0.9 \end{bmatrix}

The characteristic equation is:

det⁡(P−λI)=∣0.8−λ0.20.10.9−λ∣=0\det(P-\lambda I) = \begin{vmatrix} 0.8-\lambda & 0.2 \\ 0.1 & 0.9-\lambda \end{vmatrix} =0

Expanding the determinant gives:

(0.8−λ)(0.9−λ)−0.02=0(0.8-\lambda)(0.9-\lambda)-0.02=0 λ2−1.7λ+0.70=0\lambda^2-1.7\lambda+0.70=0 (λ−1)(λ−0.7)=0(\lambda-1)(\lambda-0.7)=0

The eigenvalues are therefore (\lambda_1=1) and (\lambda_2=0.7). The eigenvalue one corresponds to the matrix's stable probability structure, while the magnitude (0.7) determines how quickly deviations from that structure contract under repeated multiplication.

What eigenvalues mean in a transition model

A cohort state-transition model repeatedly multiplies a state vector by a transition matrix. Eigenvalues help describe the behaviour of repeated powers of that matrix, including persistence, convergence and absorption. Their interpretation depends on the transition convention, the structure of the chain and whether the model is time-homogeneous.

For a row-stochastic transition matrix (P), each row sums to one and (\lambda=1) is an eigenvalue. Under suitable conditions, a stationary row vector (\pi) satisfies:

πP=π\pi P=\pi

with:

∑iπi=1\sum_i \pi_i=1

The stationary distribution is therefore a left eigenvector associated with eigenvalue one. If a column-vector convention is used, the corresponding orientation changes, so analysts must not switch between left and right eigenvectors without also changing the matrix convention.

In a finite irreducible and aperiodic Markov chain, the other eigenvalues have magnitude below one and their contributions decay as the matrix is repeatedly applied. The second-largest eigenvalue magnitude often indicates the speed of convergence: a value close to one implies slow convergence, while a smaller magnitude implies faster convergence.

Absorbing states change the long-run interpretation

Health-economic transition models commonly include an absorbing state such as death. Once the cohort enters that state, it cannot leave, so the model's long-run distribution may be driven by absorption rather than by a clinically meaningful equilibrium among living states. An eigenvalue of one is therefore expected, but it must not automatically be interpreted as evidence of a useful steady-state population.

For an absorbing state (j):

pjj=1p_{jj}=1

and:

pjk=0for k≠jp_{jk}=0 \quad \text{for } k\ne j

A model with more than one closed communicating class may have eigenvalue one with multiplicity greater than one. In that situation, the limiting distribution can depend on the initial state and on which closed class is reached.

The dominant eigenvalue and spectral radius

The spectral radius is the largest absolute value among a matrix's eigenvalues. It provides a compact indication of how repeated multiplication may amplify, preserve or reduce components of a vector. The spectral radius is defined as:

ρ(A)=max⁡i∣λi∣\rho(A)=\max_i |\lambda_i|

If (\rho(A)<1), then (A^t) approaches the zero matrix as (t) increases. If (\rho(A)>1), repeated multiplication can cause at least one component to grow in magnitude, while (\rho(A)=1) requires closer examination of multiplicity and matrix structure before long-run behaviour can be concluded.

For a stochastic transition matrix, the spectral radius is one. This result follows from the probability-preserving structure of the matrix, but it does not by itself establish irreducibility, convergence to a unique stationary distribution or clinical plausibility.

How eigenvalues support uncertainty analysis

Eigenvalues are also used to examine variance-covariance and correlation matrices. Because a valid covariance matrix must be positive semidefinite, all of its eigenvalues should be non-negative apart from negligible deviations caused by numerical rounding. A materially negative eigenvalue can indicate an invalid covariance specification that will cause problems in correlated parameter sampling.

For a covariance matrix (\Sigma):

xTΣx≥0for every vector xx^{\mathsf T}\Sigma x\ge 0 \quad \text{for every vector } x

This condition is equivalent to all eigenvalues of (\Sigma) being non-negative. When a probabilistic sensitivity analysis samples correlated parameters, checking the eigenvalues can therefore detect incompatible correlations, inconsistent rounding or an incorrectly assembled matrix before simulation begins.

Small positive eigenvalues may also signal near-linear dependence. The matrix can remain mathematically valid while being numerically fragile, so apparently minor changes in inputs may produce large changes in inverses, decompositions or sampled values.

How principal component analysis uses eigenvalues

Principal component analysis reduces a set of correlated variables to a smaller number of uncorrelated components. Each component corresponds to an eigenvector of a covariance or correlation matrix, and its eigenvalue measures the variance explained along that direction. This can help summarise high-dimensional health, utilisation or preference data, although the resulting components still require substantive interpretation.

If the ordered eigenvalues are (\lambda_1\ge\lambda_2\ge\cdots\ge\lambda_n\ge0), the proportion of total variance explained by component (k) is:

λk∑i=1nλi\frac{\lambda_k}{\sum_{i=1}^{n}\lambda_i}

Retaining components solely because their eigenvalues exceed an arbitrary threshold can be misleading. The number retained should also reflect the analysis purpose, data-generating context, interpretability and validation performance.

Repeated and complex eigenvalues need careful handling

An eigenvalue may occur more than once as a root of the characteristic polynomial. Its algebraic multiplicity counts how often it appears as a root, while its geometric multiplicity is the number of linearly independent eigenvectors associated with it. When a matrix does not have enough independent eigenvectors, it cannot be diagonalised in the usual way.

A real matrix can also have complex eigenvalues, which occur in conjugate pairs. Complex values are not automatically errors; they can reflect rotational or oscillatory behaviour. In a health-economic model, however, analysts should confirm that the matrix being analysed is the intended object and that any resulting interpretation remains meaningful for the clinical process.

Why software results can differ slightly

Analytical formulas are useful for small matrices, but applied models normally obtain eigenvalues using numerical algorithms. Floating-point arithmetic, matrix scaling and the choice of algorithm can produce tiny imaginary parts or very small negative values that are numerical artefacts rather than substantive features. The size of the discrepancy should be judged relative to the matrix scale and the purpose of the calculation.

Directly solving a high-degree characteristic polynomial is generally less stable than using established numerical eigensolvers. Analysts should preserve adequate precision, avoid premature rounding and compare suspicious results across a second implementation or decomposition.

Common interpretation errors

Eigenvalues compress important information, but they do not explain a matrix without its eigenvectors, labels and modelling context. A technically correct eigenvalue can be misinterpreted if the analyst ignores orientation, multiplicity or the assumptions behind the matrix. The following errors are especially important in health-economic applications.

  • Treating every eigenvalue of one as a unique equilibrium ignores reducibility, absorbing states and multiplicity.
  • Confusing left and right eigenvectors can attach the stationary interpretation to the wrong vector orientation.
  • Using only the largest eigenvalue can hide slow convergence, oscillation or multiple closed classes represented by other eigenvalues.
  • Interpreting a negative covariance eigenvalue without checking scale can mistake harmless floating-point noise for a material validity problem, or dismiss a genuinely invalid covariance matrix as rounding.
  • Assuming diagonalisation is always possible ignores matrices with insufficient independent eigenvectors.
  • Applying time-homogeneous conclusions to changing matrices is inappropriate when transition probabilities vary by cycle, age or time since treatment.
  • Equating long-run mathematical behaviour with decision relevance ignores finite horizons, discounting, competing risks and clinical plausibility.

A practical validation sequence

An eigenvalue analysis should begin by confirming that the matrix itself represents the intended quantities. Validation should then test mathematical identities, numerical stability and the substantive meaning of the result. This sequence makes the calculation auditable without treating the software output as self-validating.

  1. Confirm that the matrix is square and verify every row label, column label and ordering convention.
  2. Check the matrix-specific constraints, including stochastic row sums or covariance symmetry and positive semidefiniteness.
  3. Calculate a small case independently and verify the characteristic equation, trace and determinant relationships.
  4. Substitute each eigenpair into (Av=\lambda v) and examine the residual (Av-\lambda v).
  5. Inspect multiplicity and orientation before interpreting stationary distributions or long-run behaviour.
  6. Compare eigenvalue magnitudes to assess persistence, convergence or numerical sensitivity.
  7. Repeat suspicious calculations at higher precision or with a second reliable numerical method.
  8. Relate the result back to the model horizon and decision problem rather than reporting a purely mathematical conclusion.

Eigenvalues are most useful when they reveal behaviour that can be traced back to an explicit model structure. They should support, not replace, validation of transition probabilities, covariance assumptions, clinical pathways and economic outputs.

Library

Publications

1
  • Book

    Bayesian Methods in Health Economics — Gianluca Baio, 1st Edition ed., 2012 (Chapman & Hall / CRC Press)

    An overview of Bayesian statistical methods for the analysis of health economic data, covering economic evaluation concepts, statistical cost-effectiveness analysis, Bayesian computation and MCMC, and applied health economic evaluation.

Frequently Asked Questions (6)

  • What is an eigenvalue?

    A mathematical quantity indicating the amount of variance explained by its corresponding direction, used in factor analysis to decide how many factors to keep.

    Source: Belsley, Kuh & Welsch 1980

  • What does an eigenvalue represent in factor analysis?

    In factor analysis an eigenvalue represents the amount of variance among the measured variables that a particular factor accounts for. A large eigenvalue marks a factor that explains a substantial share of the shared variation, while a small one marks a factor that captures little. Comparing eigenvalues, often by keeping those above one or by reading a scree plot, guides how many factors are worth retaining. Measuring the variance a factor explains is what it does. Kline (2015) describes this.

    Source: Kline 2015

  • How are eigenvalues used in factor analysis?

    Eigenvalues are used in factor analysis to decide how many factors to retain, since each eigenvalue indicates the amount of variance a factor explains, and factors with larger eigenvalues account for more of the variation. Common rules retain factors with eigenvalues above one or use a scree plot of the eigenvalues to find where they level off. So eigenvalues are used to guide the number of factors kept, by indicating each factor's contribution to explaining the variance, which helps balance capturing the important structure against retaining too many factors, and they underpin common criteria for deciding the dimensionality of a factor solution.

    Source: Belsley, Kuh & Welsch 1980

  • What does an eigenvalue represent?

    An eigenvalue represents the amount of variance in the data explained by its associated factor or component, so a larger eigenvalue means that direction captures more of the total variability. In factor analysis, the eigenvalues from the correlation matrix indicate how much variance each potential factor accounts for. So an eigenvalue represents the variance captured by a factor or component, providing a measure of its importance in summarising the data, which is why the pattern of eigenvalues, from largest to smallest, is examined to judge how many factors meaningfully contribute and how much of the total variance the retained factors together explain.

    Source: Belsley, Kuh & Welsch 1980

  • How do eigenvalues help decide the number of factors?

    Eigenvalues help decide the number of factors through criteria based on their sizes: the Kaiser rule retains factors with eigenvalues greater than one, on the reasoning that a factor should explain at least as much variance as a single variable, and the scree plot displays the eigenvalues in order to find the point where they level off, retaining factors before it. So eigenvalues guide the choice of the number of factors by indicating each factor's contribution, with these criteria offering rules of thumb, though they are applied with judgement, since mechanical use can retain too many or too few factors, and interpretability is also considered alongside the eigenvalues.

    Source: Belsley, Kuh & Welsch 1980

  • How do eigenvalues relate to collinearity diagnostics?

    Eigenvalues relate to collinearity diagnostics in regression because small eigenvalues of the predictor matrix indicate near-linear dependencies among the predictors, that is collinearity, and the condition indices used to detect collinearity are derived from the eigenvalues. A very small eigenvalue signals a direction along which the predictors barely vary, reflecting strong collinearity. So eigenvalues underlie collinearity diagnostics, with small eigenvalues revealing the near-dependencies that define collinearity and giving rise to large condition indices, which is why examining the eigenvalue structure of the predictors is part of diagnosing collinearity in regression as well as determining dimensions in factor analysis.

    Source: Belsley, Kuh & Welsch 1980

Trust Record

Verified by Dr Darrin Baines

British health economist

Professional identity: darrinbaines.org

Verification date: 25 Sep 2026

Content version: 1.0.0

Canonical Identity

Term code
HE-ES-SA-058

Stable URI · Machine-readable · Resolvable · CC BY 4.0