VerifiedEvidence: highv1.0.0

Importance Sampling

A variance reduction technique for Monte Carlo simulation that deliberately oversamples important regions of a distribution, then reweights the samples to correct for this.

Last reviewedDarrin Baines IP Ltd

Concept Architecture

Concept


Theoretically, Importance Sampling is a variance reduction technique used in Monte Carlo simulation that improves the efficiency of estimating expectations by preferentially sampling from regions of the probability space that contribute most to the quantity of interest. Rather than sampling directly from the target distribution, observations are generated from an alternative proposal distribution and appropriately reweighted to preserve unbiased estimation. In health economics, importance sampling is used to improve computational efficiency when estimating rare events, tail probabilities and expected model outcomes.

Mathematically, importance sampling estimates an expectation under a target probability distribution by drawing samples from a proposal distribution and weighting each observation by the ratio of the target density to the proposal density. This weighting corrects for the change in sampling distribution while reducing estimator variance when the proposal distribution is appropriately chosen.

In practice, importance sampling is implemented by selecting a proposal distribution that concentrates sampling effort in influential regions of the parameter space. Weighted samples are then incorporated into Monte Carlo simulation, Bayesian computation and probabilistic sensitivity analysis to obtain more precise estimates without requiring a substantial increase in simulation size.

Purpose


Used to improve the efficiency and precision of Monte Carlo simulation by reducing estimator variance through weighted sampling from an alternative probability distribution.

Mathematical Formulae

Primary Formula

E[f(X)] = E?g?[f(X) ? (p(X) / g(X))]

where:

p(X) = target probability density

g(X) = proposal probability density

Supporting Formulae

Importance weight:

w(X) = p(X) / g(X)

Monte Carlo estimator:

? = (1/n) ? ?f(X?)w(X?)

Related Mathematical Methods

  • Monte Carlo Simulation
  • Variance Reduction Techniques
  • Control Variates
  • Antithetic Variates
  • Bayesian Analysis
  • Probabilistic Sensitivity Analysis

Example


A probabilistic sensitivity analysis evaluates a rare but costly adverse event occurring in fewer than 1% of simulated patients. Rather than relying on conventional random sampling, importance sampling increases the frequency with which these rare events are simulated. Each observation is then weighted according to the ratio of the target and proposal distributions, producing an unbiased estimate of expected costs with substantially lower simulation variance.

Excel Implementation

FunctionExample FormulaHealth Economics Application
RAND=RAND()Generate random values for Monte Carlo simulation.
NORM.DIST=NORM.DIST(A2,Mean,SD,FALSE)Evaluate target or proposal probability densities.
SUMPRODUCT=SUMPRODUCT(ValueRange,WeightRange)/SUM(WeightRange)Calculate weighted expectations using importance sampling weights.
SUM=SUM(WeightRange)Normalise sampling weights when summarising simulation results.

VBA (Optional)


VBA can automate weighted Monte Carlo simulation using proposal distributions and calculate importance sampling estimators for probabilistic sensitivity analyses.

Sources

  • Glasserman P. Monte Carlo Methods in Financial Engineering. Springer.
  • Robert CP, Casella G. Monte Carlo Statistical Methods. Springer.
  • Briggs A, Claxton K, Sculpher M. Decision Modelling for Health Economic Evaluation. Oxford University Press.
  • ISPOR-SMDM Modeling Good Research Practices Task Force Reports.
  • NICE. Health Technology Evaluation Manual.

Library

Publications

1
  • Journal article

    Parameter Estimation and Uncertainty: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-6 — Briggs, Weinstein, Fenwick, Karnon, Sculpher & Paltiel, Task Force Report 6 ed., 2012 (Value in Health / Medical Decision Making)

    Best-practice guidance on parameter estimation and the characterisation of uncertainty in decision models, covering probabilistic sensitivity analysis, distributional choices, and correlation between parameters.

Frequently Asked Questions (6)

  • What is importance sampling?

    A variance reduction technique for Monte Carlo simulation that deliberately oversamples important regions of a distribution, then reweights the samples to correct for this.

    Source: Kahn & Marshall 1953

  • Why does importance sampling oversample some regions?

    When the quantity of interest depends on rare or extreme values that ordinary random sampling would seldom draw, the estimate is noisy because few samples land where it matters. Importance sampling deliberately draws more heavily from those influential regions, so they are well represented, and then reweights each sample by how much it was over-drawn to keep the overall estimate unbiased. This concentrates effort where it counts, giving a more precise estimate for the same number of draws. The reweighting corrects the deliberate bias. Robert and Casella (2004) describe the method.

    Source: Robert & Casella 2004

  • How does importance sampling work?

    Importance sampling works by drawing samples from a chosen proposal distribution that emphasises the important regions, evaluating the quantity of interest at each sample, and weighting each by the ratio of the original density to the proposal density. This reweighting corrects for sampling from the proposal rather than the true distribution, so the weighted average gives an unbiased estimate. Choosing a proposal that places more samples where the integrand is large concentrates effort effectively, reducing the variance of the estimate compared with ordinary sampling.

    Source: Press et al. 2007

  • Why is importance sampling used?

    Importance sampling is used when the quantity of interest depends heavily on rare or specific regions of a distribution, so that ordinary sampling would place few samples there and estimate it imprecisely. By oversampling those important regions and reweighting, it obtains a more accurate estimate for the same number of samples. This makes it valuable for estimating small tail probabilities or expectations dominated by low-probability, high-impact regions, where naive Monte Carlo would need very many samples to achieve comparable precision.

    Source: Kahn & Marshall 1953

  • What determines the effectiveness of importance sampling?

    The effectiveness of importance sampling depends on how well the proposal distribution matches the important regions of the integrand: a good proposal concentrates samples where they contribute most and yields low-variance estimates, while a poor proposal, mismatched to the integrand, can give highly variable weights and even increase the variance. Choosing the proposal well is therefore central. An ill-chosen proposal producing a few very large weights makes the estimate unstable, so the technique's benefit hinges on a suitable proposal distribution.

    Source: Kahn & Marshall 1953

  • What are the limitations of importance sampling?

    Importance sampling requires choosing a good proposal distribution, and a poor choice can make the estimate more variable than ordinary sampling, sometimes with a few extreme weights dominating and destabilising the result. Designing an effective proposal can be difficult, particularly in high dimensions, and the weights must be computed correctly. Its performance is problem-specific. These limitations mean importance sampling is applied where a suitable proposal can be identified, with the weights monitored for stability, rather than used as a general-purpose default.

    Source: Kahn & Marshall 1953

Trust Record

Verified by Dr Darrin Baines

British health economist

Professional identity: darrinbaines.org

Verification date: 28 Oct 2025

Content version: 1.0.0

Canonical Identity

Term code
HE-EM-UA-028

Stable URI · Machine-readable · Resolvable · CC BY 4.0