Concept Architecture
Concept
Theoretically, Importance Sampling is a variance reduction technique used in Monte Carlo simulation that improves the efficiency of estimating expectations by preferentially sampling from regions of the probability space that contribute most to the quantity of interest. Rather than sampling directly from the target distribution, observations are generated from an alternative proposal distribution and appropriately reweighted to preserve unbiased estimation. In health economics, importance sampling is used to improve computational efficiency when estimating rare events, tail probabilities and expected model outcomes.
Mathematically, importance sampling estimates an expectation under a target probability distribution by drawing samples from a proposal distribution and weighting each observation by the ratio of the target density to the proposal density. This weighting corrects for the change in sampling distribution while reducing estimator variance when the proposal distribution is appropriately chosen.
In practice, importance sampling is implemented by selecting a proposal distribution that concentrates sampling effort in influential regions of the parameter space. Weighted samples are then incorporated into Monte Carlo simulation, Bayesian computation and probabilistic sensitivity analysis to obtain more precise estimates without requiring a substantial increase in simulation size.
Purpose
Used to improve the efficiency and precision of Monte Carlo simulation by reducing estimator variance through weighted sampling from an alternative probability distribution.
Mathematical Formulae
Primary Formula
E[f(X)] = E?g?[f(X) ? (p(X) / g(X))]
where:
p(X) = target probability density
g(X) = proposal probability density
Supporting Formulae
Importance weight:
w(X) = p(X) / g(X)
Monte Carlo estimator:
? = (1/n) ? ?f(X?)w(X?)
Related Mathematical Methods
- Monte Carlo Simulation
- Variance Reduction Techniques
- Control Variates
- Antithetic Variates
- Bayesian Analysis
- Probabilistic Sensitivity Analysis
Example
A probabilistic sensitivity analysis evaluates a rare but costly adverse event occurring in fewer than 1% of simulated patients. Rather than relying on conventional random sampling, importance sampling increases the frequency with which these rare events are simulated. Each observation is then weighted according to the ratio of the target and proposal distributions, producing an unbiased estimate of expected costs with substantially lower simulation variance.
Excel Implementation
| Function | Example Formula | Health Economics Application |
|---|---|---|
| RAND | =RAND() | Generate random values for Monte Carlo simulation. |
| NORM.DIST | =NORM.DIST(A2,Mean,SD,FALSE) | Evaluate target or proposal probability densities. |
| SUMPRODUCT | =SUMPRODUCT(ValueRange,WeightRange)/SUM(WeightRange) | Calculate weighted expectations using importance sampling weights. |
| SUM | =SUM(WeightRange) | Normalise sampling weights when summarising simulation results. |
VBA (Optional)
VBA can automate weighted Monte Carlo simulation using proposal distributions and calculate importance sampling estimators for probabilistic sensitivity analyses.
Sources
- Glasserman P. Monte Carlo Methods in Financial Engineering. Springer.
- Robert CP, Casella G. Monte Carlo Statistical Methods. Springer.
- Briggs A, Claxton K, Sculpher M. Decision Modelling for Health Economic Evaluation. Oxford University Press.
- ISPOR-SMDM Modeling Good Research Practices Task Force Reports.
- NICE. Health Technology Evaluation Manual.
Related Concepts (2)
Library
Publications
1
Parameter Estimation and Uncertainty: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-6 — Briggs, Weinstein, Fenwick, Karnon, Sculpher & Paltiel, Task Force Report 6 ed., 2012 (Value in Health / Medical Decision Making)
Best-practice guidance on parameter estimation and the characterisation of uncertainty in decision models, covering probabilistic sensitivity analysis, distributional choices, and correlation between parameters.
Journal ArticleView source →
Frequently Asked Questions (6)
What is importance sampling?
A variance reduction technique for Monte Carlo simulation that deliberately oversamples important regions of a distribution, then reweights the samples to correct for this.
Source: Kahn & Marshall 1953
Why does importance sampling oversample some regions?
When the quantity of interest depends on rare or extreme values that ordinary random sampling would seldom draw, the estimate is noisy because few samples land where it matters. Importance sampling deliberately draws more heavily from those influential regions, so they are well represented, and then reweights each sample by how much it was over-drawn to keep the overall estimate unbiased. This concentrates effort where it counts, giving a more precise estimate for the same number of draws. The reweighting corrects the deliberate bias. Robert and Casella (2004) describe the method.
Source: Robert & Casella 2004
How does importance sampling work?
Importance sampling works by drawing samples from a chosen proposal distribution that emphasises the important regions, evaluating the quantity of interest at each sample, and weighting each by the ratio of the original density to the proposal density. This reweighting corrects for sampling from the proposal rather than the true distribution, so the weighted average gives an unbiased estimate. Choosing a proposal that places more samples where the integrand is large concentrates effort effectively, reducing the variance of the estimate compared with ordinary sampling.
Source: Press et al. 2007
Why is importance sampling used?
Importance sampling is used when the quantity of interest depends heavily on rare or specific regions of a distribution, so that ordinary sampling would place few samples there and estimate it imprecisely. By oversampling those important regions and reweighting, it obtains a more accurate estimate for the same number of samples. This makes it valuable for estimating small tail probabilities or expectations dominated by low-probability, high-impact regions, where naive Monte Carlo would need very many samples to achieve comparable precision.
Source: Kahn & Marshall 1953
What determines the effectiveness of importance sampling?
The effectiveness of importance sampling depends on how well the proposal distribution matches the important regions of the integrand: a good proposal concentrates samples where they contribute most and yields low-variance estimates, while a poor proposal, mismatched to the integrand, can give highly variable weights and even increase the variance. Choosing the proposal well is therefore central. An ill-chosen proposal producing a few very large weights makes the estimate unstable, so the technique's benefit hinges on a suitable proposal distribution.
Source: Kahn & Marshall 1953
What are the limitations of importance sampling?
Importance sampling requires choosing a good proposal distribution, and a poor choice can make the estimate more variable than ordinary sampling, sometimes with a few extreme weights dominating and destabilising the result. Designing an effective proposal can be difficult, particularly in high dimensions, and the weights must be computed correctly. Its performance is problem-specific. These limitations mean importance sampling is applied where a suitable proposal can be identified, with the weights monitored for stability, rather than used as a general-purpose default.
Source: Kahn & Marshall 1953
Trust Record
Verified by Dr Darrin Baines
British health economist
Professional identity: darrinbaines.org
Verification date: 28 Oct 2025
Content version: 1.0.0
Canonical Identity
- Persistent URI
- https://healtheconomics.wiki/concept/importance-sampling
- Term code
- HE-EM-UA-028
Stable URI · Machine-readable · Resolvable · CC BY 4.0