Concept Architecture
Individual Patient Data Meta-Analysis: Concept Architecture
Orientation and learning roadmap
The page follows participant records from eligible studies through checking, harmonisation, and synthesis. It compares two-stage and one-stage analyses, works a simple pooling calculation, and shows how participant-level modifiers can inform a health-economic model. The last sections examine missing study data, trial-level clustering, and interpretation limits.
Assemble the eligible studies before requesting records
An IPD meta-analysis begins with a systematic question and an explicit search for all eligible studies, not just investigators who agree to share records. The team seeks participant-level observations such as treatment allocation, baseline covariates, outcomes, follow-up, and censoring from each study. Published study summaries remain relevant for assessing studies whose individual data cannot be obtained.
| Step | What is checked | Why it matters |
|---|---|---|
| Identify studies | Eligibility, design, interventions, populations, and outcomes. | Selective inclusion can bias the synthesis. |
| Obtain data | Studies and participants requested, received, and unavailable. | Missing IPD may make the accessible studies unrepresentative. |
| Check integrity | Participant counts, allocation, event dates, exclusions, and published totals. | Record errors or differing analysis populations can change estimates. |
| Harmonise variables | Consistent treatment, outcome, time origin, covariate, and missingness definitions. | Same-named variables can measure different things across trials. |
Data sharing requires agreements, privacy protection, and a reproducible analytic plan. Reanalysis may resolve inconsistencies in reported methods, but access to rawer data does not remove original trial bias or measurement limitations. The analysis should document changes from the protocol.
Choose a two-stage or one-stage analysis
In a two-stage analysis, each study's participant records are analysed separately to obtain a compatible effect estimate and uncertainty measure. Those study-specific estimates are then synthesised using a prespecified meta-analysis model. This preserves the study as the unit of evidence in the second stage and makes study-level heterogeneity visible.
A one-stage analysis fits a joint model to participant records from all studies while explicitly accounting for participants clustered within studies. Study-specific baselines, treatment effects, and relevant random effects or stratification should reflect the outcome and estimand. Pooling all records into one ordinary analysis while ignoring study membership can produce misleading precision or confound study differences with patient effects.
| Approach | Primary analysis object | Key safeguard |
|---|---|---|
| Two-stage IPD synthesis | A compatible estimate and standard error derived within each study. | Use a suitable study-level pooling model and inspect heterogeneity. |
| One-stage IPD synthesis | All participant records in a study-aware hierarchical or stratified model. | Account for study structure and separate within-study from between-study relationships. |
Either approach can estimate an overall effect when correctly specified; neither is inherently superior for every outcome or sparse-data setting. One-stage and two-stage estimates can differ because their models, weighting, treatment of sparse studies, or assumptions differ. State the estimand and assumptions before comparing them.
Check a small two-stage calculation
Suppose two hypothetical randomised studies provide harmonised participant-level estimates of an additive treatment effect on a common outcome: with standard error 0.05, and with standard error 0.10. Under a common-effect inverse-variance illustration, their weights are and . The pooled effect is therefore weighted more heavily toward the more precise study.
This arithmetic assumes the study estimates are independent, comparable on the same additive scale, and treated as sharing an underlying effect for this example. A random-effects model or a time-to-event outcome would require appropriate study-specific effect measures and synthesis assumptions. The example demonstrates the second stage; obtaining IPD is what enables the consistent first-stage reanalysis and patient-level investigations.
Estimate participant-level effect modification
Participant records can examine whether treatment effects differ by a baseline characteristic, such as disease severity, age, or a validated biomarker. The relevant evidence for a patient-level interaction is the comparison of treatment groups across characteristic levels within each study. Comparing studies with older average participants against studies with younger average participants can produce an ecological association that does not represent individual-level modification.
In a two-stage design, estimate a treatment-by-characteristic interaction within each trial and then pool those interaction estimates. In a one-stage design, separate the within-study characteristic deviation from its study mean when forming interactions, or use an equivalent parameterisation that keeps within- and between-study information distinct. Prespecify clinically plausible modifiers, their scale, missing-data handling, and multiplicity safeguards; a subgroup pattern from a small sample is uncertain.
Translate estimates into health-economic inputs
An economic model may use pooled comparative treatment effects, baseline-risk relationships, subgroup effects, and uncertainty estimates from an IPD synthesis. Keeping participant records can support consistent time-to-event analysis and exploration of covariate distributions in the target population. The model still needs absolute baseline risks, utility values, resource use, time horizon, and external validity assumptions rather than a pooled relative effect alone.
If patient-level costs and health outcomes are jointly analysed, preserve their dependence and the study structure where possible. Avoid treating participant records as if everyone came from one homogeneous trial or copying a subgroup interaction into an unrelated population without checking transportability. Differences in eligibility, clinical practice, follow-up, and comparator availability can be decision-critical.
Audit missing data, bias, and reporting
IPD may be unavailable for eligible studies, while participants or outcomes may be missing within studies that provide files. These are distinct gaps and can require different sensitivity analyses. Compare characteristics and published results for contributing and non-contributing studies, evaluate risk of bias, and report the flow of studies and participants as PRISMA-IPD recommends.
- Prespecify the review question, eligibility rules, outcomes, effect scale, and analysis methods.
- Reconcile received records with trial reports and explain any discrepancies in sample size or events.
- Keep study membership in the analysis and inspect between-study heterogeneity.
- Derive patient-level interactions from within-study comparisons, not study-average proxies.
- Explore the impact of studies without IPD and participants with missing outcomes or covariates.
- Report uncertainty and limits on applying results to the health-economic target population.
Sources and technical basis
Cochrane's IPD chapter describes the study search, data checks, one-stage and two-stage synthesis, and within-trial interactions. PRISMA-IPD provides reporting requirements for requested and received data, while methodological research explains ecological bias in participant-level interactions. The two-study pooling numbers above are original teaching values, not empirical treatment effects.
Related Concepts (2)
Library
Publications
3
Economic Evaluation in Clinical Trials — Glick, Doshi, Sonnad & Polsky, 2nd Edition ed., 2015 (Oxford University Press)
Practical guidance on conducting cost-effectiveness analyses alongside controlled trials, covering trial design, measurement of costs and quality-adjusted life years, handling censored and missing data, and reporting stochastic uncertainty. Volume 4 in the Handbooks in Health Economic Evaluation series.
BookView source →NICE DSU Technical Support Document 6: Embedding Evidence Synthesis in Probabilistic Cost-Effectiveness Analysis — Software Choices — Dias, Welton, Sutton & Ades, TSD 6 ed., 2011 (NICE Decision Support Unit (University of Sheffield))
Guidance on the software options and practical steps for embedding a Bayesian evidence synthesis directly within a probabilistic cost-effectiveness model so that parameter uncertainty is propagated consistently.
NICE DSU Technical Support Document 7: Evidence Synthesis of Treatment Efficacy in Decision Making — A Reviewer’s Checklist — Ades, Caldwell, Reken, Welton, Sutton & Dias, TSD 7 ed., 2011 (NICE Decision Support Unit (University of Sheffield))
A reviewer’s checklist for appraising evidence syntheses of treatment efficacy used in decision making, covering the assumptions and reporting expected of pairwise and network meta-analyses submitted to NICE.
Frequently Asked Questions (6)
What is individual patient data meta-analysis?
A meta-analysis obtaining and analysing original patient-level data from each study, rather than relying only on published summary results.
Source: Stewart & Parmar 1993
What does individual patient data meta-analysis obtain from each study?
Individual patient data meta-analysis obtains the original record for every participant in each included study, rather than the summary figures those studies published. Having the raw patient-level data lets analysts apply consistent definitions across studies, check the original results, and examine how an effect varies with patient characteristics such as age or severity. This depth is what sets it apart, though gathering data from many separate teams is slow and demanding. Working from the raw records is its defining feature. Stewart and Tierney (2002) describe this.
Source: Stewart & Tierney 2002
How does individual patient data meta-analysis work?
Individual patient data meta-analysis works by obtaining the original patient-level datasets from the included studies, checking and standardising them, and analysing them together, either by analysing each study and combining the results or by modelling all the data with appropriate methods that account for the studies. Having the raw data allows consistent outcome definitions, subgroup analyses, and adjustment for patient characteristics. So individual patient data meta-analysis works by collecting and harmonising the raw data across studies and analysing them jointly, using the patient-level information to conduct analyses that are more detailed and consistent than those possible with summary data alone.
Source: Stewart & Parmar 1993
What are the advantages of individual patient data meta-analysis?
The advantages of individual patient data meta-analysis include the ability to standardise outcome definitions and analyses across studies, improving consistency; to examine how effects vary within subgroups and with patient-level characteristics, which summary data cannot support well; to adjust for patient factors; to check the data and update follow-up; and to reduce some reporting biases. These make it more powerful and flexible than aggregate data meta-analysis. So individual patient data meta-analysis is advantageous for the depth, consistency, and flexibility of analysis it allows, particularly for exploring how treatment effects differ among patients, which is why it is often regarded as a gold standard for synthesis.
Source: Stewart & Parmar 1993
What are the challenges of individual patient data meta-analysis?
The challenges of individual patient data meta-analysis include the difficulty and time required to obtain the original datasets from study investigators, who may be unable or unwilling to share them, so that some data may be unavailable, risking bias if the obtained studies are unrepresentative; the effort of checking, harmonising, and analysing the data; and the resources and expertise needed. Data-sharing and confidentiality issues also arise. These challenges mean individual patient data meta-analysis is more demanding and costly than aggregate data meta-analysis, and its feasibility depends on obtaining the raw data, though its analytic advantages often justify the effort where the data can be secured.
Source: Stewart & Parmar 1993
How does individual patient data meta-analysis differ from aggregate data meta-analysis?
Individual patient data meta-analysis obtains and analyses the original patient-level data from each study, while aggregate data meta-analysis combines the summary results reported by each study. The individual patient data approach allows standardised, consistent analysis, examination of subgroups and patient-level effects, and adjustment for patient factors, whereas aggregate data meta-analysis is limited to what is reported and cannot examine patient-level effects directly. However, individual patient data meta-analysis is more demanding, requiring the raw data. So the two differ in the level of data used, with individual patient data offering greater depth and flexibility at the cost of greater effort and feasibility constraints.
Source: Stewart & Parmar 1993
Trust Record
Verified by Dr Darrin Baines
British health economist
Professional identity: darrinbaines.org
Verification date: 23 Sep 2026
Content version: 1.0.0
Canonical Identity
- Term code
- HE-ES-ESM-029
Stable URI · Machine-readable · Resolvable · CC BY 4.0
