VerifiedEvidence: highv1.0.0

Node-Splitting

A technique testing for inconsistency in a network meta-analysis by separately estimating direct and indirect evidence for one comparison and comparing them.

Last reviewedDarrin Baines IP Ltd

Concept Architecture

Concept

Theoretically, Node-Splitting is a statistical method used in network meta-analysis to evaluate the consistency between direct and indirect evidence for a specific treatment comparison. It separates, or "splits", the evidence contributing to a comparison into its direct and indirect components and formally tests whether the two sources of evidence estimate the same underlying treatment effect. The method exists to identify local inconsistency within a treatment network and assess the validity of network meta-analysis assumptions.

Mathematically, node-splitting estimates separate treatment effects from direct evidence and indirect evidence before comparing them statistically. The inconsistency parameter is defined as the difference between these two estimates and is evaluated using hypothesis testing or credible intervals. Bayesian implementations commonly assess whether the posterior distribution of the inconsistency parameter includes zero, whereas frequentist approaches perform an equivalent statistical test.

In practice, node-splitting is routinely applied during network meta-analysis to identify treatment comparisons where direct and indirect evidence disagree. It is widely used in health technology assessment and comparative effectiveness research to assess the robustness of treatment networks before comparative effectiveness estimates are incorporated into economic evaluation and reimbursement models.


Purpose

Used to assess local consistency within a network meta-analysis by comparing direct and indirect evidence for individual treatment comparisons.


Mathematical Formulae

Primary Formula

Inconsistency parameter:

� = dDirect ? dIndirect

where:

  • � = inconsistency estimate
  • dDirect = treatment effect estimated from direct evidence
  • dIndirect = treatment effect estimated from indirect evidence

Hypothesis:

H?: � = 0

Supporting Formulae

Variance of inconsistency estimate:

Var(�) = Var(dDirect) + Var(dIndirect)

Standard error:

SE(�) = �Var(�)

95% confidence interval:

� � 1.96 ? SE(�)

Related Mathematical Methods

  • Network Meta-Analysis
  • Mixed Treatment Comparison
  • Consistency Assessment
  • Inconsistency Models
  • Bayesian Meta-Analysis
  • Frequentist Meta-Analysis
  • Indirect Comparison

Example

A network meta-analysis compares five biologic therapies for rheumatoid arthritis. For the comparison between Treatments A and B, the direct evidence estimates a log odds ratio of ?0.35, while the indirect evidence estimates ?0.11. Node-splitting estimates an inconsistency parameter of ?0.24. Because the corresponding statistical test is significant, inconsistency between the direct and indirect evidence is identified, prompting further investigation of study characteristics and network assumptions.


Excel Implementation

FunctionExample FormulaHealth Economics Application
ABS=ABS(A2-B2)Calculate the absolute difference between direct and indirect estimates
SQRT=SQRT(C2+D2)Calculate the standard error of the inconsistency estimate
NORM.S.DIST=NORM.S.DIST(E2,TRUE)Calculate p-values from the standard normal distribution
IF=IF(F2<0.05,"Potential inconsistency","Consistent")Flag statistically significant inconsistency

VBA (Optional)

Automate node-splitting analyses across all treatment comparisons within a network and generate inconsistency reports for health technology assessment submissions.


Sources

  • Dias S, Welton NJ, Caldwell DM, Ades AE. Checking Consistency in Mixed Treatment Comparison Meta-Analysis. Statistics in Medicine. 2010.
  • van Valkenhoef G, Dias S, Ades AE, Welton NJ. Automated Generation of Node-Splitting Models for Assessment of Inconsistency in Network Meta-Analysis. Research Synthesis Methods. 2016.
  • Chaimani A, Caldwell DM, Li T, et al. Chapter 11: Undertaking Network Meta-Analyses. Cochrane Handbook for Systematic Reviews of Interventions.
  • NICE. Health Technology Evaluation Manual.
  • ISPOR Good Practice Task Force Report on Network Meta-Analysis.

Library

Publications

4
  • BookFeatured

    Network Meta-Analysis for Decision Making — Dias, Ades, Welton, Jansen & Sutton, 1st Edition ed., 2018 (John Wiley & Sons)

    The definitive text on network meta-analysis (mixed treatment comparisons) for decision making, presenting a coherent Bayesian framework (implemented in WinBUGS) for synthesising evidence across multiple treatments, including inconsistency, bias adjustment, and use in cost-effectiveness models.

  • Guidance

    NICE DSU Technical Support Document 1: Introduction to Evidence Synthesis for Decision Making — Dias, Welton, Sutton & Ades, TSD 1 ed., 2011 (NICE Decision Support Unit (University of Sheffield))

    The introductory document of the NICE DSU evidence-synthesis series, setting out the overall analytic approach — separating baseline (natural history) and relative treatment-effect models — for synthesising evidence to inform cost-effectiveness decisions.

  • Guidance

    NICE DSU Technical Support Document 5: Evidence Synthesis in the Baseline Natural History Model — Dias, Welton, Sutton & Ades, TSD 5 ed., 2011 (NICE Decision Support Unit (University of Sheffield))

    Guidance on synthesising evidence for the baseline (natural history) component of a decision model — the absolute event rates under a standard comparator — separately from relative treatment effects.

  • Guidance

    NICE DSU Technical Support Document 25: Evidence Synthesis of Diagnostic Test Accuracy for Decision Making — Dias, Ren, Bujkiewicz, et al., TSD 25 ed., 2024 (NICE Decision Support Unit (University of Sheffield))

    Guidance on synthesising diagnostic test accuracy evidence (sensitivity and specificity) for use in decision models, including bivariate and hierarchical meta-analysis methods.

Frequently Asked Questions (6)

  • What is node-splitting?

    A technique testing for inconsistency in a network meta-analysis by separately estimating direct and indirect evidence for one comparison and comparing them.

    Source: Dias, Welton, Caldwell & Ades 2010

  • How does node-splitting test one comparison for inconsistency?

    Node-splitting tests a single comparison in a network by separating its two sources of evidence, estimating the direct result from the head-to-head trials on its own and the indirect result from the rest of the network, then checking whether the two agree. A large gap between them signals inconsistency at that point, localising the conflict to a specific comparison rather than the network as a whole. This pinpointing is what makes it useful for diagnosing where a network breaks down. Splitting direct from indirect at one node is its method. Dias and colleagues (2013) describe this.

    Source: Dias et al. 2013

  • How does node-splitting work?

    Node-splitting works by, for a chosen comparison, separating the direct evidence, from trials directly comparing the two treatments, from the indirect evidence, from the rest of the network, estimating each separately, and testing whether they differ beyond chance. A significant difference indicates inconsistency for that comparison. This is repeated for comparisons where both direct and indirect evidence exist. So node-splitting works by dividing the evidence at a node, or comparison, into its direct and indirect parts, estimating them independently, and comparing them, providing a test of consistency localised to individual comparisons within the network.

    Source: Dias, Welton, Caldwell & Ades 2010

  • Why is node-splitting used?

    Node-splitting is used to check the consistency assumption of network meta-analysis at the level of individual comparisons, identifying where direct and indirect evidence disagree, which signals inconsistency and possible problems with the network's validity. Because network meta-analysis relies on direct and indirect evidence agreeing, detecting where they conflict is important for trusting the results. Node-splitting locates inconsistency at specific comparisons rather than only globally. So node-splitting is used to assess and localise inconsistency in a network meta-analysis, helping determine whether the combined evidence is coherent and where any disagreement between direct and indirect evidence lies.

    Source: Dias et al. 2013

  • What does node-splitting reveal?

    Node-splitting reveals whether the direct and indirect evidence for a particular comparison agree or disagree, and thus whether inconsistency is present at that comparison. A close agreement supports consistency, while a significant discrepancy indicates local inconsistency, suggesting that the trials providing direct and indirect evidence differ in ways that violate transitivity. Applied across comparisons, it shows where in the network inconsistency arises. So node-splitting reveals the presence and location of inconsistency by comparing direct and indirect estimates at specific comparisons, helping to identify which parts of the network may be unreliable and to guide interpretation and investigation.

    Source: Dias, Welton, Caldwell & Ades 2010

  • What are the limitations of node-splitting?

    The limitations of node-splitting include low power to detect inconsistency when the direct or indirect evidence is sparse, so real inconsistency may be missed; the need for both direct and indirect evidence to exist for a comparison, limiting where it can be applied; and the multiple comparisons involved when testing many nodes, which can produce chance findings. It assesses local inconsistency and complements global methods. So node-splitting is interpreted with awareness of its limited power and the multiplicity of tests, used alongside other consistency assessments, and its results treated as indicating possible inconsistency to be investigated rather than as definitive.

    Source: Dias, Welton, Caldwell & Ades 2010

Trust Record

Verified by Dr Darrin Baines

British health economist

Professional identity: darrinbaines.org

Verification date: 3 Dec 2025

Content version: 1.0.0

Canonical Identity

Term code
HE-ES-ESM-042

Stable URI · Machine-readable · Resolvable · CC BY 4.0