Author-reviewedEvidence: highv1.0.0

Cycle

A cycle is a defined time interval during which a discrete-time state-transition model updates health-state occupancy and accumulates relevant outcomes and costs.

Last reviewed byDr Darrin Baines

Concept Architecture

Cycle: Concept Architecture

Follow a model through repeated intervals

A cycle is one defined interval in a discrete-time state-transition model. This page explains how the model updates health states, counts outcomes and costs, and chooses an interval short enough for the events under study.

Define the interval and the people in each state

A cohort model starts a cycle with a specified number or proportion of people in each health state. It then applies transition probabilities for that interval to determine the state distribution at the next boundary. A cycle might last a week, a month, or a year; its duration must match the clinical process and the model's time horizon.

If the row vector sk\mathbf{s}_k gives state occupancy at the beginning of cycle kk and PkP_k is the transition matrix for that interval, the next distribution is:

sk+1=skPk.\mathbf{s}_{k+1}=\mathbf{s}_kP_k.

Each row of PkP_k contains nonnegative probabilities summing to one across mutually exclusive destinations. Time-varying probabilities can be represented by a different matrix for each cycle. A cycle is the time step itself, whereas a health state is a condition occupied during or at a boundary of that step.

See one monthly update

Suppose 100 people begin a month in a stable state. Over that month, the model assigns probabilities of 0.80 to remaining stable, 0.15 to progressing, and 0.05 to dying. At the next boundary, expected occupancy is 80 stable, 15 progressed, and 5 dead.

These are expected cohort counts, not a claim that each individual makes exactly one clinical move. A one-step transition matrix must represent the intended probability of each destination at the cycle boundary; a coarse cycle may hide clinically important sequences, such as progression followed by death within the same month.

Choose a duration that matches the evidence

The interval should be short enough to represent treatment schedules, event timing, changes in risk, and clinically meaningful sequences. It should also be workable for the available data and the model's computational requirements. ISPOR–SMDM state-transition modelling guidance discusses the choice and reporting of cycle length, while methodological work on time in economic evaluation explains why long intervals can introduce approximation error.

Transition probabilities belong to a specified interval and cannot simply be reused for a different duration. Under a constant hazard rr for a single event, the interval probability is p(Δt)=1−e−rΔtp(\Delta t)=1-e^{-r\Delta t}; for a probability p1p_1 observed over duration t1t_1, the corresponding probability over t2t_2 under that same assumption is 1−(1−p1)t2/t11-(1-p_1)^{t_2/t_1}. Competing transitions and multi-state processes require a coherent joint conversion, not separate conversion of every destination probability; research on changing cycle lengths examines the limitations.

Count time, costs, and outcomes within cycles

Occupancy at a boundary is only a snapshot, while quality-adjusted life years and ongoing costs accumulate over time. For a one-month interval, 100 people spending the whole month in a state with utility 0.8 would contribute 100×0.8/12≈6.67100\times0.8/12\approx6.67 undiscounted quality-adjusted life years. Event costs and one-off treatment costs should be assigned at the appropriate time rather than automatically spread over the full cycle.

People may change states between boundaries, so valuing the entire interval from the start or end occupancy alone can misstate time in each state. A half-cycle or other within-cycle correction can approximate accrued outcomes when justified; shorter cycles or continuous-time methods may reduce that approximation error. Within-cycle correction research shows that the choice of correction and interval length can affect estimates.

Check the model's clock

Report the duration, number of cycles, initial time point, transition timing, and how costs, outcomes, discounting, and partial final intervals are handled. These choices determine whether ten annual cycles represent ten years and whether a 28-day cycle has inadvertently been treated as a calendar month.

Test whether plausible shorter intervals change the estimated costs, outcomes, or preferred strategy. If results shift materially, inspect the probability conversion, events occurring within an interval, and within-cycle accumulation before interpreting the difference as clinical evidence. Cycle length is a modelling choice, not a treatment effect or a synonym for the full time horizon.

Library

Publications

1
  • Journal article

    An Introduction to Markov Modelling for Economic Evaluation — Briggs & Sculpher, Vol. 13, No. 4 ed., 1998 (PharmacoEconomics)

    The foundational tutorial paper introducing Markov (state-transition) models for health economic evaluation, covering health states, cycle length, transition probabilities and the calculation of expected costs and outcomes. Widely cited as the standard entry point to Markov modelling.

Frequently Asked Questions (6)

  • What is a cycle in a Markov model?

    A discrete unit of time in a Markov model during which patients may transition between health states, dividing the whole time horizon.

    Source: Sonnenberg FA, Beck JR. Markov models in medical decision making: a practical guide. Medical Decision Making. 1993;13(4):322-338. doi:10.1177/0272989X9301300409.

  • Why does a Markov model advance in cycles rather than continuously?

    A Markov model divides the whole time horizon into equal cycles and updates the cohort only once per cycle, applying the transition probabilities at each step. This discrete stepping suits transition data, which are usually estimated as a probability of moving over a fixed period, and it keeps the calculation to a manageable sequence of updates. The alternative of tracking change at every instant would demand continuous-time methods and rarely adds accuracy worth the complexity. Sonnenberg and Beck (1993) describe this cyclic operation.

    Source: Sonnenberg & Beck 1993

  • What happens during a cycle?

    During a cycle, patients may move between health states according to the transition probabilities, so the distribution of the cohort across states is updated, and the costs and health effects associated with the states occupied are accrued for that period. Transitions are treated as occurring within the cycle, and the state values apply over its duration. At the end of the cycle, the model advances to the next, repeating the process, so each cycle represents one step of the cohort's progression through the model.

    Source: Sonnenberg & Beck 1993

  • How do cycles represent time in a Markov model?

    Cycles represent time in a Markov model by dividing the time horizon into equal discrete periods, with the model advancing one cycle at a time. At each cycle, transitions occur and costs and effects accrue, so the passage of time is represented as a sequence of these steps. The number of cycles times the cycle length equals the horizon. This discrete-time representation, advancing cycle by cycle, is how the Markov model tracks the cohort's changing state and accumulating outcomes over time.

    Source: Sonnenberg & Beck 1993

  • Why is the timing of events within a cycle addressed?

    The timing of events within a cycle is addressed because transitions are usually modelled as occurring at a single point, such as the cycle's start or end, whereas in reality they occur throughout, which can introduce error in the accrual of costs and effects. The half-cycle correction is commonly applied, treating transitions as occurring on average at the middle of the cycle, to reduce this error. Addressing within-cycle timing improves the accuracy of the model, particularly when cycles are long relative to the rate of change.

    Source: Sonnenberg & Beck 1993

  • How does the cycle relate to cycle length?

    The cycle is the discrete time step of a Markov model, and cycle length is the duration that one cycle represents, such as one month or one year. The cycle length determines how finely time is divided and how many cycles span the horizon. A shorter cycle length gives more cycles and finer temporal resolution, while a longer one gives fewer, coarser steps. The cycle is the unit of advance, and its length sets the scale of the time step, so the two are directly linked.

    Source: Sonnenberg & Beck 1993

Trust Record

Verified by Dr Darrin Baines

British health economist

Professional identity: darrinbaines.org

Verification date: 24 Sep 2026

Content version: 1.0.0

Canonical Identity

Term code
HE-EM-MM-004

Stable URI · Machine-readable · Resolvable · CC BY 4.0