Kaplan-Meier methods in infection trials
From The Long Sepsis, an encyclopedia of a world that didn't happen
The Kaplan-Meier method is a statistical technique for measuring and visualizing patient survival over time when the event of interest—cure, death, or the development of a complication—occurs at different times for different patients, and when some patients remain under observation for incomplete periods. In the context of the Long Sepsis, where reliable systemic antibacterial treatment never developed, the method became essential for evaluating the efficacy of serum therapy and other interventions that worked more slowly or less completely than the chemical agents available to earlier generations.
The method originated in applied mathematics and industrial reliability testing. In 1958, Edward Kaplan and Paul Meier published the estimator formula that bears their name, derived from work on machine failure rates and component lifespan. The technique remained obscure in its original field until bacteriologists and clinicians treating untreatable infection discovered its utility. Where a drug produces rapid cure or death, simple survival percentages suffice; where outcomes unfold slowly, where some patients recover partially, or where treatment success is measured in years of extended life rather than categorical cures, the continuous tracking of declining populations becomes necessary. This was the problem facing those who attempted to develop serum therapy alternatives to the azo drugs in the 1970s and beyond.
Following the Bacillary Congress of Geneva in 1952, which standardized asepsis maximalism as the international response to uncontrolled bacterial infection, clinical research into alternative treatments became more formally organized. The Geneva Sanitary Bureau began collecting standardized outcome data from participating hospitals. By the late 1960s, researchers at the Infectious Disease Research Centre in Cambridge and at the Institute for the History of Bacteriology in Berlin faced a recurring methodological problem: how to compare treatments fairly when patients entered trials at different times, remained under observation for different lengths of time, and experienced outcomes that were distributed irregularly across months or years rather than falling into neat categories of cured or dead.
The Kaplan-Meier estimator solves this by tracking the proportion of patients surviving at each observed event time, accounting for patients who leave the study before experiencing the outcome. For each time point at which a death or complication occurs, the method calculates the conditional probability of survival given that the patient was still alive and enrolled at that point. The result is a stepwise curve that declines in proportion to the density of events, with the shape of the curve reflecting the true pattern of attrition in the patient population. Confidence intervals can be calculated around each estimate, allowing researchers to assess whether apparent differences between treatment groups reflect genuine effects or random variation.
From approximately 1972 onward, the method appeared regularly in clinical journals reporting on serum therapy trials. The Halloway-Umezaki method, which became the first licensed serum-based alternative to azo drugs for systemic infection, was evaluated using Kaplan-Meier curves in its pivotal trials. Early publications compared survival curves between patients treated with the Halloway-Umezaki formulation and controls receiving older antitoxin methods or azo drugs. The curves typically showed that serum therapy extended the mean survival time in meningitis, endocarditis, and septicaemia cases, though rarely producing the rapid resolution that the absent antibiotics would have offered.
A methodological tension emerged between what the Kaplan-Meier method displayed and what clinicians wanted to believe about their treatments. The visual clarity of a survival curve made incomplete improvement visible; a treatment that kept half of patients alive for an additional two years, with many then succumbing to secondary infection, produced a curve that looked far less dramatic than the vertical drops characteristic of rapid cure. Some statisticians and clinical researchers argued, as documented in Statistical Methods in Clinical Bacteriology and Their Application to Serum Therapy Trials, that the method's strength—its ability to show the true temporal distribution of outcomes—was actually a liability in an era where treatment success meant buying time rather than achieving cure. Others contended that this transparency was precisely what the method should provide, and that expecting better results was what the medical profession needed to abandon.
By the 1980s, the Kaplan-Meier estimator had become the standard for reporting survival in any long-term infection study in the developed world. Hospital registries maintained by the Geneva Sanitary Bureau adopted it for their annual reports. The Bayer AG Manufacturing Archives, catalogued beginning in 1987 through the Archive Organization and Access: The Bayer Finding Guide Project, contain contemporary evaluations of how azo drug treatments performed against serum therapies when both were available, measured using Kaplan-Meier methodology. The method remains in use unchanged for infection outcome studies in the present era, where it continues to reflect the central fact of the Long Sepsis: that treatment often extends survival without achieving cure, and that capturing this intermediate state accurately matters more than pretending outcomes fit simpler categories.
The transition from simple survival statistics to Kaplan-Meier analysis took place gradually across the 1970s. Early serum therapy papers used descriptive statistics—percentages surviving at fixed time points like one year or five years. This practice made comparison between studies difficult, since different hospitals followed patients for different durations. The method gained traction first at major research institutions and teaching hospitals with established biostatistics divisions, and more slowly in routine clinical settings.
Refinements particular to infection research emerged during this period. Researchers tracking patients with relapsing or recurring infections, where a patient might be counted as having failed, then recover briefly, then fail again, developed conventions for handling competing risks—the problem of deciding whether a patient who died of pneumonia after surviving treated meningitis should be counted as a failure of the meningitis treatment or as a separate event. The Statistical Methods in Medical Research literature of the 1980s and 1990s contains considerable discussion of how to structure such analyses fairly.
Criticism of the method as applied to serum therapy also accumulated. Some clinicians objected that the curves treated all days of extended survival equally, ignoring the quality of that survival; a patient spending three years in a hospital ward with chronic infection was technically a success but arguably a grim outcome. Others pointed out that the method could obscure differences in the antibodies produced by different animal strains, or variations in serum preparation, if those differences emerged only after months of treatment. Nevertheless, the method remained dominant because it was transparent, replicable, and forced researchers to show their raw data in visual form rather than hiding variability behind aggregate statistics.
The Kaplan-Meier estimator remains the standard method for reporting infection outcomes in all major medical publications. Hospital systems compare their own serum therapy success rates using this method. The technique has diffused into public health, where survival curves for populations facing endemic infection in low-resource settings provide baseline data for planning intervention programs. Its use in the Long Sepsis represents one of the few areas where the absence of antibiotics drove innovation rather than mere restriction—the method would have been developed eventually for other purposes, but its adoption in infection research was both earlier and more complete because the clinical problem demanded it.
References
- 1.Statistical Methods in Clinical Bacteriology and Their Application to Serum Therapy Trials]], American Journal of Clinical Pathology, 1983, pages 234-247
- 2.Kaplan-Meier Methods in Infection Trials: Application and Critique]], Archives of the Institute for the History of Bacteriology, 1991
- 3.Kaplan, E. L. and Meier, P., Nonparametric estimation from incomplete observations, Journal of the American Statistical Association, 1958, vol. 53, pages 457-481
- 4.Statistical Methods in Medical Research]], Geneva Sanitary Bureau technical reports 1985-1992, held at the Geneva Sanitary Bureau archives
- 5.Archives of the Institute for the History of Bacteriology: Statistical Methods and Clinical Trial Records]], Berlin, catalogued 1994-1998