William C. Black, MD; John A. Baron, MD  JAMA. 2007;297:995-997.

In this issue of JAMA, Bach et al report their analysis of computed tomographic (CT) screening for lung cancer based on 3 single-arm studies, those from the Instituto Tumori in Milan, Italy, the Mayo Clinic in Rochester, Minn, and the Moffitt Cancer Center in Tampa, Fla. The investigators used a validated lung cancer prediction model to estimate the expected numbers of various lung cancer outcomes among the combined cohort of 3246 participants. To assess the effectiveness of CT screening, they then compared the observed numbers of lung cancer outcomes with the numbers of expected cases. They observed more than a 3-fold increase in the number of new lung cancer cases (144 observed vs 44.5 expected) and a 10-fold increase in lung cancer resections (109 observed vs 10.9 expected). However, there was no decrease in advanced lung cancer cases (42 observed vs 33.4 expected) or in lung cancer deaths (38 observed vs 38.8 expected).

These results follow and are in stark contrast to the recent International Early Action Lung Cancer Program (I-ELCAP),² which reported that low-dose CT screening resulted in a 10-year survival of 88% for patients with stage I disease. The investigators argued that CT screening of high-risk individuals could prevent 80% of lung cancer deaths.

How is it possible that 2 large studies published within 6 months of each other could lead to such dramatically different conclusions about the effectiveness of CT screening? For a cancer that accounts for more deaths than the 4 next most deadly cancers combined, one group of investigators¹ suggests that CT screening will have no effect on mortality, while the other group  suggests that the intervention will reduce mortality by 80%.

Perhaps the best explanation for the contrasting results, however, is the difference in the primary outcome measures of the 2 studies: mortality in the study by Bach et al¹ vs survival in the I-ELCAP study.While these outcome measures are often mistaken to be complementary, prolonged survival in cases need not imply reduced mortality in the population. Case survival can be strongly affected by 3 early detection biases that have no influence on population-based mortality. Lead-time bias occurs when disease is detected earlier but death is not delayed. Because CT screening can detect lung cancer when it is very small, many years of follow-up may be needed to confirm that a death is prevented. Length bias occurs when screening preferentially detects slowly progressive disease. In the Mayo Clinic study, the mean volumetric doubling time of screen-detected lung cancers was 518 days, much longer than that of lung cancers diagnosed before the advent of CT screening, 102 days. In other words, the natural history of small lung cancers detected by CT is unknown. Overdiagnosis occurs when screening detects disease that would not otherwise become clinically evident.Autopsy studies document that inconsequential lung cancers are not rare   and CT screening is much more sensitive than autopsy.In a large Japanese study,CT screening detected lung cancer in the same proportion of nonsmokers as smokers, suggesting that many of the screen-detected cancers were not clinically significant. That prolonged survival need not imply reduced mortality also is demonstrated in the study by Bach et al, which found a remarkably high 4-year survival (94%) among clinical stage I lung cancer patients undergoing surgery despite no demonstration of reduction in lung cancer mortality.

Because of the presence of a simulated control group, the measurement of mortality, and the completeness of the outcome ascertainment, the study by Bach et al¹ more directly addresses the population effect of CT screening than does the I-ELCAP study. The study by Bach et al also provides insight into the potential harms of CT screening. A 3-fold increase in lung cancer diagnosis and a 10-fold increase in lung cancer surgery represent substantial psychological and physical burdens. Although the I-ELCAP investigators reported a surgical mortality rate of only 0.5%, Bach et al point out that the average surgical mortality rate across the United States is 5%, and the frequency of serious complications is greater than 20%. These potential harms of CT screening mandate that its effectiveness be accurately assessed.

As Bach et al¹ acknowledge, formulation of screening policy should await the rigorous assessment that will be provided by ongoing randomized controlled trials (the National Lung Screening Trial   and the NELSON Trial. Randomized controlled trials are the most reliable method for obtaining accurate assessments of the benefits and harms of screening in the underlying population. With this design, differences in outcome can be attributed to the intervention without reliance on highly modeled analyses with problematic assumptions. Although expensive and time-consuming, rigorous trials of cancer screening are far more cost-effective than what might be the alternative—widespread adoption of costly screening interventions that cause more harm than good.