Antibody surveys may be unreliable

They don’t justify easing controls, observers warn

Surveying large swaths of the public for antibodies to the new coronavirus promises to show how widespread undiagnosed infections are, how deadly the virus really is, and whether enough of the population has become immune for social distancing measures to be eased. But the first batch of results has generated more controversy than clarity.

The survey results, from Germany, the Netherlands, and several locations in the United States, find that anywhere from 2% to 30% of certain populations have already been infected with the virus. The numbers imply that confirmed COVID-19 cases are an even smaller fraction of the true number of people infected than many had estimated and that the vast majority of infections are mild. But many scientists question the accuracy of the antibody tests and complain that several of the research groups announced their findings in the press rather than in preprints or published papers, where their data could be scrutinized. Critics are also wary because some of the researchers are on record advocating for an early end to lockdowns and other control measures, and claim the new prevalence figures support that call.

Some observers warn the coronavirus’ march through the population has only just begun, and that even if the antibody results can be believed, they don’t justify easing controls. “You would have hoped for 45% or even 60% positive,” says Mark Perkins, a diagnostics expert at the World Health Organization. “That would mean that there is lots of silent transmission, and a lot of immunity in the population. It now looks like, sadly, that’s not true. Even the high numbers are relatively small.”

The many different academic and commercial tests for coronavirus antibodies are still being refined and validated. They can show whether someone’s immune system has encountered the virus. But because no one knows what level of antibodies, if any, confers protection against the new virus, the tests can’t tell whether a person is immune to a future infection. And no one knows how long such immunity might last.

A German antibody survey was the first out of the gate several weeks ago. At a press conference on 9 April, virologist Hendrik Streeck from the University of Bonn announced preliminary results from a town of about 12,500 in Heinsberg, a region in Germany that had been hit hard by COVID-19. He told reporters his team had found antibodies to the virus in 14% of the 500 people tested. By comparing that number with the recorded deaths in the town, the study suggested the virus kills only 0.37% of the people infected. (The rate for seasonal influenza is about 0.1%.) The team concluded in a two-page summary that “15% of the population can no longer be infected with SARS-CoV-2, and the process of reaching herd immunity is already underway.” They recommended that politicians start to lift some of the regions’ restrictions.

Streeck had argued even before the study that the virus is less serious than feared and that the effects of long shutdowns may be just as bad if not worse than the damage the virus could do. However, Christian Drosten, a virologist at Charite University Hospital in Berlin, told reporters later that day that no meaningful conclusions could be drawn from the antibody study based on the limited information Streeck presented. Drosten cited uncertainty about what level of antibodies provides protection and noted that the study sampled entire households. That can lead to overestimating infections, because people living together often infect each other.

Streeck and his colleagues claimed the commercial antibody test they used has “more than 99% specificity,” but a Danish group found the test produced three false positives in a sample of 82 controls, for a specificity of only 96%. That means that in the Heinsberg sample of 500, the test could have produced more than a dozen false positives out of roughly 70 the team found.

A California serology study of 3300 people released last week in a preprint also drew strong criticisms. The lead authors of the study, Jay Bhattacharya and Eran Bendavid, who study health policy at Stanford University, worked with colleagues to recruit the residents of Santa Clara county through ads on Facebook. Fifty antibody tests were positive—about 1.5%. But after adjusting the statistics to better reflect the county’s demographics, the researchers concluded that between 2.49% and 4.16% of the county’s residents had likely been infected. That suggests, they say, that the real number of infections was as many as 80,000. That’s more than 50 times as many as viral gene tests had confirmed and implies a low fatality rate—a reason to consider whether strict lockdowns are worthwhile, argue Bendavid and co-author John Ioannidis, who studies public health at Stanford.

Another serology study, in the Netherlands, produced a similar figure for antibody prevalence that was revealed in the country’s House of Representatives on 16 April. Hans Zaaijer, a virologist at Sanquin, the Dutch national blood bank, who helped lead the study, says the team used a commercial test, which “consistently shows superior results” in validation studies, but didn’t provide more details. The results made it clear that the country was not yet near the “herd immunity” that some had hoped for. Nevertheless, the government said on 21 April that it would start to lift some restrictions in the coming weeks, opening elementary schools and allowing children’s sports teams to practice. (abridged)

Gretchen Vogel is a contributing correspondent for Science magazine based in Berlin, Germany. The article was originally published by Science.

Similar articles