Skip to main content

Geographic and demographic heterogeneity of SARS-CoV-2 diagnostic testing in Illinois, USA, March to December 2020

Abstract

Background

Availability of SARS-CoV-2 testing in the United States (U.S.) has fluctuated through the course of the COVID-19 pandemic, including in the U.S. state of Illinois. Despite substantial ramp-up in test volume, access to SARS-CoV-2 testing remains limited, heterogeneous, and insufficient to control spread.

Methods

We compared SARS-CoV-2 testing rates across geographic regions, over time, and by demographic characteristics (i.e., age and racial/ethnic groups) in Illinois during March through December 2020. We compared age-matched case fatality ratios and infection fatality ratios through time to estimate the fraction of SARS-CoV-2 infections that have been detected through diagnostic testing.

Results

By the end of 2020, initial geographic differences in testing rates had closed substantially. Case fatality ratios were higher in non-Hispanic Black and Hispanic/Latino populations in Illinois relative to non-Hispanic White populations, suggesting that tests were insufficient to accurately capture the true burden of COVID-19 disease in the minority populations during the initial epidemic wave. While testing disparities decreased during 2020, Hispanic/Latino populations consistently remained the least tested at 1.87 tests per 1000 population per day compared with 2.58 and 2.87 for non-Hispanic Black and non-Hispanic White populations, respectively, at the end of 2020. Despite a large expansion in testing since the beginning of the first wave of the epidemic, we estimated that over half (50–80%) of all SARS-CoV-2 infections were not detected by diagnostic testing and continued to evade surveillance.

Conclusions

Systematic methods for identifying relatively under-tested geographic regions and demographic groups may enable policymakers to regularly monitor and evaluate the shifting landscape of diagnostic testing, allowing officials to prioritize allocation of testing resources to reduce disparities in COVID-19 burden and eventually reduce SARS-CoV-2 transmission.

Peer Review reports

Background

As of December 2020, more than 95 million cases of SARS-CoV-2 infection had been detected globally in more than 190 different countries and territories [1]. Yet, those 95 million cases were estimated to be a small fraction of all SARS-CoV-2 infections, with the true number of infections likely to be at least an order of magnitude higher [2]. The United States (U.S.) has been hit hard by COVID-19, and limited access to diagnostic tests early in the pandemic likely contributed to substantial community spread prior to the implementation of stay-at-home policies [3]. While testing in the U.S. expanded enormously after March 2020, access to testing remained uneven: per capita testing rates varied regionally and across multiple sociodemographic factors. Within a state, some testing sites ran out of reagents by mid-week, while in other areas, employers and universities were implementing routine mass testing [4, 5].

SARS-CoV-2 diagnostic testing is considered a cornerstone for containing the virus. Testing informs surveillance, which guides evidence-based decision-making on hospital resource planning, implementation and relaxation of mitigation measures, and allocation of public health resources. Testing is also a means to control virus spread. Individuals who test positive are more likely to self-isolate, reducing onward transmission [6]. When testing is insufficient, surveillance quality suffers, and infectious individuals may not adequately self-isolate. Understanding fine-scale heterogeneity in testing and changes over time is essential for understanding where additional resources should be directed.

The state of Illinois, with 12.7 million residents, is the sixth most populous state in the U.S. and is largely demographically representative of the country. Illinois’s age structure matches that of the US, and the percent of residents identifying as Hispanic, non-Hispanic Black/White/Asian/Native American/Other, or more than one race are each within 2% of national estimates [7]. Median household income is 5% higher in Illinois than nationally and percent living in poverty is slightly higher (11.5% in Illinois, 10.5% nationally). Mean household size, 2.6, is the same in Illinois as nationally.

Illinois also has high levels of residential segregation and income inequality [8, 9]. Illinois contains a major urban center in the northeast, the city of Chicago (Illinois COVID-19 Region 11), with surrounding suburban counties (Fig. 1a). Another urban center is in the southwest (Region 4) adjacent to the city of St. Louis in the neighboring state of Missouri. The remainder of the state is primarily rural. Using aggregate testing data from the Illinois Department of Public Health (IDPH), census data, and individual-level case and death data from IDPH, we characterized testing rates across different regions of the state, across age groups, between racial and ethnic groups, and over time. Since infections are only identified as cases upon positive diagnostic test, we assessed whether case fatality ratios (CFR) might serve as a crude indicator for under-testing in the absence of other information and estimated the fraction of all SARS-CoV-2 infections that have been detected in Illinois.

Fig. 1
figure 1

Spatial distribution of and access to COVID-19 diagnostic testing sites in Illinois. a State-designated COVID-19 regions (numbered) and super-regions (colored) of Illinois. Testing sites listed on IDPH’s website on October 26, 2020, are shown in transparent black. b Travel time to nearest Illinois testing site location at 1 km × 1 km spatial resolution, with COVID-19 region boundaries shown in black. c Cumulative distribution of population living within a certain travel time of an Illinois testing site by COVID-19 region. Travel times to Illinois testing site locations on October 26, 2020 were aggregated for each census block group taking the mean of raster points falling within that census block group

Methods

Case definition

This work defines cases as SARS-CoV-2 infections recorded in Illinois surveillance as a result of a positive diagnostic test, regardless of symptom status.

Datasets

County-level positive tests and total tests were obtained from the Illinois National Electronic Disease Surveillance System (I-NEDSS) database maintained by IDPH. Daily testing volume data included 12,746,960 total specimens and 1,131,284 positive specimens recorded from March 17, 2020, to December 31, 2020, stratified by age, county of test, and race/ethnicity. Moving averages of daily testing volume were calculated on a seven-day lagging window. Until October 14, 2020, only molecular tests (reverse transcriptase polymerase chain reaction [RT-PCR] tests) were reported in this dataset. On October 14, 2020, IDPH began reporting antigen tests in this dataset. All SARS-CoV-2 diagnostic tests conducted in Illinois, including routine tests carried out by universities and congregate living facilities, were included in the dataset. Testing site locations were scraped from the IDPH website on April 23, June 15, and October 26, 2020.

Individual-level case data, including date of first positive specimen, patient’s home ZIP code, race, ethnicity, hospital admission status, and date of death, were obtained from I-NEDSS. Data were pulled on March 16, 2021, and included 1,098,549 cases reported to IDPH, 907,799 of which had specimen collection dates in 2020. Among all cases that had a date of death in I-NEDSS, 18,830 were designated as having died due to COVID-19 and were considered confirmed deaths. Cases classified as died from COVID-19 met at least one of the following criteria: presence of COVID-19 on the death certificate; death within 30 days of symptom onset/diagnosis or during hospitalization, unless the cause of death is clearly unrelated to COVID-19 (e.g. accident); never returned to baseline health after diagnosis; autopsy result consistent with COVID-19. Individuals with date of first positive specimen on or before December 31, 2020, whose deaths were confirmed in I-NEDSS after March 16, 2021, would not be included in this death tally.

In the case data, individuals were assigned to a region based on the county of symptom onset, and secondarily on listed ZIP of residence if county of onset was not available. To estimate under-reporting rates, a naïve (crude) CFR was calculated as cumulative deaths divided by cumulative cases. Counties were aggregated into COVID-19 Regions as defined by IDPH specifically for the COVID-19 response [10] and into super-regions as follows: COVID-19 Regions 1 and 2 into North Central super-region; 3 and 6 into Central super-region; 4 and 5 into Southern super-region; and 7–11 into Northeast (Fig. 1a). County populations were obtained from the 2018 American Community Survey (ACS) [7].

Self-reported race or ethnicity were available for 657,219 (72.4%) individual cases reported to IDPH and were missing for the remainder. Cases with multiple races reported were categorized as “Other”. All individuals with Hispanic/Latino as ethnicity were categorized as Hispanic/Latino regardless of race(s). Individuals with “unknown” ethnicity or no reported ethnicity were considered non-Hispanic/Latino. For brevity, non-Hispanic Asian, non-Hispanic Black, and non-Hispanic White populations are referred to as Asian, Black, and White, respectively.

In the testing dataset, race or ethnicity was recorded for 7,143,108 total specimens (56.0%) and 652,643 positive specimens (57.7%) using a single variable indicating either a non-Hispanic race or Hispanic-Latino ethnicity.

Measuring travel time to nearest testing site

We used testing site locations as listed on IDPH’s website as sites open to the public on April 23, June 15, and October 26, 2020. We computed the travel time in minutes to nearest testing site location using a friction surface of land-based vehicle travel time for a nominal year 2019 at 1 km × 1 km spatial resolution [11], downloaded via the malariaAtlas R package [12]. To create a cumulative distribution of travel time over a region’s population, we used the estimated population of each census block group (2016 ACS obtained via Safegraph) and aggregated travel time for each census block group by taking the mean travel time for pixels falling within the boundaries of that census block group. Census block groups were assigned to COVID-19 regions by whether a census block group’s centroid fell within the boundaries of a COVID-19 region. The IDPH list of testing sites was not comprehensive, as some testing sites asked not to be listed, and data on the number and location of all sites offering testing were not available.

Estimation of infection detection rate

To estimate the fraction of infections detected in a particular week (finf det), the expected infection fatality ratio (IFR) among cases with new positive specimens collected during that week was calculated based upon these cases’ age distribution using either (i) the exponential meta-regression performed by Levin et al. [13], which used first-wave data from multiple countries; or (ii) estimates from O’Driscoll et al. [14], which uses an ensemble model incorporating data from multiple countries to infer age-specific infection mortality rates. Infection fatality ratio is the fraction of all SARS-CoV-2 infections that result in death. The results of the meta-regression of Levin et al. [11], with associated uncertainties for each coefficient, are reproduced below:

$$ {\log}_{10}(IFR)\kern0.5em =\kern0.5em \left(-5.27\pm 0.07\right)+\left(0.0524\pm 0.0013\right)\ast age\kern0.5em $$

Due to the fact that, at any given time, the age distribution of cases (i.e. detected infections) was not necessarily representative of the age distribution of all incident infections, only cases 61–70 years of age were included in this analysis. This age range was selected for its large number of cases with confirmed COVID-19 deaths (> 12 every week of specimen collection except for the week of March 8th, 2020, the first week in which a fatal case was documented in ages 61–70 years) while being less likely than older age groups (> 70 years) to be associated with the less representative transmission and testing conditions in long-term care facilities. For our estimates using IFR from O’Driscoll et al. [14], IFR was uniformly sampled from 0.39–1.24% for ages 61–70 years, which was obtained by combining IFR of 0.46% (95% CI: 0.39–0.57%) for ages 60–64 years and 1.08% (95% CI: 0.92–1.24%) for ages 65–69 years.

First, a naive (crude) estimate of finf det was made by dividing the expected IFR by the reported CFR among that week’s cases. To account for a decreasing IFR due to improved clinical outcomes among the infected over the course of the pandemic, a second estimate was made by adjusting the expected IFR down by the relative decrease in a sigmoid curve fitted to the hospital fatality ratio (HFR) over time among people aged 61–70 years. HFR was calculated from I-NEDSS data as fraction of admitted cases that were later recorded as a death due to COVID-19. This sigmoid curve was fitted to weekly HFR with a non-linear least squares regression.

To account for unreported deaths, a third estimate was made in which the adjusted IFR was divided by the CFR, then multiplied by the estimated fraction of all COVID-19 deaths that were reported as COVID-19 deaths (fdeath det) on the median date of death among that week’s cases. To estimate fdeath det, we compared observed counts of COVID-19 deaths to excess deaths in select-cause mortality data (Figure S1). Select-cause mortality data provided by the National Center for Health Statistics (NCHS), including respiratory diseases and circulatory diseases among others, showed the expected weekly count of deaths by a selection of comorbid conditions of COVID-19 alongside the reported counts of deaths by these causes that occurred in the state in 2020 [15]. Excess select-cause deaths are calculated as the difference between the expected weekly select-cause death curve and the actual weekly select-cause death curve. Assuming that all excess select-cause deaths were attributable to COVID-19 and that the epidemic did not appreciably reduce deaths indirectly due to other causes in the list of select causes curated by NCHS, we calculated fdeath det by dividing the observed number of COVID-19 deaths each week (from I-NEDSS) by the excess select-cause deaths in the same week. To account for uncertainty in our estimate of fdeath det, we then sampled 1000 realizations of excess deaths using a Skellam distribution, which models the difference between two Poisson random variables, and recalculated fdeath det for each realization.

These three estimates were made from the week of March 8th to the week of December 27th, with 1000 bootstrapped samples taken on a weekly basis from estimates of CFR for cases in a given week, expected IFR, the prediction band of the sigmoid curve fitted to HFR, and the estimates of fdeath det to generate a range of estimates for finf det. For cases in a given week, estimates of fdeath det were drawn from the week of the median death date of that week’s cases. All infection detection estimates, as well as HFR and fdeath det, were conducted at the statewide level.

Results

Spatio-temporal variation in testing and access to testing in Illinois

As of December 31, 2020, more than 900,000 SARS-CoV-2 cases and 18,000 COVID-19 deaths were recorded in Illinois (Fig. 2) [16]. The first wave of COVID-19 peaked in early May in the Northeast and Southern super-regions and in mid- to late-May in the Central and North-Central super-regions. COVID-19 Regions 1 and 7–11 experienced the bulk of the first-wave cases and deaths, and Regions 11 (city of Chicago) and 10 (suburban Cook County) recorded the highest peaks in daily detected cases during this time. By August 2020, daily detected cases in Regions 2, 3, 4, 5, and 6 had surpassed their peak numbers in May. By October 2020, all COVID-19 regions were experiencing a second wave of hospitalizations and deaths.

Fig. 2
figure 2

Epidemic trajectory of COVID-19 cases in the 11 COVID-19 regions of Illinois in 2020

Reflecting both population density and the regional differences in initial burden of COVID-19, the majority of testing sites were located in the Northeast super-region (64.7% of Illinois testing sites on October 26, 2020), and many were in Regions 10 and 11 (42.1% of Illinois testing sites on October 26, 2020) (Fig. 1a). Although the number of diagnostic testing sites in the state has nearly quadrupled since April (Fig. 1b), most new testing sites between June and October were established in the Northeast super-region. Under 50% of individuals in Regions 3, 4, and 6 resided within 10 min’ drive of the nearest testing site (Fig. 1b and c). This travel time is not necessarily reflective of the time any given individual in an area would require to travel or would travel to receive a test. Many test sites restricted testing to symptomatic individuals, close contacts, or in-network patients in terms of referrals or insurance plans, but testing criteria data were not sufficiently available or reliable to assess access to unrestricted testing. Moreover, these restrictions were subject to continuous change as the availability of resources at individual sites fluctuated. Conversely, individuals in border areas could seek testing across state lines. This metric also does not account for regional differences in mode of travel.

Although testing was limited in all COVID-19 regions during the first wave, testing volume expanded 5- to 10-fold between early May and the end of December (Fig. 3). Controlling for population size, the overall testing rate was highest in Regions 10 and 11 during the early outbreak in March to June 2020. Some regions (particularly Regions 1 and 6) that were slower to increase testing in the first wave outpaced other regions in testing intensity by late October due to prioritization of the deployment of mobile teams to areas of greatest impact (meat processing plants, low-income housing areas, etc.) and establishment of community drive through testing sites where none previously existed. In November and December there was a concerted increase in testing in all Regions, with Region 3 achieving the highest testing rates in the state, before a decrease around Christmas.

Fig. 3
figure 3

Daily SARS-CoV-2 diagnostic tests administered per 1000 population in each COVID-19 region in Illinois in 2020. Shown: 7-day moving averages. Colors indicate super-region membership of each COVID-19 region, as indicated in Fig. 1a

In Region 6, overall testing intensity was dominated by the University of Illinois at Urbana-Champaign (UIUC) due to their efforts to conduct mass testing on their entire campus population [5] (Fig. 3 Region 6 with and without Champaign County, Fig. 4a). However, outside of Champaign County, the remainder of Region 6 contained some of the lowest per-capita testing in Illinois, reflecting the substantial portion of Region 6 residents who resided more than 10 miles from a testing site (Fig. 1c). There was considerable county-level heterogeneity in testing intensity within Regions 1–6, varying as much as 4-fold within the same Region even excluding Champaign County (Fig. 4a). Positive tests per capita also varied within Regions 1–6 (Fig. 4b).

Fig. 4
figure 4

a County-level average daily SARS-CoV-2 diagnostic tests per 1000 population for a representative week ending October 26, 2020. Champaign County, in COVID-19 Region 6, stands out with the highest per capita testing rate in the state. Central and Southern counties have the lowest rates. b County-level average daily positive tests per 1000 population for the week ending October 26, 2020

Changing demographics of the tested population

Prior to mid-August, testing was most intensive in the elderly population, with those aged over 80 years receiving the most tests per capita, and intensity of testing increasing with age (Fig. 5a). Routine testing in long-term care facilities contributed to higher testing intensity in the elderly population [17, 18]. In July, pilot testing at UIUC led testing in people aged 18–22 years to exceed testing by more than twice the rate in all other age groups, even the over 80-year-old group. Testing at other university campuses would also contribute to the increased testing rate in 18–22 year-old people, and the testing rate declined in late November following the Thanksgiving holiday and winter recess. Working-age adults may have been subject to routine testing at employers’ behest. Pediatric testing, including testing in older children, remained much lower than all other age groups. This could have been due to lower prevalence of SARS-CoV-2 infection in children because of lower susceptibility [19], low rates of test-seeking among SARS-CoV-2-infected children because they are less likely to be symptomatic, barriers to accessing testing because some providers did not test pediatric patients, or simply a lack of routine testing in children.

Fig. 5
figure 5

SARS-CoV-2 diagnosic testing in Illinois stratified by age group. a Seven-day moving average of daily tests per 1000 population, by age group. b Share of tests by age group

The portion of tests that were conducted on young people steadily increased between July and September 2020 (Fig. 5b). Because COVID-19 is more likely to be asymptomatic or mild in younger patients [20, 21], this change in the tested population would be expected to lead to lower case fatality rates in the population as a whole even without any improvements in treating COVID-19.

We compared the per capita testing rates of non-Hispanic White, Black, Asian, and Hispanic/Latino populations in Illinois (Fig. 6). Testing increased between March and October for all four groups. During the first wave, per capita testing was highest in Black and Hispanic/Latino populations for most age groups, reflecting their disproportionate share of COVID-19 burden [16]. After the end of the first wave in late June, testing was consistently lowest in Asian and Hispanic/Latino populations, with only minimal expansion of testing among Asian and Hispanic/Latino elders. The testing rate in the Black population saw a sharp increase around the beginning of July but did not increase further between July and October. Asians were consistently the least-tested demographic in older adults 61 years and above for most of 2020 and did not see a large expansion of testing until November 2020. In contrast, the testing rate in the White population increased steadily. The impact of student testing at university campuses was visible in all four demographic groups as the step-increase from mid-August to late-November and was largest in the Asian population. Testing rates began to decline sharply in all groups by mid-December.

Fig. 6
figure 6

Seven-day moving average of daily SARS-CoV-2 tests per 1000 population, by race/ethnicity and age group in Illinois in 2020

On a per capita basis, testing intensity was lowest in Hispanic-Latino populations and highest in Black populations, although the extent of this difference appeared to vary by COVID-19 Region (Figure S2). Since the pandemic has disproportionately affected Black and Hispanic/Latino communities in Illinois [16], the higher testing intensity in Black populations does not necessarily mean that the testing was sufficient to capture burden relative to White populations.

Crude assessment of under-testing with case fatality ratio

We considered whether the naive case fatality ratio (CFR), defined as the number of COVID-19 deaths divided by number of detected cases, could assess differences in SARS-CoV-2 testing in each super-region when detailed data on testing rates and hospital admissions were unavailable. Assuming that COVID-19 death ascertainment rates were uniformly high, and there was little to no geographic variation in infection fatality rate for SARS-CoV-2, we expected areas and populations with higher testing rates to also have lower case fatality rates.

In Illinois, crude CFR decreased over the course of 2020 in all super-regions and age groups (Fig. 7), concurrent with the scale-up of testing. CFR was highest in the Northeast and Southern super-regions in the first 2 months of the epidemic, although CFR in the Central super-region increased in May and June for adults aged 41–50 years and 61–70 years. From July onward, CFR was similar in all regions.

Fig. 7
figure 7

COVID-19 case fatality ratios (CFR), the fraction of recorded cases with a COVID-19-attributed death, by age group and super-region, for cases detected in 2020. Error bars indicate the standard error in regional CFR

Differences in CFR could be driven by heterogeneous access to testing and care as well as regional differences in the prevalence of comorbidities, standard of care, or hospital capacity. The higher CFR in the Southern super-region prior to July reflected the consistently lower testing rates in COVID-19 Regions 4 and 5 during the first wave. However, the Northeast’s CFR prior to July was substantially elevated over the CFRs in the Central and North-Central super-regions despite the Northeast super-region’s higher intensity of testing. This discrepancy suggested that despite its higher testing intensity during the first wave, the Northeast super-region was disproportionately under-tested relative to its share of the state’s COVID-19 burden. Alternatively, the higher CFR despite higher testing in the Northeast could have been driven by insufficient targeting of tests to the most affected populations. The convergence of regional CFRs in late 2020 suggested that earlier differences in the regional CFRs might not have been driven by differences in regional prevalence of comorbidities. In April–May 2020, the Northeast super-region experienced the greatest strain on hospital capacity (Figure S3), which could have contributed to lower quality of care. However, hospital capacity overall is also highest in the Northeast, and peak inpatient census did not exceed capacity (Table S1).

Most majority-Black and majority-Hispanic/Latino ZIP codes are in the Northeast and Southern super-regions [7], where the highest overall CFRs were observed during March–April 2020. When stratified by age and race (Fig. 8), CFR increased with age, with disparities becoming less pronounced for older age groups and as the epidemic progressed. CFRs remained higher for Black and Hispanic populations for all but the over-80 year-old age group through the end of 2020. Asians had the highest CFR in the over-80 age group and the highest CFR in the 71–80 age group prior to July 2020.

Fig. 8
figure 8

COVID-19 case fatality ratio by age group in non-Hispanic Asian, non-Hispanic Black, Hispanic/Latino, and non-Hispanic White populations, for cases detected in 2020. Error bars indicate the standard error in group CFR

Higher fatality rates among Black, Hispanic/Latino, and older cases could be due to a combination of under-testing leading to fewer detected cases and disparities in clinical outcomes resulting in more deaths. The under-testing of Asian, Black, and Hispanic/Latino individuals is reflected in the higher CFRs in these populations. While elevated prevalence of comorbidities such as diabetes and hypertension increased the underlying infection fatality rate in in Black and Hispanic/Latino populations, the enormous difference in CFR in younger age groups in Mar-Jun 2020 is unlikely to be explained by comorbidities alone. For example, if diabetes prevalence at age 45 were around 5% in non-Hispanic Whites and 11% in non-Hispanic Blacks [22], and diabetes increased the risk of severe outcomes by around 60% [23], the disparity in diabetes prevalence would increase the CFR in the Black population ages 41–50 by approximately 10%. Yet in this age group, the relative risk of death given a case was almost 300% higher in the Black population compared to White in Mar-Apr 2020 [2.94 (95% CI: 1.72–5.03)]. In Nov-Dec 2020, relative risk remained high at 3.31 (2.25–4.89).

In a sensitivity analysis, similar results were observed when cases with “unknown” ethnicity were removed altogether, instead of being allocated to non-Hispanic racial groups (Figure S4). As presented, the latter scenario may slightly underestimate CFR for older Black, Asian, and White populations.

The majority of SARS-CoV-2 infections were never detected

Low per capita testing rates are not necessarily problematic if there is little SARS-CoV-2 circulation and testing is highly targeted. These conditions do not describe Illinois in 2020. To estimate the extent to which testing was able to identify all incident SARS-CoV-2 infections in Illinois as a whole, we compared the expected IFR among individuals aged 61–70 years, as estimated by Levin et al. [13] and O’Driscoll et al. [14], to the CFR among the same group (Fig. 9a). We restricted the analysis to this age group because detection rates are likely highly heterogeneous across age groups, and the 61–70 age group has a sizable number of weekly cases and deaths. We generated a naive estimate (Fig. 9d) as well as estimates accounting for both a non-stationary IFR due to improving clinical outcomes among the infected (Fig. 9b, e) and under-reporting of deaths (Fig. 9c, f). This methodology only provides estimates of the detection rate for all infections and does not account for any heterogeneity in the detection of mild symptomatic and asymptomatic infections versus severely symptomatic infections. Because O’Driscoll et al. [12] estimates a lower IFR for ages 61–70 than Levin et al. [11], the estimated fraction of infections detected using IFR from O’Driscoll et al. is slightly lower than the same estimate using IFR from Levin et al.

Fig. 9
figure 9

Estimating fraction of infections detected. a Naive CFR among adults aged 61–70 years by week of specimen collection alongside expected IFR among this age distribution, as estimated by Levin et al. [13] or O’Driscoll et al. [14]. Shaded regions show 95% confidence intervals. b HFR among admitted 61–70 year-olds by week of specimen collection (solid red) with standard error of proportions (shaded red), fitted sigmoid curve (solid black) and 95% prediction interval (dashed black). c Fraction of all deaths reported by date of death, based upon comparison of COVID-19 mortality and excess all-cause mortality. d Estimated fraction of SARS-CoV-2 infections among adults aged 61–70-years that were detected by surveillance: assuming that all deaths are reported and IFR is stationary; e assuming all COVID-19 deaths are reported and IFR is non-stationary due to improving clinical outcomes; f and assuming that excess deaths are unreported COVID-19 deaths and IFR is non-stationary. Dark blue estimates use IFR estimates from Levin et al. [13] and light blue from O’Driscoll et al. [14]. Shaded regions in D-F are 95% credible intervals with 1000 bootstrapped samples

In March and April 2020, excess deaths in Illinois greatly exceeded COVID-19-attributed deaths, driving down the estimates of infection detection rates in Fig. 9f. Due to lack of data on cause of death, we made the simplifying assumption in Fig. 9c and 10F that all excess select-cause deaths documented by NCHS were COVID-19 related. This assumption produced a floor on the estimated detection rate of SARS-CoV-2 infections because not all excess deaths would be directly related to COVID-19. The true fraction of SARS-CoV-2 infections detected in Illinois likely lay between the estimates in Fig. 9e and f.

In the early epidemic, prior to mid-April, we estimated that less than 10% of SARS-CoV-2 infections among adults aged 61–70 years were detected and reported to IDPH (Fig. 9d-f). This low level of detection in the early stages of the epidemic is consistent with other estimates of around 10% detection rate [3, 24]. Despite the 3- to 4-fold scale-up in testing volume over the summer, we estimated that the detection rate among this population had yet to exceed 40% as of late December and could have been as low as under 20%.

Compared with the 61–70 year old age group (Fig. 9), we expected the detection rate of SARS-CoV-2 infections in individuals over 70 years old to be higher [24]. Older individuals are more likely to show symptoms and thus seek testing, testing intensity generally increases with age, and routine testing in long-term care facilities may identify additional asymptomatic infections. Infections among younger age groups might have been detected at a lower rate than that of the 61–70 age group because younger adults were less likely to present symptoms. An exception was in college-age young adults: routine testing by universities could have led to higher overall detection rates than 40% in this population, although the overall rate would have masked heterogeneity across the state and in different segments of the college-age population.

Discussion

Since the first cases of SARS-CoV-2 infection were detected in Illinois toward the end of January 2020, diagnostic testing capabilities have expanded dramatically. At the epidemic peak in November 2020, Illinois conducted over 110,000 diagnostic tests per day, among the highest in the U.S. For most of 2020, testing intensity varied considerably across the state, with the lowest rates in the Southern super-region and the highest rates in Champaign County, where UIUC rolled out mass testing in preparation for students returning to campus. Assessing trends in testing at the state level is insufficient as it masks local heterogeneities that can be critical: for example, UIUC’s testing protocols were not representative of testing protocols throughout the state, and any testing data, including cases, positive tests, and test positivity rate, from Champaign County or containing the college-age students would skew overall observed trends. While stratification of testing data by modality or reason for testing (inpatient, outpatient symptomatic, possible exposure, or routine) would permit disambiguation of apparent trends and more complete assessment of access to testing, these data were not systematically reported.

The ramp-up of testing, while necessary and impressive, is unlikely to be sufficient to contain SARS-CoV-2 on its own 6, 25, 26]. Among individuals aged 61–70 years in Illinois, we estimated that as of mid-September, no more than 40% of all new infections were detected. Unfortunately, data on symptoms and reason for test were lacking. Because the majority of infections in the 61–70 year age group are likely to have been symptomatic [27, 28], our estimated ceiling of 40% suggests that in addition to few asymptomatic cases found, there was also considerable room for improvement in the detection of symptomatic cases. Given RT-PCR sensitivity, some of the positive tests might have been old infections past their peak infectiousness period [29]. Test turnaround times were often several days or more [30].

Modeling analyses have suggested that infections would need to be detected at a rate far greater than 40%, the high end of our Illinois estimates, for diagnostic testing to have had a substantial impact on containing transmission, even with all identified infections successfully isolated and test turnaround time within 2 days [25, 31, 32]. Universal routine testing every 2 weeks with a highly sensitive diagnostic, a testing regime wherein nearly all infections would be identified, coupled with isolation of those who test positive, would reduce transmission by only 30% [25]. Overall, diagnostic testing probably played a minor role in directly reducing SARS-CoV-2 spread in Illinois, second to other mitigation measures (e.g. social distancing, mask usage, retail/restaurant closures). Because Illinois testing rates have been among the highest in the United States [33], diagnostic testing likely had minimal direct impact on reducing SARS-CoV-2 spread in most U.S. states in 2020. However, diagnostic testing also has an indirect role in reducing transmission by providing surveillance data, allowing the public to take preventive measures and policymakers to make mitigation policy decisions.

The ramp-up of testing did not result in equity of access to diagnostic testing sites, as many residents of Illinois outside the Northeast metro area, particularly residents of Central and Southern Illinois, needed to travel far longer to the nearest testing site. The disparities between urban, suburban, and rural access to testing were likely to be similar in other parts of the U.S.

Current surveillance does not give us an accurate picture of spread in different populations within a state. Race and ethnicity data were missing for over 40% of tests. More testing and more complete demographic and epidemiologic data are needed to capture cases all over Illinois, and particularly in racial and ethnic minority populations who experience higher rates of occupational exposure and reduced access to care [34, 35]. Black populations were under-tested for SARS-CoV-2 in Utah [36] and New York City [37]. Black patients were more likely to access testing in hospitals rather than outpatient settings in California [38], which could have reflected limited access to ambulatory testing sites or decisions to not undergo testing unless or until symptoms became severe. In a cohort study of people receiving care through the U.S. Department of Veterans Affairs, Black and Hispanic patients had both higher rates of testing and higher rates of positivity [39]. Disparity in surveillance quality across socioeconomic strata, where communities that experience disproportionate risk also have the poorest quality surveillance, is hardly unique to COVID-19 [40].

If detailed testing data are unavailable, we found that CFR can act as a crude benchmark of relative under-testing across geographic regions and reflects disparities in testing across demographic groups. However, CFR-based indicators of under-testing should be used with caution, as multiple mechanisms can create differences in observed CFR across populations, and cumulative CFRs may not reflect current conditions.

Illinois exerted tremendous effort to scale up diagnostic testing and successfully reduce geographic and demographic disparities in testing rates. Yet, containment through diagnostic testing alone would have required another order of magnitude increase in testing capacity. Managing the COVID-19 pandemic in the U.S. requires an integrated strategy of multiple policies and interventions, of which testing is only one part.

Testing is critical both as an intervention, as positive cases are directed to isolate and prevent transmission, and for surveillance, which provides information for policymakers to make effective decisions. However, when testing is both insufficient and heterogeneous, existing inequalities in disease burden are exacerbated, surveillance quality suffers, and directing interventions to appropriate demographics and locales becomes challenging. Understanding the disparities in testing is the first step toward building surveillance structures capable of reliably informing good decisions. Identifying which geographic areas are relatively under-tested with the straightforward methods as demonstrated here can be a critical part of public health departments’ regular assessment of their testing capacity.

Conclusions

In the U.S. state of Illinois, testing intensity continues to vary geographically and across demographic groups. While testing rates improved dramatically from the onset of the pandemic through December 2020, the Southern and Central parts of the state remained relatively under-tested. These data suggest that raw per capita testing volume, infection detection rates derived from deaths and IFR, CFR, and disparate patterns in admissions and cases can all be used to identify populations in which testing should be expanded. By accessing a variety of available data sources, policymakers can strengthen their understanding of COVID-19 disease burden throughout the state to more accurately assess where to target additional testing resources, thus strengthening the potential for infected individuals to be safely isolated and referred to appropriate care.

Availability of data and materials

The I-NEDSS and testing by age and race/ethnicity datasets analyzed in this study were used under license for the current study, and so are not publicly available. Restrictions apply to the availability of these data, which contain identifiable private health information. Interested parties should contact IDPH to inquire about access. Public data on cases and testing are available from IDPH (https://www.dph.illinois.gov/covid19/covid19-statistics) and from other public aggregators (https://coronavirus.jhu.edu/region/us/illinois).

Abbreviations

ACS:

American Community Survey

CFR:

Case fatality ratio

HFR:

Hospital fatality ratio

IDPH:

Illinois Department of Public Health

IFR:

Infection fatality ratio

I-NEDSS:

Illinois’s National Electronic Disease Surveillance System

NCHS:

National Center for Health Statistics

UIUC:

University of Illinois at Urbana-Champaign

References

  1. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2020;20(5):533–4. https://doi.org/10.1016/S1473-3099(20)30120-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Transcript for the CDC telebriefing update on COVID-19. 2020. Available from: https://www.cdc.gov/media/releases/2020/t0625-COVID-19-update.html. Accessed 23 Nov 2020.

  3. Perkins TA, Cavany SM, Moore SM, Oidtman RJ, Lerch A, Poterek M. Estimating unobserved SARS-CoV-2 infections in the United States. Proc Natl Acad Sci U S A. 2020;117(36):22597–602. https://doi.org/10.1073/pnas.2005476117.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Kang EY, Moore M, Zamudio MI. 50 Lives In 4 ZIP codes: WBEZ [newspaper on the internet]; 2020. [cited 2020 Aug 26]. Available from: https://www.wbez.org/stories/a-perfect-storm-50-lives-and-4-zip-codes-tell-chicagos-story-of-covid-19-inequality/50b822ae-523e-47fa-a823-3c6a1c3ee12f

  5. Jacobson SH, Jokela JA. If the University of Illinois can’t prevail over COVID-19, no other big university will be able to either: Chicago Sun-Times [newspaper on the internet]; 2020. [cited 2020 Aug 27]. Available from: https://chicago.suntimes.com/2020/8/24/21399564/university-illinois-campus-covid-19-rapid-saliva-testing-champaign-urbana-sheldon-jacobson

  6. Grassly NC, Pons-Salort M, Parker EPK, White PJ. Ferguson NM; Imperial college COVID-19 response team. Comparison of molecular testing strategies for COVID-19 control: a mathematical modelling study. Lancet Infect Dis. 2020;20(12):1381–9. https://doi.org/10.1016/S1473-3099(20)30630-7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. US Census Bureau. 2018 American Community Survey Single-Year Estimates. Available from: https://www.census.gov/newsroom/press-kits/2019/acs-1year.html. Accessed 27 Aug 2020.

  8. Kaiser Family Foundation. Population distribution by race/ethnicity. 2019. Available from: https://www.kff.org/other/state-indicator/distribution-by-raceethnicity/. Accessed 27 Aug 2020.

  9. Sommeiller E, Price M. The new gilded age: income inequality in the US by state, metropolitan area, and county. Econo Policy Instit. 2018;19.

  10. Illinois Regional COVID-19 Resurgence Criteria. Available from: https://www.dph.illinois.gov/regionmetrics?regionID=1. Accessed 27 Aug 2020.

  11. Weiss DJ, Nelson A, Vargas-Ruiz CA, Gligorić K, Bavadekar S, Gabrilovich E, et al. Global maps of travel time to healthcare facilities. Nat Med. 2020;26(12):1835–8. https://doi.org/10.1038/s41591-020-1059-1.

  12. Pfeffer DA, Lucas TC, May D, Harris J, Rozier J, Twohig KA, et al. malariaAtlas: an R interface to global malariometric data hosted by the malaria atlas project. Malar J. 2018;17(1):1.

  13. Levin AT, Hanage WP, Owusu-Boaitey N, Cochran KB, Walsh SP, Meyerowitz-Katz G. Assessing the age specificity of infection fatality rates for COVID-19: systematic review, meta-analysis, and public policy implications. Eur J Epidemiol. 2020;8:1-6.

  14. O’Driscoll M, Dos Santos GR, Wang L, Cummings DA, Azman AS, Paireau J, Fontanet A, Cauchemez S, Salje H. Age-specific mortality and immunity patterns of SARS-CoV-2. Nature. 2021;590(7844):140-5.

  15. Excess Deaths Associated with COVID-19. Available from: https://www.cdc.gov/nchs/nvss/vsrr/covid19/excess_deaths.htm. Accessed 9 Feb 2021.

  16. COVID-19 Statistics. Available from: https://www.dph.illinois.gov/covid19/covid19-statistics. Accessed 27 Aug 2020.

  17. Long -Term Care COVID-19 Testing Requirements. Available from: https://www.dph.illinois.gov/covid19/community-guidance/long-term-care-covid-19-testing-requirements. Accessed 23 Nov 2020.

  18. Roberts J. Illinois to mandate COVID-19 testing in long-term care facilities: WGEM [newspaper on the internet]; 2020. [cited 2020 Nov 23]. Available from: https://wgem.com/2020/05/28/illinois-to-mandate-covid-19-testing-in-long-term-care-facilities/

  19. Viner RM, Mytton OT, Bonell C, Melendez-Torres GJ, Ward J, Hudson L, et al. Susceptibility to SARS-CoV-2 infection among children and adolescents compared with adults: a systematic review and meta-analysis. JAMA Pediatr. 2020;25:e204573.

    Google Scholar 

  20. Sakurai A, Sasaki T, Kato S, Hayashi M, Tsuzuki SI, Ishihara T, et al. Natural history of asymptomatic SARS-CoV-2 infection. NEJM. 2020;383(9):885–6. https://doi.org/10.1056/NEJMc2013020.

  21. Yang R, Gui X, Xiong Y. Comparison of clinical characteristics of patients with asymptomatic vs symptomatic coronavirus disease 2019 in Wuhan, China. JAMA Netw Open. 2020;3(5):e2010182. https://doi.org/10.1001/jamanetworkopen.2020.10182.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Lee DC, Ta’Loria Young CA, Shim CJ, Osorio M, Vinson AJ, Ravenell JE, et al. Peer reviewed: age disparities among patients with type 2 diabetes and associated rates of hospital use and diabetic complications. Prev Chronic Dis. 2019;16. https://doi.org/10.5888/pcd16.180681.

  23. Guan WJ, Liang WH, Zhao Y, Liang HR, Chen ZS, Li YM, Liu XQ, Chen RC, Tang CL, Wang T, Ou CQ. Comorbidity and its impact on 1590 patients with COVID-19 in China: a nationwide analysis. Eur Respir J. 2020;55(5):2000547.

  24. Rosenberg ES, Tesoriero JM, Rosenthal EM, Chung R, Barranco MA, Styer LM, et al. Cumulative incidence and diagnosis of SARS-CoV-2 infection in New York. Ann Epidemiol. 2020;48:23–9.e4.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, et al. Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening. Sci Adv. 2020;7:eabd5393.

    Article  Google Scholar 

  26. Hellewell J, Abbott S, Gimma A, Bosse NI, Jarvis CI, Russell TW, et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. Lancet Glob Health. 2020;8(4):e488–96. https://doi.org/10.1016/S2214-109X(20)30074-7.

  27. Buitrago-Garcia D, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Ipekci AM, et al. Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections: a living systematic review and meta-analysis. PLoS Med. 2020;17(9):e1003346. https://doi.org/10.1371/journal.pmed.1003346.

  28. Jung C-Y, Park H, Kim DW, Choi YJ, Kim SW, Chang TI. Clinical characteristics of asymptomatic patients with COVID-19: a nationwide cohort study in South Korea. Int J Infect Dis. 2020;99:266–8. https://doi.org/10.1016/j.ijid.2020.08.001.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Mahase E. Covid-19: the problems with case counting. BMJ. 2020;370:m3374.

    Article  PubMed  Google Scholar 

  30. How long should it take to get your coronavirus test results back in Chicago?. NBC Chicago [newspaper on the internet]. 2020. Available from: https://www.nbcchicago.com/news/coronavirus/how-long-should-it-take-to-get-your-coronavirus-test-results-back-in-chicago/2306258/. Accessed 23 Nov 2020.

  31. Ferrari A, Santus E, Cirillo D, Ponce-de-Leon M, Marino N, Ferretti MT, et al. Simulating SARS-CoV-2 epidemics by region-specific variables and modeling contact tracing app containment. NPJ Digit Med. 2021;4(1):1–8.

  32. Grassly NC, Pons-Salort M, Parker EP, White PJ, Ferguson NM, Ainslie K, et al. Comparison of molecular testing strategies for COVID-19 control: a mathematical modelling study. Lancet Infect Dis. 2020;20(12):1381–9. https://doi.org/10.1016/S1473-3099(20)30630-7.

  33. Track Testing Trends - Johns Hopkins Coronavirus Resource Center. Available from: https://coronavirus.jhu.edu/testing/tracker/overview. Accessed 23 Nov 2020.

  34. Tai DBG, Shah A, Doubeni CA, Sia IG, Wieland ML. The disproportionate impact of COVID-19 on racial and ethnic minorities in the United States. Clin Infect Dis. 2020:ciaa815. https://doi.org/10.1093/cid/ciaa815.

  35. Thakur N, Lovinsky-Desir S, Bime C, Wisnivesky JP, Celedón JC. The structural and social determinants of the racial/ethnic disparities in the U.S. COVID-19 pandemic. What's our role? Am J Respir Crit Care Med. 2020;202(7):943–9. https://doi.org/10.1164/rccm.202005-1523PP.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Ahmed SM, Shah RU, Bale M, Peacock JB, Berger B, Brown A, et al. Comprehensive testing highlights racial, ethnic, and age disparities in the COVID-19 outbreak: medRxiv; 2020.

  37. Lieberman-Cribbin W, Tuminello S, Flores RM, Taioli E. Disparities in COVID-19 testing and positivity in New York City. Am J Prev Med. 2020;59(3):326–32. https://doi.org/10.1016/j.amepre.2020.06.005.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Azar KMJ, Shen Z, Romanelli RJ, Lockhart SH, Smits K, Robinson S, et al. Disparities in outcomes among COVID-19 patients in a large health care system in California. Health Aff. 2020;39(7):1253–62. https://doi.org/10.1377/hlthaff.2020.00598.

  39. Rentsch CT, Kidwai-Khan F, Tate JP, Park LS, King JT Jr, Skanderson M, et al. Patterns of COVID-19 testing and mortality by race and ethnicity among United States veterans: a nationwide cohort study. PLoS Med. 2020;17(9):e1003379. https://doi.org/10.1371/journal.pmed.1003379.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Scarpino SV, Scott JG, Eggo RM, Clements B, Dimitrov NB, Meyers LA. Socioeconomic bias in influenza surveillance. PLoS Comput Biol. 2020;16(7):e1007941. https://doi.org/10.1371/journal.pcbi.1007941.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank Stacey Hoferka Jensen, Dejan Jovanov, and Sara Rogers for data extraction and preparation from I-NEDSS, and Arielle Eagan for comments on the manuscript.

Disclaimer

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Funding

TH was supported by a grant from NIGMS (T32 GM008152). RR was supported by a grant from NIGMS (T32 GM008449). MR was supported by a COVID-19 rapid response grant via NUCATS (UL1TR001422). MR and JG were supported by a MIDAS rapid response grant (MIDASNI2020-4) and a grant from the Bill and Melinda Gates Foundation (INV-002092). The funders had no role in the design of the study and collection, analysis, and interpretation of data or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

JG and SC conceived the project. TMH completed the race and ethnicity analysis. RAKR completed the infection detection rate analysis. PA contributed to the detection rate analysis. TMH and EW completed the CFR analysis. RAKR and MR completed the testing site analysis. JG and MR completed the regional testing rate analysis. MR completed the bed availability analysis. TMH, RAKR, and JG wrote the initial draft. All authors revised and approved the final manuscript.

Corresponding author

Correspondence to Jaline Gerardin.

Ethics declarations

Ethics approval and consent to participate

This study was carried out as part of a Medical Study “Modeling COVID-19 Epidemiologic Trend and Health Care Impact in Illinois” declared by IDPH on March 23, 2020. All data collection was performed by IDPH as part of routine surveillance for COVID-19 and was deidentified prior to analysis. CDC determined that this study does not constitute human subjects research.

This activity was reviewed by CDC and was conducted consistent with applicable federal law and CDC policy. See e.g., 45 C.F.R. part 46, 21 C.F.R. part 56; 42 U.S.C. §241(d); 5 U.S.C. §552a; 44 U.S.C. §3501 et seq.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Figure S1.

Calculation of fdeathdet from Illinois COVID-19-attributed deaths and excess select cause deaths. Figure S2. Testing rate per capita by race/ethnicity and COVID-19 Region. Population denominators were drawn from ACS 2018. “Native” included both “American Indian or Alaskan Native” and “Native Hawaiian or Other Pacific Islander”. Native populations were excluded from Figures 6 and 8 due to small population denominators after stratifying by age. The small denominators are reflected in the large fluctuations in the Native timeseries in this figure. Figure S3. Daily COVID-19 hospital census by COVID-19 Region (subplots) and super-region (colors) in 2020. Lines show 7-day rolling averages. Data for med/surg occupancy are not available prior to May 2020. Med/surg census covers all admitted patients who are not in the intensive care unit (ICU). Figure S4. Sensitivity of CFR to case race/ethnicity assignment. Alternate scenarios were run in which cases with “unknown” ethnicity were: 1) Assumed to be non-Hispanic and assigned to the recorded racial group (solid line, and identical to Figure 8), 2) Assigned to the “unknown” racial group (dashed line), or 3) Assumed to be Hispanic (dotted line). For Hispanic-Latino, scenarios #1 and #2 are identical. For Black, White, and Asian, scenarios #2 and #3 are identical. Assumption of non-Hispanic ethnicity slightly, but significantly, decreases CFR for older non-Hispanic White and Black populations. Table S1. Total hospital beds by COVID-19 Region. Bed availability data from September 1, 2020 via IDPH website. Beds available for COVID refers to number of beds not occupied by non-COVID patients.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Holden, T.M., Richardson, R.A.K., Arevalo, P. et al. Geographic and demographic heterogeneity of SARS-CoV-2 diagnostic testing in Illinois, USA, March to December 2020. BMC Public Health 21, 1105 (2021). https://doi.org/10.1186/s12889-021-11177-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-021-11177-x

Keywords