Reliability of COVID-19 data: An evaluation and reflection
Abstract
Importance
The rapid proliferation of COVID-19 has left governments scrambling, and several data aggregators are now assisting in the reporting of county cases and deaths. The different variables affecting reporting (e.g., time delays in reporting) necessitates a well-documented reliability study examining the data methods and discussion of possible causes of differences between aggregators.
Objective
To statistically evaluate the reliability of COVID-19 across aggregators.
Design, Setting, and Participants
Cases and deaths were collected daily by volunteers via state and local health departments, as primary sources and newspaper reports, as secondary sources. In an effort to begin comparison for reliability statistical analysis, BroadStreet collected data from other COVID-19 aggregator sources, including USAFacts, Johns Hopkins University, New York Times, The COVID Tracking Project.
Main Outcomes and Measures
COVID-19 cases and death counts at the county and state levels.
Results
Lower levels of inter-rater agreement were observed across aggregators associated with the number of deaths, which manifested itself in state level Bayesian estimates of COVID-19 fatality rates.
Conclusions and Relevance
A national, publically available data set is needed for current and future disease outbreaks and improved reliability in reporting.
Related articles
Related articles are currently not available for this article.