bibtype J - Journal Article
ARLID 0572279
utime 20240404124229.0
mtime 20230526235959.9
SCOPUS 85158061738
WOS 001009734700001
DOI 10.7554/eLife.81916
title (primary) (eng) Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations
specification
page_count 19 s.
serial
ARLID cav_un_epca*0430859
ISSN 2050-084X
title eLife
volume_id 12
publisher
name eLife
keyword modelling
keyword forecast
keyword COVID-19
keyword Europe
keyword ensemble
keyword prediction
author (primary)
ARLID cav_un_auth*0450503
name1 Sherratt
name2 K.
country GB
author
ARLID cav_un_auth*0450504
name1 Gruson
name2 H.
country GB
author
ARLID cav_un_auth*0450505
name1 Grah
name2 R.
country SE
author
ARLID cav_un_auth*0417210
name1 Tuček
name2 Vít
institution UIVT-O
full_dept (cz) Oddělení strojového učení
full_dept Department of Machine Learning
country CZ
fullinstit Ústav informatiky AV ČR, v. v. i.
author
ARLID cav_un_auth*0101206
name1 Šmíd
name2 Martin
institution UTIA-B
full_dept (cz) Ekonometrie
full_dept Department of Econometrics
department (cz) E
department E
full_dept Department of Econometrics
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
author
ARLID cav_un_auth*0237467
name1 Zajíček
name2 Milan
institution UTIA-B
full_dept (cz) Výpočetní Středisko
full_dept Computer Centre
department (cz) VS
department VS
full_dept Department of Image Processing
country CZ
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
source
url https://dx.doi.org/10.7554/eLife.81916
cas_special
abstract (eng) BACKGROUND: Short-term forecasts of infectious disease contribute to situational awareness and capacity planning. Based on best practice in other fields and recent insights in infectious disease epidemiology, one can maximise forecasts’ predictive performance by combining independent models into an ensemble. Here we report the performance of ensemble predictions of COVID-19 cases and deaths across Europe from March 2021 to March 2022. METHODS: We created the European COVID-19 Forecast Hub, an online open-access platform where modellers upload weekly forecasts for 32 countries with results publicly visualised and evaluated. We created a weekly ensemble forecast from the equally-weighted average across individual models' predictive quantiles. We measured forecast accuracy using a baseline and relative Weighted Interval Score (rWIS). We retrospectively explored ensemble methods, including weighting by past performance. RESULTS: We collected weekly forecasts from 48 models, of which we evaluated 29 models alongside the ensemble model. The ensemble had a consistently strong performance across countries over time, performing better on rWIS than 91% of forecasts for deaths (N=763 predictions from 20 models), and 83% forecasts for cases (N=886 predictions from 23 models). Performance remained stable over a 4-week horizon for death forecasts but declined with longer horizons for cases. Among ensemble methods, the most influential choice came from using a median average instead of the mean, regardless of weighting component models. CONCLUSIONS: Our results support combining independent models into an ensemble forecast to improve epidemiological predictions, and suggest that median averages yield better performance than methods based on means. We highlight that forecast consumers should place more weight on incident death forecasts than case forecasts at horizons greater than two weeks. FUNDING: European Commission, Ministerio de Ciencia, Innovación y Universidades, FEDER66666 - Agència de Qualitat i Avaluació Sanitàries de Catalunya - Netzwerk Universitätsmedizin - Health Protection Research Unit - Wellcome Trust - European Centre for Disease Prevention and Control - Ministry of Science and Higher Education of Poland - Federal Ministry of Education and Research - Los Alamos National Laboratory - German Free State of Saxony - NCBiR - FISR 2020 Covid-19 I Fase - Spanish Ministry of Health / REACT-UE (FEDER) - National Institutes of General Medical Sciences - Ministerio de Sanidad/ISCIII - PERISCOPE European H2020 - PERISCOPE European H2021 - InPresa - National Institutes of Health, NSF, US Centers for Disease Control and Prevention, Google, University of Virginia, Defense Threat Reduction Agency.
FORD0 10000
FORD1 10200
FORD2 10201
reportyear 2024
num_of_auth 129
mrcbC47 UTIA-B 10000 10100 10103
mrcbC52 4 O 4o 20231122151341.9
mrcbC55 UTIA-B BB
inst_support RVO:67985807
inst_support RVO:67985556
permalink https://hdl.handle.net/11104/0343023
mrcbC61 1
confidential S
article_num e81916
mrcbC91 A
mrcbT16-e BIOLOGY
mrcbT16-j 3.681
mrcbT16-s 3.932
mrcbT16-D Q1*
mrcbT16-E Q1*
arlyear 2023
mrcbTft \nSoubory v repozitáři: 0572279-aoa.pdf
mrcbU14 85158061738 SCOPUS
mrcbU24 37083521 PUBMED
mrcbU34 001009734700001 WOS
mrcbU63 cav_un_epca*0430859 eLife Roč. 12 April 2023 2023 2050-084X 2050-084X eLife