Prediction of COVID-19 Con rmed Cases Using Gradient Boosting Regression Method

Abdu Gumaei,Mabrook Al-Rakhami,Mohamad Mahmoud Al Rahhal,Fahad Raddah H.Albogamy,Eslam Al Maghayreh and Hussain AlSalman

1College of Computer and Information Sciences,King Saud University,Riyadh,11362,Saudi Arabia

2Computer Science Department,Faculty of Applied Science,Taiz University,Taiz,Yemen

3College of Applied Computer Sciences,King Saud University,Riyadh,11362,Saudi Arabia

Abstract:The fast spread of coronavirus disease(COVID-19)caused by SARSCoV-2 has become a pandemic and a serious threat to the world.As of May 30,2020,this disease had infected more than 6 million people globally,with hundreds of thousands of deaths.Therefore,there is an urgent need to predict confirmed cases so as to analyze the impact of COVID-19 and practice readiness in healthcare systems.This study uses gradient boosting regression(GBR)to build a trained model to predict the daily total confirmed cases of COVID-19.The GBR method can minimize the loss function of the training process and create a single strong learner from weak learners.Experiments are conducted on a dataset of daily confirmed COVID-19 cases from January 22,2020,to May 30,2020.The results are evaluated on a set of evaluation performance measures using 10-fold cross-validation to demonstrate the effectiveness of the GBR method.The results reveal that the GBR model achieves 0.00686 root mean square error,the lowest among several comparative models.

Keywords:COVID-19;coronavirus disease;SARS-CoV-2;machine learning;gradient boosting regression(GBR)method

1 Introduction

At the end of December 2019,patients with clinical symptoms similar to those of the common cold and pneumonia were reported in Wuhan city,China.Chinese scientists detected that the cause of this pneumonia was a novel coronavirus[1].The most common clinical features of the disease are cough,fever,and difficulty in breathing.More severe symptoms in some cases can include lung damage,severe acute respiratory syndrome(SARS),breathing failure,and kidney failure,possibly causing death[2].Coronavirus disease 2019(COVID-19)was named by the World Health Organization(WHO)on February 11,2020[3].The International Committee on Taxonomy of Viruses(ICTV)refers to COVID-19 as severe acute respiratory syndrome coronavirus 2(SARS-CoV-2)[3].

The coronavirus(CoV)family includes the Middle East respiratory syndrome coronavirus(MERSCoV)and SARS and can cause symptoms with severity ranging down to those of the common cold[4].Published studies have shown that MERS-CoV and SARS-CoV infections,respectively,spread from dromedary camels and civet cats to humans.CoVs can be transmitted between humans and several animals,such as cattle,cats,camels,and bats[5].Animal CoVs,such as MERS-CoV,it is noted that it can hardly to be transmitted to humans and then spread between humans[6].Compared to SARS-CoV and MERS-CoV,SARS-CoV-2 spreads easily and has a low mortality rate[7].

On May 30,2020,the WHO reported that COVID-19 had infected more than 6 million people in 213 countries and territories,with 369,126 fatalities since the cases were officially registered in January[6].COVID-19 has become a serious worldwide problem,especially in the United States,Brazil,Russia,Spain,the United Kingdom,India,and Italy[8].Since the disease has no specific treatment and it spreads rapidly,it is crucial to prepare healthcare services for future cases[9].

Machine learning and approximation algorithms have been used to solve problems in areas such as healthcare[10],industry[11],cloud computing[12,13],human activity recognition[14],and brain tumor classification[15].Machine learning models are certainly useful to forecast future cases to take control of this global pandemic[16–18].

Few studies have used statistical models and artificial intelligence(AI)methods to predict coronavirus cases.The autoregressive integrated moving average(ARIMA)was used to forecast the spread of SARSCoV-2[18].An AI framework to predict the clinical severity of coronavirus was proposed in[19].A simple and powerful method was proposed to predict the continuation of COVID-19[20].However,to develop an effective model to predict future confirmed cases of COVID-19 in the world in different time periods is a challenging issue that needs a solution.

We aim to develop an effective model using a gradient boosting regression(GBR)algorithm to predict daily total confirmed cases and enhance the readiness of healthcare systems.

The rest of the paper is organized as follows.Section 2 explains the materials and methods,including a COVID-19 data sample,the GBR method,and performance evaluation measures.Section 3 describes our experiments and their results.Section 4 provides our conclusions and suggestions for future work.

2 Materials and Methods

We describe the dataset used to evaluate the work,our computational method,and performance evaluation measures.

2.1 COVID-19 Data Sample

The data sample used in this study includes the total daily confirmed cases of COVID-19,collected from the official website(https://gisanddata.maps.arcgis.com/apps/opsdashboard/index.html)of Johns Hopkins University,in the period from January 22,2020,to May 30,2020,all over the world.It contains 130 time-series instances from which to build our model,which we compare to other predictive models.Tab.1 shows some example instances from the collected COVID-19 data sample Fig.1.

The time-series instances of the dataset were processed for supervised learning methods using the timeseries data of the previous days as input to predict the next day.We used a sliding window technique to create three public benchmark datasets based on different time-intervals(5,10,and 15 days),respectively,called COVID-19_DataSet1,1https://github.com/abdugumaei/COVID-19-Time-Series-Prediction-Datasets/blob/master/COVID-19_DataSet1.csvCOVID-19_DataSet2,2https://github.com/abdugumaei/COVID-19-Time-Series-Prediction-Datasets/blob/master/COVID-19_DataSet2.csvand COVID-19_DataSet3.3https://github.com/abdugumaei/COVID-19-Time-Series-Prediction-Datasets/blob/master/COVID-19_DataSet3.csvTabs.2–4 demonstrate the first five instances of these datasets,whereTS1,TS2,…,TS15 are features variables of the previous days,andYis the predicted variable of the next day.

Table 1:Some instances of the collected COVID-19 data sample

Figure 1:Growth of total confirmed COVID-19 cases from January 22,2020,to May 30,2020

Table 2:First five instances of COVID-19_DataSet1

Table 3:First five instances of COVID-19_DataSet2

Table 4:First five instances of COVID-19_DataSet3

To make the values of independent feature variables suitable to ML methods and in a specific range,we transformed them to values between zero and one using a min-max normalization technique:

wherefi,jis the feature variable in rowiand columnjof a COVID-19 dataset.

2.2 Gradient Boosting Regression(GBR)

Gradient boosting(GB)is a machine learning(ML)algorithm used for regression and classification tasks.It can build a prediction model using a combination of weak prediction models,often through decision trees(DTs)[21,22].This algorithm was first proposed to optimize a cost function[23]and has been used for regression[24,25]and energy theft detection[26].This led to the development of applications in statistics and artificial intelligence(AI)[27].

GB regression(GBR)is an adaptive boosting algorithm that creates a single strong regression learner by iteratively combining a set of weak regression learners[28].Its objective function can use gradient descent to minimize the loss function computed from adding weak learners.In this case,the loss function is used to measure how the coefficients of a good model can fit the underlying instances of data.Such as in other boosting algorithms,GBR generates an additive model in a greedy style:

Algorithm 1:Training GBR Method

We train the GBR method on COVID-19 confirmed case datasets containing feature variables(xi)that represent total confirmed cases for previous days,and target labels(yi)that are confirmed cases of the following days.The trained GBR model predicts the total confirmed cases for the next day based on those of previous days.

2.3 Performance Evaluation Measures

To evaluate the experimental results of the study,a set of performance measures is utilized to evaluate the differences between the predicted and actual numbers of COVID-19 confirmed cases.These are the root mean square error(RMSE),mean absolute error(MAE),and coefficient of determination(R-squared).RMSE and MAE evaluate the errors between predicted and actual values,which should be small.In contrast,higher values of R-squared give a good indication that the model can correctly predict data instances.These measures are calculated as

3 Experiments and Discussion

We conducted a set of experiments to compare the GBR model to other predictive models in terms of the above performance evaluation measures.We describe and discuss the experimental results for the three COVID-19 datasets.All models were trained based on 10-fold cross-validation,a robust technique,used to train and evaluate ML models.It divides the dataset into 10 folds.The validation process is executed ten times,each time using one fold for testing and the others for training.The final evaluation result is the average over the 10 folds.Tabs.5–7 show the RMSE,MAE,R-squared,average,and standard deviation using this technique on the three datasets.

Table 5:Evaluation results of GBR method using 10-fold cross-validation on COVID-19_DataSet1

Table 6:Evaluation results of GBR method using 10-fold cross-validation on COVID-19_DataSet2

Table 7:Evaluation results of GBR method using 10-fold cross-validation on COVID-19_DataSet3

In Figs.2–4,we visualize the averaged results of RSME,MAE,and R-squared for the GBR method on the three datasets.From the results,it is clear that the best evaluation results are on COVID-19_DataSet3,which is for a time interval of 15 days.This means that to train the model using a long period of total confirmed cases can produce more accurate predictions.

Figure 2:Averaged RSME results of GBR method on the three datasets

Figure 3:Averaged MAE results of GBR method on the three datasets

We compared the performance of the GBR method to that of the popular ML regression methods of extreme gradient boosting regression(XGBR),support vector regression(SVR),and decision tree regression(DTR).Figs.5–7 show the actual and predicted total confirmed cases of fold 6 test instances for each dataset using GBR,XGBR,SVR,and DTR.From the figures,we can see that the actual and predicted total confirmed cases are better fitted by GBR than by the other methods,and SVR has the worst fitting among the compared methods.

Figure 4:Averaged R-squared results of GBR method on the three datasets

Figure 5:Actual and predicted total confirmed cases of test instances in fold 6 of COVID-19_DataSet1 for:(a)GBR;(b)XGBR;(c)SVR;(d)DTR

Figure 6:Actual and predicted total confirmed cases of test instances in fold 6 of COVID-19_DataSet2 for:(a)GBR;(b)XGBR;(c)SVR;(d)DTR

For the 10-fold cross-validation test,we report the average results of RMSE,MAE,and R-squared on the three datasets in Tabs.8–10.We can notice that GBR achieves the lowest average MAE and the highest average R-squared among the four methods.Figs.8–10 show the difference in RMSE results between GBR and the other methods on all three datasets.

From the reported results,we find that GBR can effectively predict the total confirmed COVID-19 cases for the next day based on those of previous days.We also conclude that GBR performs better than popular predictive methods in terms of RSME,MAE,and R-squared.

Figure 7:Actual and predicted total confirmed cases of test instances in fold 6 of COVID-19_DataSet3 for:(a)GBR;(b)XGBR;(c)SVR;(d)DTR

Table 8:Comparison of GBR,XGBR,SVR,and DTR on COVID-19_DataSet1

Table 9:Comparison of GBR,XGBR,SVR,and DTR on COVID-19_DataSet2

Table 10:Comparison of GBR,XGBR,SVR,and DTR on COVID-19_DataSet3

Figure 8:Average RMSE for GBR,XGBR,SVR,and DTR on COVID-19_DataSet1

Figure 9:Average RMSE for GBR,XGBR,SVR,and DTR on COVID-19_DataSet2

Figure 10:Average RMSE for GBR,XGBR,SVR,and DTR on COVID-19_DataSet3

4 Conclusion and Future Work

The SARS-CoV-2 pandemic has become a serious worldwide problem.Prediction of future confirmed cases of COVID-19 disease using ML methods is important to provide medical services and have readiness in healthcare systems.We proposed the GBR method to predict the daily total confirmed cases of COVID-19 based on the totals of previous days.We selected GBR because it can minimize the loss function in the training process and create a single strong learner from weak learners.We conducted experiments using 10-fold cross-validation on the daily confirmed cases of COVID-19 collected from January 22,2020,to May 30,2020.Experimental results were evaluated using RMSE,MAE,and R-squared.The results revealed that GBR is an effective ML tool to predict the daily confirmed cases of COVID-19.The results showed that GBR achieves 0.00686 RMSE,which is the lowest among GBR and the comparison XGBR,SVR,and DTR models on the same datasets.In future work,we plan to conduct a comprehensive study of ML methods to predict the total deaths and recovered cases as well as the total confirmed cases of COVID-19,so as to analyze their performance in more detail.

Acknowledgement:The authors extend their appreciation to the Deanship of Scientific Research at King Saud University for funding this work through research group No.RG-1441-502.

Funding Statement:The financial support provided from the Deanship of Scientific Research at King Saud University,Research group No.RG-1441-502.

Conflicts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.