"Remember this rule: intuition cannot be trusted in the absence of stable regularities in the environment."
--Daniel Kahneman, Nobel Prize winning economist
In this very first Actionable Insights blog piece, we are bringing you a very topical content. This article is about the ongoing COVID19 pandemic and how we built a simple, yet effective visualization tool. In this example, we are using the COVID19 outbreak public data from India. The data is aggregated from the Ministry of Health and Family Welfare (MoHFW), Government of India website, that publishes daily statistics about the COVID19 outbreak in the country.
We picked the India data because of its importance in fighting to overcome this pandemic. India is the second most populous country in the world, home to 1.34 billion people. In this visualization tool, we are overlaying the state-wise data onto a country map, providing a quick visual summary of the pandemic. The state-wise hover panels provide a great interactive mechanism for users interested in learning more about the data. By using the power of colors and visual summaries, we wanted to tell the story of how this disease is affecting the country, without overwhelming the users with a lot of information in one go.
There is a basic mode and a forecast mode in the visualization tool. The basic visualization mode displays the sate-wise COVID19 cases and deaths. It is the default mode when the visualization tool is newly loaded. The forecasting visualization can be activated using the 'Forecast' tab in the tool. In the forecasting visualization, the hovering information panel shows the state-wise case forecasts, for three time periods: a day (+1 day) ahead, three days (+3 days) ahead and a week (+7 days) ahead. The case forecasting model is developed using the historic data of the COVID19 outbreak. The forecasting model also incorporates state-wise: population, total land area, nominal gross domestic product (GDP) per-capita and human development index (HDI).
Algorithm used here for the forecasting combines Bayesian statistics with an ensemble deep neural network. It is trained daily on the historic COVID19 India data. Our Bayesian statistical forecasting approach generates a range of predictions, instead of a typical point prediction generated by a traditional (non Bayesian) deep neural network. Using these range of predictions, we are also quantifying the algorithmic uncertainties associated with each forecast.
The training process of the forecasting algorithm is designed to 'look ahead' 'n' number of days. Using the trained model weights and the latest MoHFW COVID19 data, the state-wise case forecasts are generated and updated daily. We are currently training to forecast cases for three 'look ahead' periods: a day in advance (+1 day), three days in advance (+3 days) and a week in advance (+7 days). The state-wise case forecast uncertainty is reported in the form of standard deviation (±) in the hover panel. Quality of the state-wise forecasting is also evaluated daily using the mean absolute percentage error (MAPE) metric. The state-wise forecasting MAPE can be accessed using the 'Forecast quality' tab in the visualization tool. A lower MAPE means smaller errors were made while forecasting cases, which in-turn translates into a better performing forecasting model.
A key motivation behind the development of this tool is the quote by Daniel Kahneman, the Nobel prize winning economist, at the beginning of this article. In this unprecedented crisis of the COVID19 pandemic, where everything is new, irregular and chaotic, intuitive thinking can often be counter-productive. With the help of data, visual story telling and predictive modeling, we want to help individuals and organizations make better decisions, that rely less on intuition and more on deliberate thinking and evidence.
Significantly, our mission is to help individuals and organizations with better resource management and in reducing some of the societal impact of COVID19. Our approach of case forecasting can help guide a systematic strategy to restore normalcy. With the help of an easy to understand interface, we managed to improve the accessibility of our advanced forecasting techniques to a wider non-technical audience.
Learn more about how this tool was built by visiting our GitHub project page, where we have open-sourced the visualization part of this application.
Read more about applying Bayesian statistics to deep-neural networks by visiting our educational Prezi on this topic.
Since we first launched this COVID19 visualization project in April 2020, we have been continuously updating the forecasts as well as the COVID19 statistics for India and constantly improving the dashboard. This project has been developed and updated by Moad Computer. But, if you find this work compelling, your support matters immensely. Please take a moment and consider supporting this project using the donate button below.
CDR JAYAKRISHNAN N NAIR RTD IN
4/17/2020 10:59:35 am
Can we forecast more than one day, say 3 days, a week... thanks
4/17/2020 12:37:16 pm
Excellent suggestion Jayakrishnan. We have specified a factor in the predictive model called 'look ahead' as 1. This means that we are forecasting for a day in advance. I will push the results soon with a 'look ahead' factor of 3 or 7. I am very excited to experiment with it and could be really informative.
4/18/2020 08:23:37 am
Done! The advanced tab now shows the three days in advance state-wise case forecasts.
Jayakrishnan N Nair
4/18/2020 09:55:50 am
State wise data is available. Can we consolidate for india. So that we can predict for 7/10 days etc.
4/18/2020 11:52:57 am
Consolidating state-wise data into a single prediction for India is very straight forward. We are thinking of ways to display that information. The 7 day state-wise forecasting is also in the works. I will release it soon. I am more than happy to support and extend this application for organizations interested in working with us. Feel free to directly reach out to me: email@example.com
4/19/2020 12:49:19 am
Done! The 7 days in advance case forecasts are working now and can be accessed through the advanced tab.
5/1/2020 01:22:25 am
The nation-wide summary is now available in the visualization tool. Click or tap on the map title and it shows the nation-wide COVID19 case summary and case forecast.
4/20/2020 09:03:52 am
Working with a few partners to develop a model for the US. I want to implement a county-wise prediction model for the US, since the policy levels are more granular there. The algorithm is an ensemble deep-neural network trained on historic data since April 2nd. We are looking ahead 'n' days during the training and use that to generate a prediction using the latest data.
4/20/2020 09:08:45 am
There are no explicit doubling rates being inferred from the data, and there are no hard coded double rates. The historic COVID19 India data is used to 'look ahead'.
Your comment will be posted after it is approved.
Leave a Reply.
Moad Computer is an actionable insights firm. We provide enterprises with end-to-end artificial intelligence solutions. Actionable Insights blog is a quick overview of things we are most excited about.