During COVID-19 outbreak, many people are suffering the negative emotions, causing anxiety, fear, and depression in daily life. To improve the individuals’ mental health, musical therapy will be employed due to its high value of treatment in the mental health field. In our project, a smart empathetic speaker based on real-time emotion recognition system will be developed. Through electroencephalography (EEG) measurement, the types of signals reflecting the listener’s emotion will be extracted. The deep learning method will be used to recognize the emotions of the user in real-time.