An Automated Approach for Quantifying Emotional Conditions based on Electroencephalogram Signals

Document Type : Original Article (s)

Authors

1 MSc Student, Department of Cognitive Science (Cognitive Psychology), School of New Sciences and Technologies, Semnan University, Semnan, Iran

2 Assistant Professor, Department of Biomedical Engineering, School of Electrical and Computer Engineering, Semnan University, Semnan, Iran

3 Associate Professor, Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran

Abstract

Background: Emotion is a psychological process of the mind. It not only has an important role in human interactions, but also has been the subject of attention in human-computer interactions in recent years. Because of diversity and uncertainty nature of the emotion, as well as the individuals’ inability to accurately and quantitatively express their emotions, a quantitative measure for emotion is needed. To describe different emotional states, we used arousal-valence two-dimensional model of emotion.Methods: To propose an approach for emotion recognition based on fuzzy clustering, individuals’ electroencephalogram signals during watching videos along with self-reports about their emotions were achieved from database for emotion analysis using physiological signals (DEAP). Three features of functional connectivity of the brain including correlation, phase locked value, and coherence were investigated and clustered using fuzzy c-means clustering approach. Finally, according to online rating and clustering results for each feature, quantitative and continuous values for valence and arousal were obtained.Findings: We achieved 0.901 ± 0.079 of valence accuracy and 0.860 ± 0.083 of arousal accuracy. Selected functional connections were related to simultaneous activation of visual, auditory, and sensory perception areas of brain cortex.Conclusion: The accuracy of the results was more than previous studies which were done on emotion recognition based on binary method. In addition, the results indicated that emotion estimation based on coherence had better accuracy than the other investigated features. This results for valence were more than previous studies. The results of this study are applicable in improving human-computer interactions as well as in the area of cognitive rehabilitation.

Keywords

References

  1. Konar A, Chakraborty A. Emotion recognition: A pattern analysis approach. Hoboken, NJ: John Wiley and Sons; 2015.
  2. Koelstra S, Muhl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, et al. DEAP: A database for emotion analysis; using physiological signals. IEEE Trans Affect Comput 2012; 3(1): 18-31.
  3. Guo Y, Gao H. Emotion recognition system in images based on fuzzy neural network and HMM. Proceedings of the 5th IEEE International Conference on Cognitive Informatics; 2006 Jul 17-19; Beijing, China. p. 73-8.
  4. Posner J, Russell JA, Peterson BS. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol 2005; 17(3): 715-34.
  5. Soleymani M, Pantic M, Pun T. Multimodal emotion recognition in response to videos. IEEE Trans Affect Comput 2012; 3(2): 211-23.
  6. Naji M, Firoozabadi M, Azadfallah P. Emotion classification during music listening from forehead biosignals. Signal Image Video Process 2015; 9(6): 1365-75.
  7. Soleymani M, Lichtenauer J, Pun T, Pantic M. A multimodal database for affect recognition and implicit tagging. IEEE Trans Affect Comput 2012; 3(1): 42-55.
  8. Koelstra S, Patras I. Fusion of facial expressions and EEG for implicit affective tagging. Image Vis Comput 2013; 31(2): 164-74.
  9. Lithari C, Klados MA, Bamidis PD. Graph analysis on functional connectivity networks during an emotional paradigm. Proceedings of the 7th Mediterranean Conference on Medical and Biological Engineering and Computing; 2010 May 27-30; Chalkidiki, Greece. Berlin, Germany: Springer; 2010. p. 115-8.
  10. Chen M, Han J, Guo L, Wang J, Patras I. Identifying valence and arousal levels via connectivity between EEG channels. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction; 2015 Sep 21-24; Xi'an, China. p. 63-9.
  11. Niso G, Bruna R, Pereda E, Gutierrez R, Bajo R, Maestu F, et al. HERMES: Towards an integrated toolbox to characterize functional and effective brain connectivity. Neuroinformatics 2013; 11(4): 405-34.
  12. Pourmohammadi S, Maleki A. An automatic approach to continuous stress assessment during driving based on fuzzy c-means clustering. The Modares Journal of Electrical Engineering 2013; 13(1): 9-17.
  13. Chung SY, Yoon HJ. Affective classification using Bayesian classifier and supervised learning. Proceedings of the 12th International Conference on Control, Automation and Systems; 2012 Oct 17-21; JeJu Island, South Korea. p. 1768-71.
  14. Naser DS, Saha G. Recognition of emotions induced by music videos using DT-CWPT. Proceedings of the 2013 Indian Conference on Medical Informatics and Telemedicine; 2013 Mar 28-30; Kharagpur, India: p. 53-7.
  15. Bahari F, Janghorbani A. EEG-based emotion recognition using Recurrence Plot analysis and K nearest neighbor classifier. Proceedings of the 20th Iranian Conference on Biomedical Engineering; 2013 Dec 18-20; Tehran, Iran. p. 228-33.
  16. Torres-Valencia CA, Garcia-Arias HF, Lopez MAA, Orozco-Gutierrez AA. Comparative analysis of physiological signals and electroencephalogram (EEG) for multimodal emotion recognition using generative models. Proceedings of the 19th Symposium on Image, Signal Processing and Artificial Vision 2014 Sep 17-19; Armenia, Colombia. p. 1-5.
  17. Zhuang X, Rozgiç V, Crystal M. Compact unsupervised EEG response representation for emotion recognition. Proceedings of the IEEE-EMBS International Conference on Biomedical and Health Informatics; 2014 June 1-4; Valencia, Spain. p. 736-9.
  18. Singh BK, Verma K, Thoke AS. Fuzzy cluster based neural network classifier for classifying breast tumors in ultrasound images. Expert Systems with Applications 2016; 66(Supplement C): 114-23.
  19. Bastos-Filho TF, Ferreira A, Atencio AC, Arjunan S, Kumar D. Evaluation of feature extraction techniques in emotional state recognition. 2012 p. 1-6.
  20. Nolte J. The human brain: An introduction to its functional anatomy. 6th ed. Philadelphia, PA: Mosby; 2009.
Journal of Isfahan Medical School
Volume 35, Issue 458 - Serial Number 458
November and December 2018
Pages 1732-1737

Files

History

  • Receive Date: 06 September 2017
  • Revise Date: 01 November 2024
  • Accept Date: 06 April 2022

Share

How to cite

Statistics