Cross-Cultural Emotion Recognition and Comparison Using Convolutional Neural Networks Cover Image

Cross-Cultural Emotion Recognition and Comparison Using Convolutional Neural Networks
Cross-Cultural Emotion Recognition and Comparison Using Convolutional Neural Networks

Author(s): Alexander I. Iliev, Ameya Mote, Arjun Manoharan
Subject(s): Library and Information Science, Classification, Education and training, Other
Published by: Институт по математика и информатика - Българска академия на науките
Keywords: Emotion Recognition; Speech Analysis; Language Processing; Convolutional Neural Networks; Cultural Comparison

Summary/Abstract: The paper sets to define a comparison of emotions across 3 different cultures namely Canadian French, Italian, and North American. This was achieved using speech samples for each of the three languages subject to our study. The features used were MFCCs and were passed through convolutional neural network in order to verify their significance for the task of emotion recognition through speech. Three different systems were trained and tested, one for each language. The accuracy came to 71.10%, 79.07%, and 73.89% for each of them respectively. The aim was to prove that the feature vectors we used were representing each emotion well. A comparison across each emotion, gender and language was drawn at the end and it was observed that apart from the emotion neutral, every other emotion was ex-pressed somewhat differently by each culture. Speech is one of the main vehicles to recognize emotions and is an attractive area to be studied with application to presenting and preserving different cultural and scientific heritage.

  • Issue Year: 2020
  • Issue No: X
  • Page Range: 87-101
  • Page Count: 15
  • Language: English