Emotion Recognition Using Speaker Cues

Emotion Recognition Using Speaker Cues
标题：基于说话人线索的情感识别
作者： Ismail Shahin
链接：https://arxiv.org/abs/2002.03566

This research aims at identifying the unknown emotion using speaker cues. In this study, we identify the unknown emotion using a two-stage framework. The first stage focuses on identifying the speaker who uttered the unknown emotion, while the next stage focuses on identifying the unknown emotion uttered by the recognized speaker in the prior stage. This proposed framework has been evaluated on an Arabic Emirati-accented speech database uttered by fifteen speakers per gender. Mel-Frequency Cepstral Coefficients (MFCCs) have been used as the extracted features and Hidden Markov Model (HMM) has been utilized as the classifier in this work. Our findings demonstrate that emotion recognition accuracy based on the two-stage framework is greater than that based on the one-stage approach and the state-of-the-art classifiers and models such as Gaussian Mixture Model (GMM), Support Vector Machine (SVM), and Vector Quantization (VQ). The average emotion recognition accuracy based on the two-stage approach is 67.5%, while the accuracy reaches to 61.4%, 63.3%, 64.5%, and 61.5%, based on the one-stage approach, GMM, SVM, and VQ, respectively. The achieved results based on the two-stage framework are very close to those attained in subjective assessment by human listeners.
本研究旨在利用说话人的线索来识别未知情绪。在本研究中，我们使用两阶段架构来识别未知情绪。第一阶段主要是识别出说出未知情绪的说话人，而下一阶段则是识别出前一阶段被识别出的说话人说出的未知情绪。该框架已在阿拉伯酋长国口音的语音数据库中进行了评估，每个性别有15名发言者。本文采用Mel频率倒谱系数（MFCCs）作为提取特征，采用隐马尔可夫模型（HMM）作为分类器。研究结果表明，基于两阶段框架的情感识别准确率要高于基于一阶段框架的情感识别准确率和基于高斯混合模型（GMM）、支持向量机（SVM）和矢量量化（VQ）的情感识别准确率。基于两阶段方法的平均情感识别准确率为67.5%，而基于一阶段方法的平均情感识别准确率分别为61.4%、63.3%、64.5%和61.5%。基于两阶段框架的评价结果与人的主观评价结果非常接近。