Научные статьи \ Общие вопросы науки и культуры \ Информационные технологии. Вычислительная техника. Обработка данных \ Искусственный интеллект

Обзор и анализ подходов и практических областей применения распознавания эмоций человека

Обзор и анализ подходов и практических областей применения распознавания эмоций человека

Автор: Орлов А.А., Миронов М.И., Абрамова Е.С.

Журнал: Вестник Южно-Уральского государственного университета. Серия: Компьютерные технологии, управление, радиоэлектроника @vestnik-susu-ctcr

Рубрика: Информатика и вычислительная техника

Статья в выпуске: 4 т.23, 2023 года.

Бесплатный доступ

Человеческие эмоции сложны и многогранны, что делает их сложными для количественной оценки и анализа. Однако с развитием технологий исследователи изучают возможности использования искусственного интеллекта для лучшего понимания и классификации человеческих эмоций. В частности, нейронные сети становятся все более популярными для распознавания и анализа эмоций благодаря их способности обучаться и адаптироваться на основе больших массивов данных.

Нейронные сети, распознавание эмоций, сбор данных, человеческие эмоции, искусственный интеллект

Короткий адрес: https://sciup.org/147242613

IDR: 147242613   |   УДК: 004.8   |   DOI: 10.14529/ctcr230401

Review and analysis of approaches and practical applications of human emotion recognition

Human emotions are complex and multifaceted, making them difficult to quantify and analyze. However, as technology advances, researchers are exploring the artificial intelligence used to better understand and classify human emotions. In particular, neural networks are becoming increasingly popular for emotion recognition and analysis because of their ability to learn and adapt from large datasets.

Список литературы Обзор и анализ подходов и практических областей применения распознавания эмоций человека

  • Ильин В.И. «Чувства» и «эмоции» как социологические категории // Вестник Санкт-Петербургского университета. Социология. 2016. № 4. C. 28–40. [Ilyin V.I. “Feelings” and “emotions” as sociological categories. Vestnik of Saint Petersburg University. Sociology. 2016;4:28–40. (In Russ.)] DOI: 10.21638/11701/spbu12.2016.402
  • Vizilter Y., Gorbatsevich V., Vorotnikov A., Kostromov N Real-time face identification via multiconvolutional neural network and Boosted Hashing Forest. Advances in Computer Vision and Pattern Recognition. 2017;PartF1:33–55. DOI: 10.1007/978-3-319-61657-5_2
  • Navid M.S., Niazi I.K., Lelic D. et al. Investigating the effects of chiropractic spinal manipulation on EEG in stroke patients. Brain Sciences. 2020;5(10). DOI: 10.3390/brainsci10050253
  • International Neural Network Society; Verband der Elektrotechnik; Institute of Electrical and Electronics Engineers. ANNA’18: Advances in Neural Networks and Applications 2018 September 15–17, 2018, St. St. Konstantin and Elena Resort, Bulgaria. Berlin, Germany: VDE Verlag GmbH; 2018. ISBN 9783800747566.
  • Goshvarpour A., Abbasi A., Goshvarpour A. An Emotion Recognition Approach based on Wavelet Transform and Second-Order Difference Plot of ECG. Journal of AI and Data Mining. 2017;2(5):211–221. DOI: 10.22044/jadm.2017.887
  • Дэвидсон Р., Бегли Ш. Эмоциональная жизнь мозга: пер. с англ. СПб.: Питер, 2017. 256 с. ISBN 978-5-4461-0515-1. [Davidson R.J., Sharon B. The Emotional Life of Your Brain. Hudson Street Press; 2012.].
  • Grandgirard J., Poinsot D., Krespi L. et al. Costs of secondary parasitism in the facultative hyperparasitoid Pachycrepoideus dubius: Does host size matter? Entomologia Experimentalis et Applicata. 2002;3(103):239–248. DOI: 10.1023/A:1021193329749
  • Iqtait M., Mohamad F.S., Mamat M. Feature extraction for face recognition via active shape model (ASM) and active appearance model (AAM). IOP Conference Series: Materials Science and Engineering. 2018. 332(1):012032. DOI: 10.1088/1757-899X/332/1/012032
  • Zafeiriou S., Zhang C., Zhang Z. A survey on face detection in the wild: Past, present and future. Computer Vision and Image Understanding. 2015;138:1–24. DOI: 10.1016/j.cviu.2015.03.015
  • Liu W., Anguelov D., Erhan D., Szegedy C., Reed S., Fu C.-Y., Berg A.C. SSD: single shot multibox detector. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2016;9905:21–37. DOI: 10.1007/978-3-319-46448-0_2
  • Viola P., Jones M. Robust Real-Time Face Detection Intro to Face Detection. International Journal of Computer Vision. 2004;2(57):137–154. DOI: 10.1023/B:VISI.0000013087.49260.fb
  • Azulay A., Weiss Y. Why do deep convolutional networks generalize so poorly to small image transformations? Journal of Machine Learning Research. 2019;20:1–25.
  • Ganga Mohan P., Prakash C., Gangashetty S.V. Bessel transform for image resizing. In: International Conference on Systems, Signals, and Image Processing; 2011. P. 75–78.
  • Owusu E., Abdulai J.-D., Zhan Y. Face detection based on multilayer feed-forward neural network and Haar features. Software: Practice and Experience. 2019;49(1):120–129. DOI: 10.1002/spe.2646
  • Lowe D.G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision. 2004;60(2):91–110. DOI: 10.1023/B:VISI.0000029664.99615.94
  • Tomasi C., Manduchi R. Bilateral Filtering for Gray and Color Images. In: Proceedings of the IEEE International Conference on Computer Vision. Bombay, India; 1998. P. 839–846.
  • Delbracio M., Kelly D., Brown M.S., Milanfar P. Mobile Computational Photography: A Tour. Annual Review of Vision Science. 2021;7:571–604. DOI: 10.1146/annurev-vision-093019-115521
  • Ojala T., Pietikainen M., Maenpaa T. Multi Resolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2002;24(7):971–987. DOI: 10.1109/TPAMI.2002.1017623
  • Horn B.K.P., Schunck B.G. Determining optical flow. Artificial Intelligence. 1981;17(1–3): 185–203. DOI: 10.1016/0004-3702(81)90024-2
  • Zhao J., Mao X., Zhang J. Learning deep facial expression features from image and optical flow sequences using 3D CNN. Visual Computer. 2018;34(10):1461–1475. DOI: 10.1007/ s00371-018-1477-y
  • Li S., Gong D., Yuan Y. Face recognition using Weber local descriptors. Neurocomputing. 2013;122:272–283. DOI: 10.1016/j.neucom.2013.05.038
  • Revina I.M., Emmanuel W.R.S. Face expression recognition using weber local descriptor and F-RBFNN. In: Proc. 2nd International Conference on Intelligent Computing and Control Systems (ICICCS 2018). Madurai, India; 2018. P. 196–199. DOI: 10.1109/ICCONS.2018.8662891
  • Peng Z. et al. Conformer: Local Features Coupling Global Representations for Visual Recognition. In: Proceedings of the IEEE International Conference on Computer Vision; 2021. P. 357–366. DOI: 10.1109/ICCV48922.2021.00042
  • Бобе А.С., Конышев Д.В., Воротников С.А. Система распознавания базовых эмоций на основе анализа двигательных единиц лица // Инженерный журнал: наука и инновации. 2016. № 9 (57). С. 7. [Bobe A.S., Konyshev D.V., Vorotnikov S.A. Emotion recognition system based on the facial motor units’ analysis. Engineering Journal: Science and Innovation. 2016; 9(57):7. (In Russ.)] DOI: 10.18698/2308-6033-2016-9-1530
  • Martínez A.M., Kak A.C. PCA versus LDA. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2001;23(2):228–233. DOI: 10.1109/34.908974
  • Lyons M.J., Kamachi M.G., Gyoba J. The Japanese Female Facial Expression (JAFFE) Dataset. 1998. [Electronic resource] (accessed 19.12.2022).
  • Perikos I., Ziakopoulos E., Hatzilygeroudis I. Recognize Emotions from Facial Expressions Using a SVM and Neural Network Schema. In: Engineering Applications of Neural Networks. EANN 2015. Communications in Computer and Information Science, vol 517. Springer, Cham.; 2015. DOI: 10.1007/978-3-319-23983-5_25
  • Komala K. Human Emotion Detection and Classification Using Convolution Neural Network. European Journal of Molecular and Clinical Medicine. 2020; 6(7):237–245.
  • Lucey P., Cohn J.F., Kanade T., Saragih J., Ambadar Z., Matthews I. The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition – Workshops, San Francisco, CA, USA; 2010. P. 94–101. DOI: 10.1109/CVPRW.2010.5543262
  • An F., Liu Z. Facial expression recognition algorithm based on parameter adaptive initialization of CNN and LSTM. Visual Computer. 2020;36(3):483–498. DOI: 10.1007/s00371-019-01635-4
  • Challenges in Representation Learning Facial Expression Recognition Challenge [Electronic resource]. Available at: https://www.kaggle.com/c/challenges-in-representation-learning-facial-expressionrecognition-challenge (accessed 19.12.2022).
  • Cao T., Li M. Facial Expression Recognition Algorithm Based on the Combination of CNN and K-Means. In: Proc. 11th International Conference on Machine Learning and Computing (ICMLC 2019); 2019. P. 400–404. DOI: 10.1145/3318299.3318344
  • Connie T., Al-Shabi M., Cheah W.P., Goh M. Facial Expression Recognition Using a Hybrid CNN-SIFT Aggregator. In: Conference: International Workshop on Multi-disciplinary Trends in Artificial Intelligence. 2017. DOI: 10.1007/978-3-319-69456-6_12
  • Springenberg J.T., Dosovitskiy A., Brox T., Riedmiller M. Striving for simplicity: The all convolutional net. In: 3rd International Conference on Learning Representations, ICLR 2015 – Workshop Track Proceedings; 2015. P. 1–14.
  • Sokolova M., Lapalme G. A systematic analysis of performance measures for classification tasks. Information Processing and Management. 2009;4(45):427–437. DOI: 10.1016/j.ipm.2009.03.002
  • Ахметшин Р.И., Кирпичников А.П., Шлеймович М.П. Распознавание эмоций человека на изображениях // Вестник технологического университета. 2015. Т. 18, № 11. С. 160−163. [Akhmetshin R.I., Kirpichnikov A.P., Shleymovich M.P. [Recognizing human emotions from images]. Herald of technological university. 2015;18(11):160−163. (In Russ.)].
  • Perkins R. Neural Networks Model Audience Reactions to Movies. Caltech: website. Available at: https://www.caltech.edu/about/news/neural-networks-model-audience-reactions-movies-79098 (accessed 15.02.2023).
  • Affectiva: website. Available at: https://www.affectiva.com/success-story/flying-mollusk/ (accessed 15.12.2022).
  • Talele A.K., Chourasia B. Student’s Emotions Identification Using CNN. International Journal of Advanced Research in Engineering and Technology (IJARET). 2020;11(11):1426–1434. DOI: 10.34218/IJARET.11.11.2020.130
  • Кирпичников А.П., Ляшева С.А., Шлеймович М.П. Обнаружение и сопровождение людей в интеллектуальных детекторах внештатных ситуаций // Вестник Казанского технологического университета. 2014. Т. 17, № 21. С. 351–356. [Kirpichnikov A.P., Lyasheva S.А., Shleymovich М.P. [Detection and tracking of people in intelligent detectors of emergency situations]. Bulletin of Kazan Technological University. 2014;17(21):351–356. (In Russ.)]
Еще
QR-код для установки приложения SciUp Наведите камеру и скачайте бесплатное приложение SciUp