Pandemic masks

a review systematics on the impacts of the mask on recognition of emotions

Authors

DOI:

https://doi.org/10.1590/1983-3652.2023.41598

Keywords:

Mask, Emotion, Recognition, Experiment

Abstract

The use of pandemic masks is one of the main behavioral changes brought about by the COVID-19 pandemic, which has possibly hampered the Facial Emotion Recognition (FER). This systematic review aims to gather and compare methodologies and results of experiments, published between 2019 and 2022, that assess the impact of pandemic masks on FER. Therefore, this study has been based and divided on the PRISMA recommendations, in three stages: identification, screening, and eligibility. The first step was dedicated to the choice of descriptors, the time frame and their application in the chosen databases. In the second step, titles, abstracts, and keywords were read to select articles that meet the inclusion criteria. The articles selected at this stage were placed on the Connected Papers platform, in order to explore unidentified references via databases. In the last phase, the full reading and the synthesis of the studies were carried out. Finally, 11 articles have been elected, whose results showed that pandemic masks harm the FER in a heterogeneous way. Expressions such as happiness and disgust, which depend on the region of the mouth to be discriminated, are harmed. Sadness is also undermined by pandemic masks, often getting confused with neutral faces and vice versa. For the findings to be more generalizable, future studies need to adopt standardized tasks with all basic expressions and include non-basic expressions such as shame. In addition, the implementation of dynamic stimuli with ethnic variation and control over exposure time are recommended.

Downloads

Download data is not yet available.

References

BANI, Marco et al. Behind the Mask: Emotion Recognition in Healthcare Students. en. Medical Science Educator, v. 31, n. 4, p. 1273–1277, ago. 2021. ISSN 2156-8650. DOI: 10.1007/s40670-021-01317-8. Disponível em: https://link.springer.com/10.1007/s40670-021-01317-8. Acesso em: 11 nov. 2021.

BRASIL, Ministério da Saúde. Lei nº 14.019, de 2 de julho de 2020. Dispõe sobre a obrigatoriedade do uso de máscaras de proteção individual. [S.l.: s.n.], 2020. Disponível em: https://www.in.gov.br/en/web/dou/-/lei-n-14.019-de-2-de-julho-de-2020-264918074. Acesso em: 1 mai. 2022.

BRASIL, Ministério da Saúde. Anvisa atualiza medidas de proteção a serem adotadas em aeroportos e aeronaves. [S.l.: s.n.], 2022. Disponível em: https://www.gov.br/anvisa/pt-br/assuntos/noticias-anvisa/2022/anvisa-atualiza-medidas-de-protecao-a-serem-adotadas-em-aeroportos-e-aeronaves. Acesso em: 1 mai. 2022.

CALBI, Marta et al. The consequences of COVID-19 on social interactions: an online study on face covering. Scientific Reports, v. 11, n. 1, p. 2601, dez. 2021. ISSN 2045-2322. DOI: 10.1038/s41598-021-81780-w. Disponível em: http://www.nature.com/articles/s41598-021-81780-w. Acesso em: 11 nov. 2021.

CALVO, Manuel G.; FERNÁNDEZ-MARTÍN, Andrés; NUMMENMAA, Lauri. Facial expression recognition in peripheral versus central vision: role of the eyes and the mouth. en. Psychological Research, v. 78, n. 2, p. 180–195, mar. 2014. ISSN 0340-0727, 1430-2772. DOI: 10.1007/s00426-013-0492-x. Disponível em: http://link.springer.com/10.1007/s00426-013-0492-x. Acesso em: 9 mai. 2022.

CALVO, Manuel G.; LUNDQVIST, Daniel. Facial expressions of emotion (KDEF): Identification under different display-duration conditions. en. Behavior Research Methods, v. 40, n. 1, p. 109–115, fev. 2008. ISSN 1554-351X, 1554-3528. DOI: 10.3758/BRM.40.1.109. Disponível em: http://link.springer.com/10.3758/BRM.40.1.109. Acesso em: 9 mai. 2022.

CARBON, Claus-Christian. Wearing Face Masks Strongly Confuses Counterparts in Reading Emotions. en. Frontiers in Psychology, v. 11, p. 566886, set. 2020. ISSN 1664-1078. DOI: 10.3389/fpsyg.2020.566886. Disponível em: https://www.frontiersin.org/article/10.3389/fpsyg.2020.566886/full. Acesso em: 11 nov. 2021.

CARBON, Claus-Christian; SERRANO, Martin. The Impact of Face Masks on the Emotional Reading Abilities of Children—A Lesson From a Joint School–University Project. en. i-Perception, v. 12, n. 4, p. 204166952110382, jul. 2021. ISSN 2041-6695, 2041-6695. DOI: 10.1177/20416695211038265. Disponível em: http://journals.sagepub.com/doi/10.1177/20416695211038265. Acesso em: 11 nov. 2021.

CHEN, Zhaochun et al. Extremely potent monoclonal antibodies neutralize Omicron and other SARS-CoV-2 variants. en. [S.l.], jan. 2022. DOI: 10.1101/2022.01.12.22269023. Disponível em: http://medrxiv.org/lookup/doi/10.1101/2022.01.12.22269023. Acesso em: 20 out. 2022.

CORTEZ, Rosalinda de Jesus. O papel da idade na capacidade de reconhecimento emocional: uma revisão sistemática da literatura. 2021. Tese (Doutorado) – Universidade Lusófona do Porto, Porto.

DARWIN, Charles. The expression of the emotions in man and animals. London, England: Oxford University, 1872. v. 1. ISBN 0-19-515806-2. Acesso em: 4 fev. 2022.

DONATO, G. et al. Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence, v. 21, n. 10, p. 974–989, out. 1999. ISSN 01628828. DOI: 10.1109/34.799905. Disponível em: http://ieeexplore.ieee.org/document/799905/. Acesso em: 22 out. 2022.

DU, Shichuan; TAO, Yong; MARTINEZ, Aleix M. Compound facial expressions of emotion. en. Proceedings of the National Academy of Sciences, v. 111, n. 15, abr. 2014. ISSN 0027-8424, 1091-6490. DOI: 10.1073/pnas.1322355111. Disponível em: https://pnas.org/doi/full/10.1073/pnas.1322355111. Acesso em: 8 mai. 2022.

EBNER, Natalie C.; RIEDIGER, Michaela; LINDENBERGER, Ulman. FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation. en. Behavior Research Methods, v. 42, n. 1, p. 351–362, fev. 2010. ISSN 1554-351X, 1554-3528. DOI: 10.3758/BRM.42.1.351. Disponível em: http://link.springer.com/10.3758/BRM.42.1.351. Acesso em: 23 out. 2022.

EKMAN, Paul. The argument and evidence about universals in facial expressions. In: HANDBOOK of Social Psychophysiology. [S.l.]: John Wiley & Sons, 1989.

EKMAN, Paul. An argument for basic emotions. en. Cognition and Emotion, v. 6, n. 3-4, p. 169–200, mai. 1992. ISSN 0269-9931, 1464-0600. DOI: 10.1080/02699939208411068. Disponível em: https://www.tandfonline.com/doi/full/10.1080/02699939208411068. Acesso em: 22 out. 2022.

EKMAN, Paul. The facial action coding system. Salt Lake City: Research Nexus eBook, 2002.

EKMAN, Paul; FRIESEN, Wallace. Pictures of facial affect. [S.l.]: Consulting Psychologists Press., 1976.

FERGUSON, N et al. Report 9: Impact of non-pharmaceutical interventions (NPIs) to reduce COVID19 mortality and healthcare demand. [S.l.], mar. 2020. DOI: 10.25561/77482. Disponível em: http://spiral.imperial.ac.uk/handle/10044/1/77482. Acesso em: 16 mai. 2022.

FREUD, Erez et al. The COVID-19 pandemic masks the way people perceive faces. en. Scientific Reports, v. 10, n. 1, p. 22344, dez. 2020. ISSN 2045-2322. DOI: 10.1038/s41598-020-78986-9. Disponível em: http://www.nature.com/articles/s41598-020-78986-9. Acesso em: 21 out. 2022.

GALVÃO, Maria Cristiane Barbosa; RICARTE, Ivan Luiz Marques. Revisão Sistemática da Literatura: conceituação, produção e Publicação. Logeion: Filosofia da Informação, v. 6, n. 1, p. 57–73, set. 2019. ISSN 2358-7806. DOI: 10.21728/logeion.2019v6n1.p57-73. Disponível em: http://revista.ibict.br/fiinf/article/view/4835. Acesso em: 20 out. 2022.

GORI, Monica; SCHIATTI, Lucia; AMADEO, Maria Bianca. Masking Emotions: Face Masks Impair How We Read Emotions. pt. Frontiers in Psychology, v. 12, p. 669432, mai. 2021. ISSN 1664-1078. DOI: 10.3389/fpsyg.2021.669432. Disponível em: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.669432/full. Acesso em: 11 nov. 2021.

GRUNDMANN, Felix; EPSTUDE, Kai; SCHEIBE, Susanne. Face masks reduce emotion-recognition accuracy and perceived closeness. en. [S.l.], out. 2020. DOI: 10.31234/osf.io/xpzs3. Disponível em: https://osf.io/xpzs3. Acesso em: 11 nov. 2021.

KANG, Jungsuk et al. Age and Cultural Differences in Recognitions of Emotions from Masked Faces among Koreans and Americans. en. International Journal of Environmental Research and Public Health, v. 18, n. 19, p. 10555, out. 2021. ISSN 1660-4601. DOI: 10.3390/ijerph181910555. Disponível em: https://www.mdpi.com/1660-4601/18/19/10555. Acesso em: 11 nov. 2021.

KOVÁCS, Petra et al. Face inversion reveals holistic processing of peripheral faces. en. Cortex, v. 97, p. 81–95, dez. 2017. ISSN 00109452. DOI: 10.1016/j.cortex.2017.09.020. Disponível em: https://linkinghub.elsevier.com/retrieve/pii/S001094521730326X. Acesso em: 20 out. 2022.

KRET, Mariska E.; FISCHER, Agneta H. Recognition of facial expressions is moderated by Islamic cues. en. Cognition and Emotion, v. 32, n. 3, p. 623–631, abr. 2018. ISSN 0269-9931, 1464-0600. DOI: 10.1080/02699931.2017.1330253. Disponível em: https://www.tandfonline.com/doi/full/10.1080/02699931.2017.1330253. Acesso em: 12 mai. 2022.

LEPPÄNEN, Jukka M. et al. Depression biases the recognition of emotionally neutral faces. en. Psychiatry Research, v. 128, n. 2, p. 123–133, set. 2004. ISSN 01651781. DOI: 10.1016/j.psychres.2004.05.020. Disponível em: https://linkinghub.elsevier.com/retrieve/pii/S0165178104001362. Acesso em: 20 out. 2022.

MARINI, Marco et al. The impact of facemasks on emotion recognition, trust attribution and re-identification. en. Scientific Reports, v. 11, n. 1, p. 5577, dez. 2021. ISSN 2045-2322. DOI: 10.1038/s41598-021-84806-5. Disponível em: http://www.nature.com/articles/s41598-021-84806-5. Acesso em: 21 out. 2022.

MATSUMOTO, David et al. Facial Expressions of Emotion. In: HANDBOOK of Emotions. 3. ed. United States of America: [s.n.], 2008. v. 5. ISBN 978-1-59385-650-2. Disponível em: https://psycnet.apa.org/record/2008-07784-013. Acesso em: 4 abr. 2022.

NOYES, Eilidh et al. The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers. en. Royal Society Open Science, v. 8, n. 3, rsos.201169, 201169, mar. 2021. ISSN 2054-5703. DOI: 10.1098/rsos.201169. Disponível em: https://royalsocietypublishing.org/doi/10.1098/rsos.201169. Acesso em: 21 out. 2022.

PARADA-FERNÁNDEZ, Pamela et al. Wearing mask hinders emotion recognition, but enhances perception of attractiveness. en. Personality and Individual Differences, v. 184, p. 111195, jan. 2022. ISSN 01918869. DOI: 10.1016/j.paid.2021.111195. Disponível em: https://linkinghub.elsevier.com/retrieve/pii/S0191886921005742. Acesso em: 11 nov. 2021.

PAZHOOHI, Farid; FORBY, Leilani; KINGSTONE, Alan. Facial masks affect emotion recognition in the general population and individuals with autistic traits. en. Edição: Marina A. Pavlova. PLOS ONE, v. 16, n. 9, e0257740, set. 2021. ISSN 1932-6203. DOI: 10.1371/journal.pone.0257740. Disponível em: https://dx.plos.org/10.1371/journal.pone.0257740. Acesso em: 11 nov. 2021.

RAMACHANDRA, Vijayachandra; LONGACRE, Hannah. Unmasking the psychology of recognizing emotions of people wearing masks: The role of empathizing, systemizing, and autistic traits. en. Personality and Individual Differences, v. 185, p. 111249, fev. 2022. ISSN 01918869. DOI: 10.1016/j.paid.2021.111249. Disponível em: https://linkinghub.elsevier.com/retrieve/pii/S0191886921006280. Acesso em: 11 nov. 2021.

RUBA, Ashley L.; POLLAK, Seth D. Children’s emotion inferences from masked faces: Implications for social interactions during COVID-19. en. Edição: Zezhi Li. PLOS ONE, v. 15, n. 12, e0243708, dez. 2020. ISSN 1932-6203. DOI: 10.1371/journal.pone.0243708. Disponível em: https://dx.plos.org/10.1371/journal.pone.0243708. Acesso em: 21 out. 2022.

RUSSELL, James A. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. en. Psychological Bulletin, v. 115, n. 1, p. 102–141, 1994. ISSN 1939-1455, 0033-2909. DOI: 10.1037/0033-2909.115.1.102. Disponível em: http://doi.apa.org/getdoi.cfm?doi=10.1037/0033-2909.115.1.102. Acesso em: 12 mai. 2022.

SMITH, Marie L. et al. Transmitting and Decoding Facial Expressions. en. Psychological Science, v. 16, n. 3, p. 184–189, mar. 2005. ISSN 0956-7976, 1467-9280. DOI: 10.1111/j.0956-7976.2005.00801.x. Disponível em: http://journals.sagepub.com/doi/10.1111/j.0956-7976.2005.00801.x. Acesso em: 20 out. 2022.

SOUSA, Cristina. Emoções e expressão facial: Novos desafios. PSICOLOGIA, v. 24, n. 2, p. 17, jan. 2010. ISSN 2183-2471, 0874-2049. DOI: 10.17575/rpsicol.v24i2.303. Disponível em: http://revista.appsicologia.org/index.php/rpsicologia/article/view/303. Acesso em: 22 out. 2022.

TEJADA, Julian et al. Building and validation of a set of facial expression images to detect emotions: a transcultural study. en. Psychological Research, v. 86, n. 6, p. 1996–2006, set. 2022. ISSN 0340-0727, 1430-2772. DOI: 10.1007/s00426-021-01605-3. Disponível em: https://link.springer.com/10.1007/s00426-021-01605-3. Acesso em: 20 out. 2022.

TOOBY, John; COSMIDES, Leda. The evolutionary psychology of the emotions and their relationship to internal regulatory variables. In: HANDBOOK of emotions, 3rd ed. New York, NY, US: The Guilford Press, 2008. p. 114–137. ISBN 1-59385-650-4 (Hardcover); 978-1-59385-650-2 (Hardcover).

USP, Unicamp e Unesp mantêm obrigatoriedade das máscaras. CARTA CAPITAL, mar. 2022. Disponível em: https://www.cartacapital.com.br/cartaexpressa/usp-unicamp-e-unesp-mantem-obrigatoriedade-das-mascaras/amp/. Acesso em: 1 mai. 2022.

VASCONCELLOS, Silvio José Lemos et al. Psicopatia e Reconhecimento de Expressões Faciais de Emoções: Uma Revisão Sistemática. Psicologia: Teoria e Pesquisa, v. 30, n. 2, p. 125–134, jun. 2014. ISSN 0102-3772. DOI: 10.1590/S0102-37722014000200001. Disponível em: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-37722014000200001&lng=pt&tlng=pt. Acesso em: 20 out. 2022.

WEGRZYN, Martin et al. Mapping the emotional face. How individual face parts contribute to successful emotion recognition. en. Edição: Marina A. Pavlova. PLOS ONE, v. 12, n. 5, e0177239, mai. 2017. ISSN 1932-6203. DOI: 10.1371/journal.pone.0177239. Disponível em: https://dx.plos.org/10.1371/journal.pone.0177239. Acesso em: 20 out. 2022

Published

2023-02-27

How to Cite

DANTAS, T. .; TEJADA, J.; FREITAG, R. M. K. Pandemic masks: a review systematics on the impacts of the mask on recognition of emotions. Texto Livre, Belo Horizonte-MG, v. 16, p. e41598, 2023. DOI: 10.1590/1983-3652.2023.41598. Disponível em: https://periodicos.ufmg.br/index.php/textolivre/article/view/41598. Acesso em: 27 sep. 2024.