Emotion and Virtual SpaceFrom very short introduction to production
Yajing FENG
Ph.D. student in Affective Computing
Paris-Saclay University
What are emotions?
To understand the nature of emotions, a curious person posed several questions to five researchers ...
How can emotions be measured?
- Pupil dilation (Eye Tracking)
- Skin conductance (EDA/GSR)
- Brain activity (EEG, fMRI)
- Heart rate (ECG)
- Facial expressions
- Speech (Voice and Text)
- Body motion, Gesture, and Posture
- ...
Virtual emotional space
Our emotions are influenced by the physical and social living environment. The growing social problems have caused various mental health issues.
In this emotional space in virtual reality, scenes are generated according to the emotional states of the user. The user can also interact with the space and modify it with diverse commands.
The user's experience in the space aims at providing the possibility for him/her to be more aware of his/her emotions.
Merci !
I would like to thank CIH LMU -Team for giving this extraordinary class in digital storytelling, Hannah Low for her valuable advice, and classmates who gave me feedback.
Also, many friends have helped me in achieving this project.
I especially appreciate Lise Michard for sharing her plentiful experience in art therapy, which is the first inspiration for interaction design in the virtual space; Yue Kong, for her amazing customized tutorial in neuroscience; Jade Liu, for all the late-night discussions on interactive space design and social phenomenons.
Last but not least, ShangXiao Long, to whom I'm incredibly grateful, for her company, consistent support, exemplary patience, and magic of turning ideas into pleasant visual presentations; without whom, this emotional virtual space wouldn't be possible.
Also, many friends have helped me in achieving this project.
I especially appreciate Lise Michard for sharing her plentiful experience in art therapy, which is the first inspiration for interaction design in the virtual space; Yue Kong, for her amazing customized tutorial in neuroscience; Jade Liu, for all the late-night discussions on interactive space design and social phenomenons.
Last but not least, ShangXiao Long, to whom I'm incredibly grateful, for her company, consistent support, exemplary patience, and magic of turning ideas into pleasant visual presentations; without whom, this emotional virtual space wouldn't be possible.
References
A. Naz, R. Kopper, R. P. McMahan and M. Nadin, "Emotional qualities of VR space," 2017 IEEE Virtual Reality (VR), 2017, pp. 3-11, doi: 10.1109/VR.2017.7892225.
Avishag Shemesh, Gerry Leisman, Moshe Bar & Yasha Jacob Grobman (2021): A neurocognitive study of the emotional impact of geometrical criteria of architectural space, Architectural Science Review, DOI: 10.1080/00038628.2021.1940827
Bechara, A., Damasio, H., & Damasio, A. (2000). Emotion, Decision Making and the Orbitofrontal Cortex. Cerebral Cortex, 10(3), 295-307. doi: 10.1093/cercor/10.3.295
Darwin, Charles, Phillip Prodger(1998). The expression of the emotions in man and animals. Oxford University Press, USA.
Dixon ML, Thiruchselvam R, Todd R, Christoff K. Emotion and the prefrontal cortex: An integrative review. Psychol Bull. 2017 Oct;143(10):1033-1081. doi: 10.1037/bul0000096.
Eslinger, P. J., Anders, S., Ballarini, T., Boutros, S., Krach, S., Mayer, A. V., Moll, J., Newton, T. L., Schroeter, M. L., de Oliveira-Souza, R., Raber, J., Sullivan, G. B., Swain, J. E., Lowe, L., & Zahn, R. (2021). The neuroscience of social feelings: mechanisms of adaptive social functioning. Neuroscience and biobehavioral reviews, 128, 592–620. https://doi.org/10.1016/j.neubiorev.2021.05.028
Graham, L. T., Gosling, S. D., & Travis, C. K. (2015). The psychology of home environments: A call for research on residential space. Perspectives on Psychological Science, 10(3), 346–356. https://doi.org/10.1177/1745691615576761
James, W. (1884). What is an Emotion? Mind, 9(34), 188–205.
Khalsa SS, Adolphs R, Cameron OG, Critchley HD, Davenport PW, Feinstein JS, Feusner JD, Garfinkel SN, Lane RD, Mehling WE, Meuret AE, Nemeroff CB, Oppenheimer S, Petzschner FH, Pollatos O, Rhudy JL, Schramm LP, Simmons WK, Stein MB, Stephan KE, Van den Bergh O, Van Diest I, von Leupoldt A, Paulus MP; Interoception Summit 2016 participants. Interoception and Mental Health: A Roadmap. Biol Psychiatry Cogn Neurosci Neuroimaging. 2018 Jun;3(6):501-513. doi: 10.1016/j.bpsc.2017.12.004. Epub 2017 Dec 28.
Lazarus, R. S. (1991). Emotion and adaptation. New York: Oxford University Press.
Levenson RW. Stress and Illness: A Role for Specific Emotions. Psychosom Med. 2019 Oct;81(8):720-730. doi: 10.1097/PSY.0000000000000736.
Lindquist KA, Wager TD, Kober H, Bliss-Moreau E, Barrett LF. The brain basis of emotion: a meta-analytic review. Behav Brain Sci. 2012 Jun;35(3):121-43. doi: 10.1017/S0140525X11000446.
Margolis, Eric, Richard Samuels, and Stephen P. Stich (2012), The Oxford Handbook of Philosophy of Cognitive Science, Oxford Handbooks. https://doi.org/10.1093/oxfordhb/9780195309799.001.0001.
Mauss IB, Robinson MD. Measures of emotion: A review. Cogn Emot. 2009 Feb 1;23(2):209-237. doi: 10.1080/02699930802204677.
Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
Russell J. A. (2003). Core affect and the psychological construction of emotion. Psychological review, 110(1), 145–172. https://doi.org/10.1037/0033-295x.110.1.145
Scherer, K. R.(2000) Emotion. In M.Hewstone & W. Stroebe. Introduction to Social Psychology: A European perspective (3rd. ed., pp. 151-191). Oxford: Blackwell
Scherer, K. R. (2005). What are emotions? And how can they be measured?. Social science information, 44(4), 695-729.
Avishag Shemesh, Gerry Leisman, Moshe Bar & Yasha Jacob Grobman (2021): A neurocognitive study of the emotional impact of geometrical criteria of architectural space, Architectural Science Review, DOI: 10.1080/00038628.2021.1940827
Bechara, A., Damasio, H., & Damasio, A. (2000). Emotion, Decision Making and the Orbitofrontal Cortex. Cerebral Cortex, 10(3), 295-307. doi: 10.1093/cercor/10.3.295
Darwin, Charles, Phillip Prodger(1998). The expression of the emotions in man and animals. Oxford University Press, USA.
Dixon ML, Thiruchselvam R, Todd R, Christoff K. Emotion and the prefrontal cortex: An integrative review. Psychol Bull. 2017 Oct;143(10):1033-1081. doi: 10.1037/bul0000096.
Eslinger, P. J., Anders, S., Ballarini, T., Boutros, S., Krach, S., Mayer, A. V., Moll, J., Newton, T. L., Schroeter, M. L., de Oliveira-Souza, R., Raber, J., Sullivan, G. B., Swain, J. E., Lowe, L., & Zahn, R. (2021). The neuroscience of social feelings: mechanisms of adaptive social functioning. Neuroscience and biobehavioral reviews, 128, 592–620. https://doi.org/10.1016/j.neubiorev.2021.05.028
Graham, L. T., Gosling, S. D., & Travis, C. K. (2015). The psychology of home environments: A call for research on residential space. Perspectives on Psychological Science, 10(3), 346–356. https://doi.org/10.1177/1745691615576761
James, W. (1884). What is an Emotion? Mind, 9(34), 188–205.
Khalsa SS, Adolphs R, Cameron OG, Critchley HD, Davenport PW, Feinstein JS, Feusner JD, Garfinkel SN, Lane RD, Mehling WE, Meuret AE, Nemeroff CB, Oppenheimer S, Petzschner FH, Pollatos O, Rhudy JL, Schramm LP, Simmons WK, Stein MB, Stephan KE, Van den Bergh O, Van Diest I, von Leupoldt A, Paulus MP; Interoception Summit 2016 participants. Interoception and Mental Health: A Roadmap. Biol Psychiatry Cogn Neurosci Neuroimaging. 2018 Jun;3(6):501-513. doi: 10.1016/j.bpsc.2017.12.004. Epub 2017 Dec 28.
Lazarus, R. S. (1991). Emotion and adaptation. New York: Oxford University Press.
Levenson RW. Stress and Illness: A Role for Specific Emotions. Psychosom Med. 2019 Oct;81(8):720-730. doi: 10.1097/PSY.0000000000000736.
Lindquist KA, Wager TD, Kober H, Bliss-Moreau E, Barrett LF. The brain basis of emotion: a meta-analytic review. Behav Brain Sci. 2012 Jun;35(3):121-43. doi: 10.1017/S0140525X11000446.
Margolis, Eric, Richard Samuels, and Stephen P. Stich (2012), The Oxford Handbook of Philosophy of Cognitive Science, Oxford Handbooks. https://doi.org/10.1093/oxfordhb/9780195309799.001.0001.
Mauss IB, Robinson MD. Measures of emotion: A review. Cogn Emot. 2009 Feb 1;23(2):209-237. doi: 10.1080/02699930802204677.
Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
Russell J. A. (2003). Core affect and the psychological construction of emotion. Psychological review, 110(1), 145–172. https://doi.org/10.1037/0033-295x.110.1.145
Scherer, K. R.(2000) Emotion. In M.Hewstone & W. Stroebe. Introduction to Social Psychology: A European perspective (3rd. ed., pp. 151-191). Oxford: Blackwell
Scherer, K. R. (2005). What are emotions? And how can they be measured?. Social science information, 44(4), 695-729.
Scroll down to continue
Swipe to continue
Swipe to continue
Emotion and Virtual Space
How can emotions be measured?
Virtual emotional space
Merci !
References
