How to measure and evaluate the emotional reactions that result from human interaction.

Besides concerns of design with functionality and utility, users also have emotional needs. It is now current knowledge that emotion plays a fundamental role in human decision process. Thus design process must include tools to evaluate emotions in interactions with objects in the world.

In ErgoUX we have been using several tools to investigate emotional processes during interactions with several technologies such as games, technical aids for people with disabilities , disruptive vehicles like a bicycle with elliptical wheels, or new trendy technologies like virtual reality.

Some developed projects in this area

• Face Reading Tool to a Digital Game¹
  

Abstract

Nowadays, the face reading technology could be a good solution to evaluate digital games or to be integrated in a user centered design process. The big advantages of this technology is the possibility to get direct measures in non-intrusive way, don’t require a special computer and use a normal camera. In the literature, most studies use this technology in the context of neuromarketing, few studies use it in the context of gamming. In this context, this paper presents an exploratory study to analyse the potentialities of a face-reading tool to measure the emotional reactions, when the user plays a digital game. The aspects evaluated were the sensitivity of the tool at the different moments of the game, and to identification of usability problems. Our results show that the tool was effective in the evaluation of these aspects, allowing the identification of moments of the game where it is necessary to increase or not the emotions and develop a other studies to improve the usability problems.

¹ Trindade Y., Rebelo F., Noriega P. (2018) Potentialities of a Face Reading Tool to a Digital Game Evaluation and Development: A Preliminary Study. In: Rebelo F., Soares M. (eds) Advances in Ergonomics in Design. AHFE 2017. Advances in Intelligent Systems and Computing, vol 588. Springer, Cham

Trindade Y., Rebelo F., Noriega P. (2019) Emotions Appraisal with Face Reading in a Touristic Virtual Environment Prototype. In: Rebelo F., Soares M. (eds) Advances in Ergonomics in Design. AHFE 2018. Advances in Intelligent Systems and Computing, vol 777. Springer, Cham

• ELIP Project²

Abstract

• Emotional Reactions to Different Wheelchairs Designs³

Abstract

The emotional reactions caused during the interaction with a product interfered in the evaluation by the user. For the assistive technologies, like the wheelchairs, there is a range of emotional reactions associated with the image of disease, despite the importance of these products for the independence of the people. Many studies about wheelchairs focused in biomechanical and functional aspects, without emphasis in other aspects of the user experience with these products. In this context, the aim of this work is to evaluate if the wheelchair with different design features provoke different emotional reactions in users and non-users of this assistive technology. Geneva Emotional Wheel was applied to 30 people wheelchair users and 30 people wheelchair non-users during a video with two wheelchairs in a virtual environment 3D. The results indicate that a wheelchair with a modern design causes more positive emotional reactions than a wheelchair with traditional design. It is considered these results can cooperate with wheelchair designers, as well as in health services in the context of prescription of this assistive technology.

³ Carneiro L., Rebelo F., Noriega P. (2019) Different Wheelchairs Designs Influence Emotional Reactions from Users and Non-users?. In: Rebelo F., Soares M. (eds) Advances in Ergonomics in Design. AHFE 2018. Advances in Intelligent Systems and Computing, vol 777. Springer, Cham

• Evaluation of the Relationship Between Virtual Environments and Emotions⁴

Abstract

This study describes the emotional responses to the use of virtual reality (VR) environments. Namely the relation between different environments and axial emotional dimensions: valence, arousal and dominance. To better understand this relation, were also evaluated presence, concentration, relaxation. We evaluated the experience of 146 participants in three virtual environments: Helix^® (a roller coaster experience); Yana^® (a beach sunset/sunrise experience); Surge^® (an abstract environment transformation experience). Helix^® proved to be a facilitator of presence and arousal. Surge^® results are like the Helix^® except that levels of relaxation are lower. Yana^® is a facilitator of dominance but levels of arousal and presence was the lowest of the three. The presence was positively related with arousal. Relaxation had a negative relation with arousal and presence. The emotional appraisals were different for each environment. These results are useful in developing virtual environments to model emotional experience.

⁴ Oliveira T., Noriega P., Rebelo F., Heidrich R. (2018) Evaluation of the Relationship Between Virtual Environments and Emotions. In: Rebelo F., Soares M. (eds) Advances in Ergonomics in Design. AHFE 2017. Advances in Intelligent Systems and Computing, vol 588. Springer, Cham

Oliveira T., Noriega P., Carvalhais J., Rebelo F., Lameira V. (2020) How Deep Is a Virtual Reality Experience? Virtual Environments, Emotions and Physiological Measures. In: Rebelo F., Soares M. (eds) Advances in Ergonomics in Design. AHFE 2019. Advances in Intelligent Systems and Computing, vol 955. Springer, Cham

Virtual Reality (VR) is a way of transporting a person to a reality (i.e., a virtual environment) in which he or she is not physically present but feels like he or she is there¹.

¹ Rebelo, F., Noriega, P., Duarte, E., & Soares, M. (2012). Using virtual reality to assess user experience. Human Factors, 54(6), 964-982. doi: 10.1177/0018720812465006

Within this research area, we use virtual reality as a tool to optimize design solutions, through the evaluation of human behavior in interaction with the elements of a virtual system.

Some developed projects in this area

• Behavioral compliance for dynamic versus static signs in an immersive virtual environment²

One of our first projects that gave rise to the doctoral thesis of Professor Emilia Duarte.

Abstract

This study used an immersive virtual environment (IVE) to examine how dynamic features in signage affect behavioral compliance during a work-related task and an emergency egress. Ninety participants performed a work-related task followed by an emergency egress. Compliance with uncued and cued safety signs was assessed prior to an explosion/fire involving egress with exit signs. Although dynamic presentation produced the highest compliance, the difference between dynamic and static presentation was only statistically significant for uncued signs. Uncued signs, both static and dynamic, were effective in changing behavior compared to no/minimal signs. Findings are explained based on sign salience and on task differences. If signs must capture attention while individuals are attending to other tasks, salient (e.g., dynamic) signs are useful in benefiting compliance. This study demonstrates the potential for IVEs to serve as a useful tool in behavioral compliance research.

² Duarte, E., Rebelo, F., Teles, J., & Wogalter, M. S. (2014). Behavioral compliance for dynamic versus static signs in an immersive virtual environment. Applied Ergonomics, 45, 5, 1367-1375

Emília Duarte; F. Rebelo; J. Teles; M. S. Wogalter (2013). Behavioral compliance for dynamic versus static signs in an immersive virtual environmentstatic signs in an immersive virtual environment. Applied Ergonomics, Article in Press (IF=1.728) http://dx.doi.org/10.1016/j.apergo.2013.10.004

Duarte, E.; Noriega, P.; Calhandro, A.; Rebelo, F. (2014). The effect of humoristic vs. dramatic animation-based warnings - A study on acceptance and risk perception. Proceedings of the Human Factors and Ergonomics Society Annual Meeting,58,1,1884-1888,2014,SAGE Publications 

• Using Virtual Reality to Study the Influence of Environmental variables to enhance wayfinding within complex buildings

This study was developed by Elisangela Vilar, giving rise to his doctoral thesis.

Abstract

Wayfinding difficulties may lead people to avoid places; it also can make them late for important occurrences such as business meetings or flights, which may cause loss of opportunity and money. Additionally, as settings grow in dimension and complexity, emergency evacuation emerges as a key problem, and wayfinding becomes a matter of life and death. The ability to predict people’s route-choice is particularly important to avoid wayfinding problems, mainly when considered during developmental stages of complex buildings. Studies focused on the factors that influence route-choice indoors are few; most of the studies are focused on spatial knowledge and wayfinding strategies considering outdoor environments. This dissertation considers the affordances concept as an approach to study the individual movement indoors. It considers that some environmental variables act as factors of attraction, improving corridors affordance and influencing the spatial decision. Directional signage was also discussed as explicit information that directly informs a path. The main goal was to contribute with a better understanding about the human wayfinding behavior indoors to define recommendations for optimizing the usability of complex buildings. For this, the use of signage and environmental variables as directional explicit and implicit information in directing people within complex buildings was investigated, considering everyday and emergency situations. A Virtual Reality-based methodology was used in three experiments. Results indicated that, when signage was absent, the environmental variables were able to direct people towards a specific destination in both, everyday and emergency situations. But, competing with posted signs, environmental variables were not so efficient. During an emergency egress, static ISO-type signs were not enough to lead people to a safe place when competing with the environmental variables in the studied conditions.

Vilar E., Rebelo F., Noriega P. (2018) Smart Systems in Emergency Wayfinding: A Literature Review. In: Marcus A., Wang W. (eds) Design, User Experience, and Usability: Designing Interactions. DUXU 2018. Lecture Notes in Computer Science, vol 10919, 379-388. Springer, Cham - https://doi.org/10.1007/978-3-319-91803-7_28

Vilar E., Rebelo F., Noriega P. (2018) Comparing Three Stimulus Presentation Types in a Virtual Reality Experiment to Human Wayfinding Behavior During Emergency Situation. In: Rebelo F., Soares M. (eds) Advances in Ergonomics in Design. AHFE 2017. Advances in Intelligent Systems and Computing, vol 588, 34-44. Springer, Cham - https://doi.org/10.1007/978-3-319-60582-1_4

Vilar, E., Rebelo, F., Noriega, P., Teles, J., Mayhorn, C. (2015). Signage versus environmental affordances: Is the explicit information strong enough to guide human behavior during a wayfinding task? Human Factors and Ergonomics in Manufacturing & Services Industries, 25(4), 439-452. https://doi.org/10.1002/hfm.20557

• Space exploration matrices to evaluate human interaction with virtual environments

One of the greatest challenges is to create an environment in a way that people can find their destination in the fastest and safest manner. One way to study this kind of problem is to understand what happens during the path that an individual performs in an environment. In this project we used space exploration matrices to evaluate human interaction with virtual environments. The virtual environment is divided in a grid of adjustable cells. The frequency that each cell is stepped by a participant is saved. The “warm” colors represent more stepped on cells and “cold” colors less stepped on cells.

• Nexperience

This project aims to improving the working conditions at Nespresso through the development of a solution for training the workers, using Virtual Reality, to induce safe behavior.