Publication
An unobtrusive multimodal stress detection model & recommender system
| dc.contributor.author | Ferreira, Simão | |
| dc.contributor.author | Correia, Hugo | |
| dc.contributor.author | Rodrigues, Fátima | |
| dc.contributor.author | Rodrigues, Matilde | |
| dc.contributor.author | Rocha, Nuno | |
| dc.date.accessioned | 2024-12-16T14:22:55Z | |
| dc.date.available | 2024-12-16T14:22:55Z | |
| dc.date.issued | 2023-05 | |
| dc.description.abstract | Studies estimate that about 50% of all lost workdays are related to occupational stress. In recent years, several solutions for mental health management, including biofeedback applications, have emerged as a way to enhance employee mental health. Solutions to mitigate risk factors related to the working settings present an enormous potential and a clear contribution. However, most of the work that has been developed is limited to laboratory environments and does not suit real-life needs. Our study proposes an unobtrusive multimodal approach for detecting work-related stress combining videoplethysmography and self-reported measures for stablishing the ground truth in real-life settings. The study involved 28 volunteers over a two-month period. Various physiological signals were collected through a videopletismography solution, while users were performing daily working, for approximately eight hours a day. In parallel, selfreported measures were collected via a pop-up application (developed by the research team) that periodically retrieved the user's perceived stress (amongst other variables) in order to label the physiological data. In order to develop the stress detection model, we pre-processed the data and performed Heart Rate Variability (HRV) feature extraction. Then, we experimented with several machine learning models, utilizing both individual and combined physiological signals to explore all available alternatives. After rigorous evaluation, the best-trained model achieved an accuracy of over 80% and an F1 Score of over 85%. With the stress detection model in place, we are developing a structured intervention model to help reduce stress. This intervention model integrates two interconnected dimensions through digital coaching, which prioritizes personalized recommendations based on user preferences. Our top priority is to ensure user engagement, and we believe that adherence to and adoption of recommended interventions are more likely when users receive recommendations that align with their preferences. Thus, we prioritize personalized recommendations that are tailored to each individual's unique model. After detecting immediate stress peaks and providing real-time feedback on stress levels, our alarm system goes a step further by offering customized recommendations for brief stress relief. The digital coach (intervention model) offers various recommendations and active lifestyle changes such as exercise, task management, weight management, better sleep habits, structured pauses, and other critical interventions. These critical interventions are also based on user preferences, allowing our system to prevent future stress-related incidents and, most importantly, mitigate long-term stress. This project and its methodology demonstrate that truly unobtrusive stress detection is possible and can be performed within the scope of ethical demands. In future work, we will evaluate the responses and beneficial outcomes of implementing a recommender system. | pt_PT |
| dc.description.version | info:eu-repo/semantics/publishedVersion | pt_PT |
| dc.identifier.citation | Ferreira, S., Correia, H., Rodrigues, F., Rodrigues, M., & Rocha, N. (2023). An unobtrusive multimodal stress detection model & recommender system. TEchMA2023 – 6th International Conference on Technologies for the Wellbeing and Sustainable Manufacturing - Book of abstracts, 63. | pt_PT |
| dc.identifier.isbn | 978-972-789-858-9 | |
| dc.identifier.uri | http://hdl.handle.net/10400.22/26856 | |
| dc.language.iso | eng | pt_PT |
| dc.publisher | UA Editora - Universidade de Aveiro | pt_PT |
| dc.relation | This research was funded by ITEA3 and Compete 2020 - POCI-01- 0247-FEDER-046168|Lisboa-01-0247-FEDER- 046168. | pt_PT |
| dc.relation.publisherversion | https://techma2023.web.ua.pt/wp-content/uploads/2023/05/livro_final2.pdf | pt_PT |
| dc.subject | Occupational stress | pt_PT |
| dc.subject | Machine learning | pt_PT |
| dc.title | An unobtrusive multimodal stress detection model & recommender system | pt_PT |
| dc.type | conference object | |
| dspace.entity.type | Publication | |
| oaire.citation.conferencePlace | Aveiro | pt_PT |
| oaire.citation.startPage | 63 | pt_PT |
| oaire.citation.title | TEchMA2023 – 6th International Conference on Technologies for the Wellbeing and Sustainable Manufacturing - Book of abstracts | pt_PT |
| person.familyName | Ferreira | |
| person.familyName | Rodrigues | |
| person.familyName | Rocha | |
| person.givenName | Simão | |
| person.givenName | Matilde | |
| person.givenName | Nuno | |
| person.identifier | 2680796 | |
| person.identifier | 192266 | |
| person.identifier.ciencia-id | B11E-1BD3-5F34 | |
| person.identifier.ciencia-id | 5110-3A70-C3F3 | |
| person.identifier.ciencia-id | AE16-A494-5F8B | |
| person.identifier.orcid | 0000-0001-8233-2217 | |
| person.identifier.orcid | 0000-0001-6175-6934 | |
| person.identifier.orcid | 0000-0002-3139-2786 | |
| person.identifier.rid | N-7022-2015 | |
| person.identifier.rid | M-9821-2013 | |
| person.identifier.scopus-author-id | 57359736400 | |
| person.identifier.scopus-author-id | 55485977900 | |
| person.identifier.scopus-author-id | 32867975300 | |
| rcaap.rights | openAccess | pt_PT |
| rcaap.type | conferenceObject | pt_PT |
| relation.isAuthorOfPublication | 0bd5b0fc-6849-4f36-b751-87e7f4c81eff | |
| relation.isAuthorOfPublication | 8ddb200d-027c-40ca-8ca4-7e3a5981bcb1 | |
| relation.isAuthorOfPublication | 9e940914-601a-4978-8d5b-74e5ade7ada7 | |
| relation.isAuthorOfPublication.latestForDiscovery | 0bd5b0fc-6849-4f36-b751-87e7f4c81eff |