Please use this identifier to cite or link to this item:
https://hdl.handle.net/10316/100889
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Hijazi, Haytham | - |
dc.contributor.author | Couceiro, Ricardo | - |
dc.contributor.author | Castelhano, João | - |
dc.contributor.author | De Carvalho, Paulo | - |
dc.contributor.author | Castelo Branco, Miguel | - |
dc.contributor.author | Madeira, Henrique | - |
dc.date.accessioned | 2022-07-19T08:21:13Z | - |
dc.date.available | 2022-07-19T08:21:13Z | - |
dc.date.issued | 2021 | - |
dc.identifier.issn | 2169-3536 | pt |
dc.identifier.uri | https://hdl.handle.net/10316/100889 | - |
dc.description.abstract | Assessing comprehension difficulties requires the ability to assess cognitive load. Changes in cognitive load induced by comprehension difficulties could be detected with an adequate time resolution using different biofeedback measures (e.g., changes in the pupil diameter). However, identifying the Spatio-temporal sources of content comprehension difficulties (i.e., when, and where exactly the difficulty occurs in content regions) with a fine granularity is a big challenge that has not been explicitly addressed in the state-of-the-art. This paper proposes and evaluates an innovative approach named Intelligent BiofeedbackAugmented Content Comprehension (TellBack) to explicitly address this challenge. The goal is to autonomously identify regions of digital content that cause user’s comprehension difficulty, opening the possibility to provide real-time comprehension support to users. TellBack is based on assessing the cognitive load associated with content comprehension through non-intrusive cheap biofeedback devices that acquire measures such as pupil response or Heart Rate Variability (HRV). To identify when exactly the difficulty in comprehension occurs, physiological manifestations of the Autonomic Nervous System (ANS) such as the pupil diameter variability and the modulation of HRV are exploited, whereas the fine spatial resolution (i.e., the region of content where the user is looking at) is provided by eye-tracking. The evaluation results of this approach show an accuracy of 83.00% ± 0.75 in classifying regions of content as difficult or not difficult using Support Vector Machine (SVM), and precision, recall, and micro F1-score of 0.89, 0.79, and 0.83, respectively. Results obtained with 4 other classifiers, namely Random Forest, k-nearest neighbor, Decision Tree, and Gaussian Naive Bayes, showed a slightly lower precision. TellBack outperforms the state-of-the-art in precision & recall by 23% and 17% respectively | pt |
dc.language.iso | eng | pt |
dc.relation | BASE project Grant POCI - 01-0145 - FEDER- 031581 | pt |
dc.relation | University of Coimbra Grant PTDC/PSI-GER/30852/2017 | | pt |
dc.rights | openAccess | pt |
dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | pt |
dc.subject | Biomedical measurement | pt |
dc.subject | cognitive load | pt |
dc.subject | content comprehension | pt |
dc.subject | eye-tracking | pt |
dc.subject | heart rate variability | pt |
dc.subject | machine learning | pt |
dc.title | Intelligent Biofeedback Augmented Content Comprehension (TellBack) | pt |
dc.type | article | - |
degois.publication.firstPage | 28393 | pt |
degois.publication.lastPage | 28406 | pt |
degois.publication.title | IEEE Access | pt |
dc.peerreviewed | yes | pt |
dc.identifier.doi | 10.1109/ACCESS.2021.3058664 | pt |
degois.publication.volume | 9 | pt |
dc.date.embargo | 2021-01-01 | * |
uc.date.periodoEmbargo | 0 | pt |
item.fulltext | Com Texto completo | - |
item.openairecristype | http://purl.org/coar/resource_type/c_18cf | - |
item.languageiso639-1 | en | - |
item.openairetype | article | - |
item.cerifentitytype | Publications | - |
item.grantfulltext | open | - |
crisitem.author.researchunit | CISUC - Centre for Informatics and Systems of the University of Coimbra | - |
crisitem.author.researchunit | CISUC - Centre for Informatics and Systems of the University of Coimbra | - |
crisitem.author.researchunit | CIBIT - Coimbra Institute for Biomedical Imaging and Translational Research | - |
crisitem.author.researchunit | CISUC - Centre for Informatics and Systems of the University of Coimbra | - |
crisitem.author.parentresearchunit | Faculty of Sciences and Technology | - |
crisitem.author.parentresearchunit | Faculty of Sciences and Technology | - |
crisitem.author.parentresearchunit | Faculty of Sciences and Technology | - |
crisitem.author.orcid | 0000-0002-4981-3649 | - |
crisitem.author.orcid | 0000-0003-1237-6964 | - |
crisitem.author.orcid | 0000-0002-8996-1515 | - |
crisitem.author.orcid | 0000-0002-9847-0590 | - |
crisitem.author.orcid | 0000-0003-4364-6373 | - |
crisitem.author.orcid | 0000-0001-8146-4664 | - |
Appears in Collections: | I&D CISUC - Artigos em Revistas Internacionais I&D CIBIT - Artigos em Revistas Internacionais |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Intelligent_Biofeedback_Augmented_Content_Comprehension_TellBack.pdf | 2.78 MB | Adobe PDF | View/Open |
SCOPUSTM
Citations
4
checked on Nov 17, 2022
WEB OF SCIENCETM
Citations
3
checked on May 2, 2023
Page view(s)
142
checked on Oct 16, 2024
Download(s)
70
checked on Oct 16, 2024
Google ScholarTM
Check
Altmetric
Altmetric
This item is licensed under a Creative Commons License