Quantification of advanced dementia patients' engagement in therapeutic sessions: an automatic video based approach using computer vision and machine learning

Liangfei Zhang, Ognjen Arandjelovic, Sonia Dewar, Arlene Astell, Gayle Doherty, Maggie Ellis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Most individuals with advanced dementia lose the ability to communicate with the outside world through speech. This limits their ability to participate in social activities crucial to their well-being and quality of life. However, there is mounting evidence that individuals with advanced dementia can still communicate non-verbally and benefit greatly from these interactions. A major problem in facilitating the advancement of this research is of a practical and methodical nature: assessing the success of treatment is currently done by humans, prone to subjective bias and inconsistency, and it involves laborious and time consuming effort. The present work is the first attempt at exploring if automatic (artificial intelligence based) quantification of the degree of patient engagement in Adaptive Interaction sessions, a highly promising intervention developed to improve the quality of life of nonverbal individuals with advanced dementia. Hence we describe a framework which uses computer vision and machine learning as a potential first step towards answering this question. Using a real-world data set of videos of therapeutic sessions, not acquired specifically for the purposes of the present work, we demonstrate highly promising results.

Original languageEnglish
Title of host publication2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
PublisherIEEE
Pages5785-5788
Number of pages4
Volume2020
ISBN (Electronic)978-1-7281-1990-8
ISBN (Print)978-1-7281-1991-5
DOIs
Publication statusPublished - Jul 2020
Event42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society (EMBC 2020) - EMBS Virtual Academy, Montreal, Canada
Duration: 20 Jul 202024 Jul 2020
https://embc.embs.org/2020/

Publication series

NameAnnual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
ISSN (Print)2375-7477

Conference

Conference42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society (EMBC 2020)
Abbreviated titleEMBC 2020
Country/TerritoryCanada
CityMontreal
Period20/07/2024/07/20
Internet address

Fingerprint

Dive into the research topics of 'Quantification of advanced dementia patients' engagement in therapeutic sessions: an automatic video based approach using computer vision and machine learning'. Together they form a unique fingerprint.

Cite this