Capturing social cues with imaging glasses

Lauren Murray; Philip Hands; Ross Goucher; Juan Ye

doi:10.1145/2968219.2968260

Capturing social cues with imaging glasses

Lauren Murray, Philip Hands, Ross Goucher, Juan Ye

School of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

Original language	English
Title of host publication	Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct
Place of Publication	New York, NY
Publisher	ACM
Pages	968-972
Number of pages	5
ISBN (Print)	9781450344623
DOIs	https://doi.org/10.1145/2968219.2968260
Publication status	Published - 12 Sept 2016
Event	2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16) - Kongresshaus Stadthalle Heidelberg, Heidelberg, Germany Duration: 12 Sept 2016 → 16 Sept 2016 http://ubicomp.org/ubicomp2016/

Conference

Conference	2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16)
Abbreviated title	UbiComp
Country/Territory	Germany
City	Heidelberg
Period	12/09/16 → 16/09/16
Internet address	http://ubicomp.org/ubicomp2016/

Keywords

Affective Computing
Imaging glasses
Emotion
Recognition

Access to Document

10.1145/2968219.2968260

Cite this

@inproceedings{9552414448e0402491ca809f67e58af7,

title = "Capturing social cues with imaging glasses",

abstract = "Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.",

keywords = "Affective Computing, Imaging glasses, Emotion, Recognition",

author = "Lauren Murray and Philip Hands and Ross Goucher and Juan Ye",

year = "2016",

month = sep,

day = "12",

doi = "10.1145/2968219.2968260",

language = "English",

isbn = "9781450344623",

pages = "968--972",

booktitle = "Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct",

publisher = "ACM",

address = "United States",

note = "2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), UbiComp ; Conference date: 12-09-2016 Through 16-09-2016",

url = "http://ubicomp.org/ubicomp2016/",

}

Murray, L, Hands, P, Goucher, R & Ye, J 2016, Capturing social cues with imaging glasses. in Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, New York, NY, pp. 968-972, 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), Heidelberg, Germany, 12/09/16. https://doi.org/10.1145/2968219.2968260

TY - GEN

T1 - Capturing social cues with imaging glasses

AU - Murray, Lauren

AU - Hands, Philip

AU - Goucher, Ross

AU - Ye, Juan

PY - 2016/9/12

Y1 - 2016/9/12

N2 - Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

AB - Capturing visual social cues in social conversations can prove a difficult task for visually impaired people. Their lack of ability to see facial expressions and body postures expressed by their conversation partners can lead them to misunderstand or misjudge the social situations. This paper presents a system that infers social cues from streaming video recorded by a pair of imaging glasses and feedbacks the inferred social cues to the users. We have implemented the prototype and evaluated the effectiveness and usefulness of the system in real-world conversation situations.

KW - Affective Computing

KW - Imaging glasses

KW - Emotion

KW - Recognition

U2 - 10.1145/2968219.2968260

DO - 10.1145/2968219.2968260

M3 - Conference contribution

SN - 9781450344623

SP - 968

EP - 972

BT - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

PB - ACM

CY - New York, NY

T2 - 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16)

Y2 - 12 September 2016 through 16 September 2016

ER -

Capturing social cues with imaging glasses

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this