Biologically inspired vision for human-robot interaction

Mario Saleiro; Miguel Farrajota; Kasim Terzić; Sai Krishna; João M.F. Rodrigues; J. M.Hans du Buf

doi:10.1007/978-3-319-20681-3_48

Biologically inspired vision for human-robot interaction

Mario Saleiro^*, Miguel Farrajota, Kasim Terzić, Sai Krishna, João M.F. Rodrigues, J. M.Hans du Buf

^*Corresponding author for this work

School of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Human-robot interaction is an interdisciplinary research area that is becoming more and more relevant as robots start to enter our homes, workplaces, schools, etc. In order to navigate safely among us, robots must be able to understand human behavior, to communicate, and to interpret instructions from humans, either by recognizing their speech or by understanding their body movements and gestures. We present a biologically inspired vision system for human-robot interaction which integrates several components: visual saliency, stereo vision, face and hand detection and gesture recognition. Visual saliency is computed using color, motion and disparity. Both the stereo vision and gesture recognition components are based on keypoints coded by means of cortical V1 simple, complex and end-stopped cells. Hand and face detection is achieved by using a linear SVM classifier. The system was tested on a child-sized robot.

Original language	English
Title of host publication	Universal Access in Human-Computer Interaction. Access to Interaction
Subtitle of host publication	9th International Conference, UAHCI 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II
Editors	Margherita Antona, Constantine Stephanidis
Place of Publication	Cham
Publisher	Springer
Pages	505-517
Number of pages	13
ISBN (Electronic)	9783319206813
ISBN (Print)	9783319206806
DOIs	https://doi.org/10.1007/978-3-319-20681-3_48
Publication status	Published - 2015
Event	9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015 - Los Angeles, United States Duration: 2 Aug 2015 → 7 Aug 2015 Conference number: 9 http://2015.hci.international/uahci

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9176
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015
Abbreviated title	UAHCI
Country/Territory	United States
City	Los Angeles
Period	2/08/15 → 7/08/15
Internet address	http://2015.hci.international/uahci

Keywords

Biological framework
Hand gestures
Human-robot interaction

Access to Document

10.1007/978-3-319-20681-3_48

hci2015
© 2015, Springer International Publishing Switzerland. This work has been made available online in accordance with the publisher’s policies. This is the author created accepted version manuscript following peer review and as such may differ slightly from the final published version. The final published version of this work is available at https://doi.org/10.1007/978-3-319-20681-3_48
Accepted author manuscript, 3.91 MB

Cite this

Saleiro, M., Farrajota, M., Terzić, K., Krishna, S., Rodrigues, J. M. F., & du Buf, J. M. H. (2015). Biologically inspired vision for human-robot interaction. In M. Antona, & C. Stephanidis (Eds.), Universal Access in Human-Computer Interaction. Access to Interaction: 9th International Conference, UAHCI 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II (pp. 505-517). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9176). Springer. https://doi.org/10.1007/978-3-319-20681-3_48

Saleiro, Mario ; Farrajota, Miguel ; Terzić, Kasim et al. / Biologically inspired vision for human-robot interaction. Universal Access in Human-Computer Interaction. Access to Interaction: 9th International Conference, UAHCI 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II. editor / Margherita Antona ; Constantine Stephanidis. Cham : Springer, 2015. pp. 505-517 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{c25dfc2be48042699cd5c73e23912193,

title = "Biologically inspired vision for human-robot interaction",

abstract = "Human-robot interaction is an interdisciplinary research area that is becoming more and more relevant as robots start to enter our homes, workplaces, schools, etc. In order to navigate safely among us, robots must be able to understand human behavior, to communicate, and to interpret instructions from humans, either by recognizing their speech or by understanding their body movements and gestures. We present a biologically inspired vision system for human-robot interaction which integrates several components: visual saliency, stereo vision, face and hand detection and gesture recognition. Visual saliency is computed using color, motion and disparity. Both the stereo vision and gesture recognition components are based on keypoints coded by means of cortical V1 simple, complex and end-stopped cells. Hand and face detection is achieved by using a linear SVM classifier. The system was tested on a child-sized robot.",

keywords = "Biological framework, Hand gestures, Human-robot interaction",

author = "Mario Saleiro and Miguel Farrajota and Kasim Terzi{\'c} and Sai Krishna and Rodrigues, {Jo{\~a}o M.F.} and {du Buf}, {J. M.Hans}",

year = "2015",

doi = "10.1007/978-3-319-20681-3_48",

language = "English",

isbn = "9783319206806",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "505--517",

editor = "Margherita Antona and Constantine Stephanidis",

booktitle = "Universal Access in Human-Computer Interaction. Access to Interaction",

address = "Netherlands",

note = "9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015, UAHCI ; Conference date: 02-08-2015 Through 07-08-2015",

url = "http://2015.hci.international/uahci",

}

Saleiro, M, Farrajota, M, Terzić, K, Krishna, S, Rodrigues, JMF & du Buf, JMH 2015, Biologically inspired vision for human-robot interaction. in M Antona & C Stephanidis (eds), Universal Access in Human-Computer Interaction. Access to Interaction: 9th International Conference, UAHCI 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9176, Springer, Cham, pp. 505-517, 9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015, Los Angeles, California, United States, 2/08/15. https://doi.org/10.1007/978-3-319-20681-3_48

Biologically inspired vision for human-robot interaction. / Saleiro, Mario; Farrajota, Miguel; Terzić, Kasim et al.
Universal Access in Human-Computer Interaction. Access to Interaction: 9th International Conference, UAHCI 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II. ed. / Margherita Antona; Constantine Stephanidis. Cham: Springer, 2015. p. 505-517 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9176).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Biologically inspired vision for human-robot interaction

AU - Saleiro, Mario

AU - Farrajota, Miguel

AU - Terzić, Kasim

AU - Krishna, Sai

AU - Rodrigues, João M.F.

AU - du Buf, J. M.Hans

N1 - Conference code: 9

PY - 2015

Y1 - 2015

N2 - Human-robot interaction is an interdisciplinary research area that is becoming more and more relevant as robots start to enter our homes, workplaces, schools, etc. In order to navigate safely among us, robots must be able to understand human behavior, to communicate, and to interpret instructions from humans, either by recognizing their speech or by understanding their body movements and gestures. We present a biologically inspired vision system for human-robot interaction which integrates several components: visual saliency, stereo vision, face and hand detection and gesture recognition. Visual saliency is computed using color, motion and disparity. Both the stereo vision and gesture recognition components are based on keypoints coded by means of cortical V1 simple, complex and end-stopped cells. Hand and face detection is achieved by using a linear SVM classifier. The system was tested on a child-sized robot.

AB - Human-robot interaction is an interdisciplinary research area that is becoming more and more relevant as robots start to enter our homes, workplaces, schools, etc. In order to navigate safely among us, robots must be able to understand human behavior, to communicate, and to interpret instructions from humans, either by recognizing their speech or by understanding their body movements and gestures. We present a biologically inspired vision system for human-robot interaction which integrates several components: visual saliency, stereo vision, face and hand detection and gesture recognition. Visual saliency is computed using color, motion and disparity. Both the stereo vision and gesture recognition components are based on keypoints coded by means of cortical V1 simple, complex and end-stopped cells. Hand and face detection is achieved by using a linear SVM classifier. The system was tested on a child-sized robot.

KW - Biological framework

KW - Hand gestures

KW - Human-robot interaction

U2 - 10.1007/978-3-319-20681-3_48

DO - 10.1007/978-3-319-20681-3_48

M3 - Conference contribution

AN - SCOPUS:84945911426

SN - 9783319206806

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 505

EP - 517

BT - Universal Access in Human-Computer Interaction. Access to Interaction

A2 - Antona, Margherita

A2 - Stephanidis, Constantine

PB - Springer

CY - Cham

T2 - 9th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015

Y2 - 2 August 2015 through 7 August 2015

ER -

Saleiro M, Farrajota M, Terzić K, Krishna S, Rodrigues JMF, du Buf JMH. Biologically inspired vision for human-robot interaction. In Antona M, Stephanidis C, editors, Universal Access in Human-Computer Interaction. Access to Interaction: 9th International Conference, UAHCI 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II. Cham: Springer. 2015. p. 505-517. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Epub 2015 Jul 18. doi: 10.1007/978-3-319-20681-3_48

Biologically inspired vision for human-robot interaction

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this