WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing

Hui Shyong Yeo; Juyoung Lee; Hyung-il Kim; Askar Gupta; Andrea Bianchi; Daniel Vogel; Hideki Koike; Woontack Woo; Aaron John Quigley

doi:10.1145/3338286.3340130

WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing

Hui Shyong Yeo, Juyoung Lee, Hyung-il Kim, Askar Gupta, Andrea Bianchi, Daniel Vogel, Hideki Koike, Woontack Woo, Aaron John Quigley

School of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

To better explore the incorporation of pointing and gesturing into ubiquitous computing, we introduce WRIST, an interaction and sensing technique that leverages the dexterity of human wrist motion. WRIST employs a sensor fusion approach which combines inertial measurement unit (IMU) data from a smartwatch and a smart ring. The relative orientation difference of the two devices is measured as the wrist rotation that is independent from arm rotation, which is also position and orientation invariant. Employing our test hardware, we demonstrate that WRIST affords and enables a number of novel yet simplistic interaction techniques, such as (i) macro-micro pointing without explicit mode switching and (ii) wrist gesture recognition when the hand is held in different orientations (e.g., raised or lowered). We report on two studies to evaluate the proposed techniques and we present a set of applications that demonstrate the benefits of WRIST. We conclude with a discussion of the limitations and highlight possible future pathways for research in pointing and gesturing with wearable devices.

Original language	English
Title of host publication	Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19)
Place of Publication	New York
Publisher	ACM
Number of pages	15
ISBN (Electronic)	9781450368254
DOIs	https://doi.org/10.1145/3338286.3340130
Publication status	Published - 1 Oct 2019
Event	21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2019) - Taipei International Convention Center, Taipei, Taiwan Duration: 1 Oct 2019 → 4 Oct 2019 Conference number: 21 https://mobilehci.acm.org/2019/

Conference

Conference	21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2019)
Abbreviated title	MobileHCI 2019
Country/Territory	Taiwan
City	Taipei
Period	1/10/19 → 4/10/19
Internet address	https://mobilehci.acm.org/2019/

Keywords

Smartwatch
Wrist gesture
Distal pointing
Large displays

Access to Document

10.1145/3338286.3340130

MobileHCI2019
Copyright © 2019 Association for Computing Machinery. This work has been made available online in accordance with publisher policies or with permission. Permission for further reuse of this content should be sought from the publisher or the rights holder. This is the author created accepted manuscript following peer review and may differ slightly from the final published version. The final published version of this work is available at https://doi.org/10.1145/3338286.3340130
Accepted author manuscript, 10.3 MB

Cite this

Yeo, H. S., Lee, J., Kim, H., Gupta, A., Bianchi, A., Vogel, D., Koike, H., Woo, W., & Quigley, A. J. (2019). WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19) Article 19 ACM. https://doi.org/10.1145/3338286.3340130

@inproceedings{d2e5257d7eee4ef3a827f88f3e2f7687,

title = "WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing",

abstract = "To better explore the incorporation of pointing and gesturing into ubiquitous computing, we introduce WRIST, an interaction and sensing technique that leverages the dexterity of human wrist motion. WRIST employs a sensor fusion approach which combines inertial measurement unit (IMU) data from a smartwatch and a smart ring. The relative orientation difference of the two devices is measured as the wrist rotation that is independent from arm rotation, which is also position and orientation invariant. Employing our test hardware, we demonstrate that WRIST affords and enables a number of novel yet simplistic interaction techniques, such as (i) macro-micro pointing without explicit mode switching and (ii) wrist gesture recognition when the hand is held in different orientations (e.g., raised or lowered). We report on two studies to evaluate the proposed techniques and we present a set of applications that demonstrate the benefits of WRIST. We conclude with a discussion of the limitations and highlight possible future pathways for research in pointing and gesturing with wearable devices.",

keywords = "Smartwatch, Wrist gesture, Distal pointing, Large displays",

author = "Yeo, {Hui Shyong} and Juyoung Lee and Hyung-il Kim and Askar Gupta and Andrea Bianchi and Daniel Vogel and Hideki Koike and Woontack Woo and Quigley, {Aaron John}",

note = "Funding: Next-Generation In-ormation Computing Development Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT (NRF-2017M3C4A7066316) and Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No.2019-0-01270, WISE AR UI/UX Platform Development for Smartglasses).; 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2019), MobileHCI 2019 ; Conference date: 01-10-2019 Through 04-10-2019",

year = "2019",

month = oct,

day = "1",

doi = "10.1145/3338286.3340130",

language = "English",

booktitle = "Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19)",

publisher = "ACM",

address = "United States",

url = "https://mobilehci.acm.org/2019/",

}

Yeo, HS, Lee, J, Kim, H, Gupta, A, Bianchi, A, Vogel, D, Koike, H, Woo, W & Quigley, AJ 2019, WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing. in Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19)., 19, ACM, New York, 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2019), Taipei, Taiwan, 1/10/19. https://doi.org/10.1145/3338286.3340130

WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing. / Yeo, Hui Shyong; Lee, Juyoung; Kim, Hyung-il et al.
Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19). New York: ACM, 2019. 19.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - WRIST

T2 - 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2019)

AU - Yeo, Hui Shyong

AU - Lee, Juyoung

AU - Kim, Hyung-il

AU - Gupta, Askar

AU - Bianchi, Andrea

AU - Vogel, Daniel

AU - Koike, Hideki

AU - Woo, Woontack

AU - Quigley, Aaron John

N1 - Conference code: 21

PY - 2019/10/1

Y1 - 2019/10/1

N2 - To better explore the incorporation of pointing and gesturing into ubiquitous computing, we introduce WRIST, an interaction and sensing technique that leverages the dexterity of human wrist motion. WRIST employs a sensor fusion approach which combines inertial measurement unit (IMU) data from a smartwatch and a smart ring. The relative orientation difference of the two devices is measured as the wrist rotation that is independent from arm rotation, which is also position and orientation invariant. Employing our test hardware, we demonstrate that WRIST affords and enables a number of novel yet simplistic interaction techniques, such as (i) macro-micro pointing without explicit mode switching and (ii) wrist gesture recognition when the hand is held in different orientations (e.g., raised or lowered). We report on two studies to evaluate the proposed techniques and we present a set of applications that demonstrate the benefits of WRIST. We conclude with a discussion of the limitations and highlight possible future pathways for research in pointing and gesturing with wearable devices.

AB - To better explore the incorporation of pointing and gesturing into ubiquitous computing, we introduce WRIST, an interaction and sensing technique that leverages the dexterity of human wrist motion. WRIST employs a sensor fusion approach which combines inertial measurement unit (IMU) data from a smartwatch and a smart ring. The relative orientation difference of the two devices is measured as the wrist rotation that is independent from arm rotation, which is also position and orientation invariant. Employing our test hardware, we demonstrate that WRIST affords and enables a number of novel yet simplistic interaction techniques, such as (i) macro-micro pointing without explicit mode switching and (ii) wrist gesture recognition when the hand is held in different orientations (e.g., raised or lowered). We report on two studies to evaluate the proposed techniques and we present a set of applications that demonstrate the benefits of WRIST. We conclude with a discussion of the limitations and highlight possible future pathways for research in pointing and gesturing with wearable devices.

KW - Smartwatch

KW - Wrist gesture

KW - Distal pointing

KW - Large displays

U2 - 10.1145/3338286.3340130

DO - 10.1145/3338286.3340130

M3 - Conference contribution

BT - Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19)

PB - ACM

CY - New York

Y2 - 1 October 2019 through 4 October 2019

ER -

WRIST: Watch-Ring Interaction and Sensing Technique for wrist gestures and macro-micro pointing

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this