Juan Ye

Search results

• 2025

  Quantifying the impact of motion on 2D gaze estimation in real-world mobile interactions

  Lei, Y., Wang, Y., Buchanan, F., Zhao, M., Sugano, Y., He, S., Khamis, M. & Ye, J., 14 Feb 2025, (Submitted) arXiv, p. 1-27, 27 p.

  Research output: Working paper › Preprint

  • Tracking System 100%
  • Mobile Interaction 100%
  • facial image 100%
  • Spatial Relationship 100%
  • Affect Behavior 100%
• 2024

  An end-to-end review of gaze estimation and its interactive applications on handheld mobile devices

  Lei, Y., He, S., Khamis, M. & Ye, J., 1 Feb 2024, In: ACM Computing Surveys. 56, 2, 38 p., 34.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Interactive Application 100%
  • Mobile Device 100%
  • Computational Power 50%
  • Interactive System 50%
  • Machine Learning Technique 50%

• SelfVis: self-supervised learning for human activity recognition based on area charts

  Jiang, A. & Ye, J., 3 May 2024, (E-pub ahead of print) In: IEEE Transactions on Emerging Topics in Computing. Early Access, p. 1-12 12 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Self-Supervised Learning 100%
  • Human Activity Recognition 100%
  • Activity Recognition 66%
  • Residual Neural Network 33%
  • Recognition Accuracy 33%

• Towards automated animal density estimation with acoustic spatial capture-recapture

  Wang, Y., Ye, J., Li, X. & Borchers, D. L., Sept 2024, In: Biometrics. 80, 3, 12 p., ujae081.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Hylobatidae 100%
• 2023

  DynamicRead: exploring robust gaze interaction methods for reading on handheld mobile devices under dynamic conditions

  Lei, Y., Wang, Y., Caslin, T., Wisowaty, A., Zhu, X., Khamis, M. & Ye, J., 18 May 2023, In: Proceedings of the ACM on Human-Computer Interaction. 7, ETRA, 17 p., 158.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Dwell Time 100%
  • Mobile Device 100%
  • Real-Time Application 50%
  • User Participant 50%
  • Research Question 50%

• Online continual learning for human activity recognition

  Schiemer, M., Fang, L., Dobson, S. & Ye, J., 8 Jul 2023, In: Pervasive and Mobile Computing. 93, 20 p., 101817.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Human Activity Recognition 100%
  • Continual Learning 100%
  • Research Question 11%
  • Recognition System 11%
  • Prediction Time 11%
• 2022

  An exploratory study on academic reading contexts, technology, and strategies

  Moreno Rocha, M. A., Nacenta, M. A. & Ye, J., 13 Jan 2022. 10 p.

  Research output: Contribution to conference › Paper › peer-review

  • Exploratory Study 100%
  • Academic Performance 100%
  • Academic Context 50%
  • Negative Attitude 50%
  • Negative Effect 50%

• Automated call detection for acoustic surveys with structured calls of varying length

  Wang, Y., Ye, J. & Borchers, D. L., 1 Jul 2022, In: Methods in Ecology and Evolution. 13, 7, p. 1552-1567 16 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Convolutional Neural Network 100%
  • Hidden Markov Models 100%
  • Acoustic Survey 100%
  • Hidden Markov Model 100%
  • Neural Network 100%

• VisuaLizations As Intermediate Representations (VLAIR): an approach for applying deep learning-based computer vision to non-image-based data

  Jiang, A., Nacenta, M. A. & Ye, J., 24 Sept 2022, In: Visual Informatics. 6, 3, p. 35-50 16 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Intermediate Representation 100%
  • Computer Vision 100%
  • Deep Learning Method 100%
  • Machine Learning Algorithm 100%
  • Human Activity Recognition 40%
• 2021

  Bayesian inference federated learning for heart rate prediction

  Fang, L., Liu, X., Su, X., Ye, J., Dobson, S., Hui, P. & Tarkoma, S., 2021, Wireless Mobile Communication and Healthcare: 9th EAI International Conference, MobiHealth 2020, Virtual Event, November 19, 2020, Proceedings. Ye, J., O'Grady, M. J., Civitarese, G. & Yordanova, K. (eds.). Cham: Springer, p. 116-130 15 p. (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering; vol. 362 LNICST).

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Federated Learning 100%
  • Wearable Device 100%
  • User Privacy 20%
  • Collected Data 20%
  • Privacy Preserving 20%

• Collaborative activity recognition with heterogeneous activity sets and privacy preferences

  Civitarese, G., Ye, J., Zampatti, M. & Bettini, C., 23 Nov 2021, In: Journal of Ambient Intelligence and Smart Environments. 13, 6, p. 433-452 20 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Privacy Preference 100%
  • Training Data 100%
  • Activity Recognition 100%
  • Federated Learning 50%
  • Privacy Threat 50%

• Continual activity recognition with generative adversarial networks

  Ye, J., Nakwijit, P., Schiemer, M., Jha, S. & Zambonelli, F., 27 Mar 2021, In: ACM Transactions on Internet of Things. 2, 2, p. 1-25 25 p., 9.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Generative Adversarial Networks 100%
  • Human Activity Recognition 100%
  • Activity Recognition 100%
  • Learning System 12%
  • Historical Data 12%

• Continual learning in sensor-based human activity recognition: an empirical benchmark analysis

  Jha, S., Schiemer, M., Zambonelli, F. & Ye, J., 16 Apr 2021, (E-pub ahead of print) In: Information Sciences. In Press, p. 1-35 35 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Human Activity Recognition 100%
  • Continual Learning 100%
  • Recognition System 28%
  • World Application 14%
  • Daily Activity 14%

• ContrasGAN: unsupervised domain adaptation in Human Activity Recognition via adversarial and contrastive learning

  Rosales Sanabria, A., Zambonelli, F., Dobson, S. A. & Ye, J., 6 Nov 2021, (E-pub ahead of print) In: Pervasive and Mobile Computing. In Press, p. 1-34 34 p., 101477.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Unsupervised Domain Adaptation 100%
  • Contrastive Learning 100%
  • Human Activity Recognition 100%
  • Transfer Learning 66%
  • Superior Performance 33%

• Generalisation and robustness investigation for facial and speech emotion recognition using bio-inspired spiking neural networks

  Mansouri Benssassi, E. & Ye, J., 16 Jan 2021, (E-pub ahead of print) In: Soft Computing. First Online, 14 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Speech Emotion Recognition 100%
  • Facial Emotion Recognition 100%
  • Facial Expression 100%
  • Neural Network 100%
  • Support Vector Machine 50%

• Investigating multisensory integration in emotion recognition through bio-inspired computational models

  Mansouri Benssassi, E. & Ye, J., 19 Aug 2021, (E-pub ahead of print) In: IEEE Transactions on Affective Computing. Early Access, 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Multisensory Integration 100%
  • Computational Modeling 100%
  • Fusion Technique 66%
  • Neural Network 66%
  • Evaluation Result 33%

• Shared learning activity labels across heterogeneous datasets

  Ye, J., 9 Mar 2021, In: Journal of Ambient Intelligence and Smart Environments. Pre-press, p. 1-18

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Learning Experiences 100%
  • Annotation 100%
  • Collaborative Learning 100%
  • Recognition Accuracy 33%
  • Data Sharing 33%

• Unsupervised domain adaptation in activity recognition: a GAN-based approach

  Rosales Sanabria, A., Zambonelli, F. & Ye, J., 22 Jan 2021, In: IEEE Access. 9, p. 19421-19438 18 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Unsupervised Domain Adaptation 100%
  • Human Activity Recognition 100%
  • Activity Recognition 100%
  • Generative Adversarial Networks 66%
  • Training Data 66%
• 2020

  Continual learning in human activity recognition: an empirical analysis of regularization

  Jha, S., Schiemer, M. & Ye, J., 17 Jul 2020, p. 1-4. 4 p.

  Research output: Contribution to conference › Paper › peer-review

  Open Access

  File

  • Regularization 100%
  • Human Activity Recognition 100%
  • Continual Learning 100%
  • Computer Vision 100%
  • Learning Algorithm 100%

• Discovery and recognition of emerging human activities using a hierarchical mixture of directional statistical models

  Fang, L., Ye, J. & Dobson, S. A., 1 Jul 2020, In: IEEE Transactions on Knowledge and Data Engineering. 32, 7, p. 1304 - 1316 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Annotation 100%
  • Training Phase 100%
  • Human Activity Recognition 100%

• Evolving models for incrementally learning emerging activities

  Ye, J. & Callus, E., 21 Jul 2020, In: Journal of Ambient Intelligence and Smart Environments. 12, 4, p. 313-325 13 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • State-of-the-Art Method 100%
  • Living System 100%
  • Sensor Data 100%
  • Assisted Living 100%
  • Model Parameter 100%

• Sensor technology for smart homes

  Ye, J., O’Grady, M. & Banos, O., 9 Dec 2020, In: Sensors. 20, 24, 3 p., 7046.

  Research output: Contribution to journal › Editorial

  Open Access

  File

• Synch-Graph: multisensory emotion recognition through neural synchrony via graph convolutional networks

  Mansouri Benssassi, E. & Ye, J., 3 Apr 2020, Proceedings of the AAAI Conference on Artificial Intelligence (AAAI-20). AAAI Press, p. 1351-1358 8 p. (Proceedings of the AAAI Conference on Artificial Intelligence).

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Graph Convolutional Network 100%
  • Neural Network 100%
  • Multisensory Integration 100%
  • Facial Expression 100%
  • Emotional State 50%

• Unsupervised domain adaptation for activity recognition across heterogeneous datasets

  Rosales Sanabria, A. & Ye, J., 14 Mar 2020, (E-pub ahead of print) In: Pervasive and Mobile Computing. In press, 101147.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Unsupervised Domain Adaptation 100%
  • Activity Recognition 100%
  • Recognition Accuracy 33%
  • Annotation 33%
  • Ambient Assisted Living 33%

• Visualization as Intermediate Representations (VLAIR) for human activity recognition

  Jiang, A., Nacenta, M., Terzić, K. & Ye, J., 18 May 2020, PervasiveHealth '20: Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare. Munson, S. A. & Schueller, S. M. (eds.). ACM, p. 201-210 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Intermediate Representation 100%
  • Human Activity Recognition 100%
  • Classification Performance 40%
  • Ambient Assisted Living 20%
  • Visual Feature 20%

• XLearn: learning activity labels across heterogeneous datasets

  Ye, J., Dobson, S. A. & Zambonelli, F., Jan 2020, In: ACM Transactions on Intelligent Systems and Technology. 11, 2, 28 p., 17.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Learning Experiences 100%
  • Annotation 100%
  • Recognition Accuracy 50%
  • Ensemble Learning 50%
  • Ambient Assisted Living 50%
• 2019

  Distributed self-monitoring sensor networks via Markov switching Dynamic Linear Models

  Fang, L., Ye, J. & Dobson, S. A., 16 Jun 2019, Proceedings 2019 IEEE 13th International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2019). IEEE Computer Society, p. 33-42 8780572

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Computer Hardware 100%
  • Sensor Network 100%
  • Wireless Sensor Network 50%
  • Collected Data 50%
  • Sensor Node 50%

• Lifelong learning in sensor-based human activity recognition

  Ye, J., Dobson, S. A. & Zambonelli, F., 18 Nov 2019, In: IEEE Pervasive Computing. 18, 3, p. 49-58 10 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Lifelong Learning 100%
  • Human Activity Recognition 100%
  • Lifelong Education 100%
  • Conceptual Framework 100%
  • Learning System 33%

• Representation learning for minority and subtle activities in a smart home environment

  Rosales Sanabria, A., Kelsey, T., Dobson, S. A. & Ye, J., 28 Oct 2019, In: Journal of Ambient Intelligence and Smart Environments. Pre-press, p. 1-19

  Research output: Contribution to journal › Article › peer-review

  • Home Environment 100%
  • Representation Learning 100%
  • Human Activity Recognition 100%
  • Learning System 50%
  • World Application 50%

• Representation learning for minority and subtle activities in a smart home environment

  Rosales Sanabria, A., Kelsey, T. W. & Ye, J., 22 Jul 2019, Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom 2019). IEEE Computer Society, 7 p. 8767417

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Home Environment 100%
  • Representation Learning 100%
  • Human Activity Recognition 100%
  • World Application 50%
  • Classification Technique 50%

• Robust audio sensing with multi-sound classification

  Ye, J. & Haubrick, P., 22 Jul 2019, 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE Computer Society, p. 1-7 7 p. 8767402. (Pervasive Computing and Communications (PerCom)).

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Health Condition 100%
  • Priori Knowledge 100%
  • Acoustic Signal 100%
  • Ambient Environment 100%
  • Daily Activity 100%

• Sensor-based human activity mining using Dirichlet process mixtures of directional statistical models

  Fang, L., Ye, J. & Dobson, S. A., 5 Oct 2019, Proceedings 2019 IEEE International Conference on Data Science and Advanced Analytics (DSAA 2019). Singh, L., De Veaux, R., Karypis, G., Bonchi, F. & Hill, J. (eds.). IEEE Computer Society, p. 154-163 10 p. 8964193. (Proceedings of the International Conference on Data Science and Advanced Analytics).

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Dirichlet Process 100%
  • Ambient Sensor 50%
  • Learning System 50%
  • Machine Learning 50%
  • Annotation 50%

• Speech emotion recognition with early visual cross-modal enhancement using spiking neural networks

  Mansouri-Benssassi, E. & Ye, J., 30 Sept 2019, 2019 International Joint Conference on Neural Networks, IJCNN 2019. Institute of Electrical and Electronics Engineers Inc., p. 1-8 8 p. 8852473. (Proceedings of the International Joint Conference on Neural Networks; vol. 2019-July).

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Speech Emotion Recognition 100%
  • Neural Network 100%
  • Information Processing 50%
  • Face Perception 50%
  • Signal Processing 50%
• 2018

  Diversity computing

  Fletcher-Wastson, S., De Jaegher, H., van Dijk, J., Frauenberger, C., Magnee, M. & Ye, J., 22 Aug 2018, In: Interactions. 25, 5, p. 28-33 5.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

• SLearn: shared learning human activity labels across multiple datasets

  Ye, J., 19 Mar 2018, 2018 IEEE International Conference on Pervasive Computing and Communications. IEEE Computer Society, 10 p. 8444594

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Annotation 100%
  • Collaborative Learning 100%
  • Recognition Accuracy 33%
  • Solution Space 33%
  • Training Data 33%

• Wearable assistive technologies for autism: opportunities and challenges

  Mansouri Benssassi, E., Gomez, J.-C., Boyd, L. E., Hayes, G. R. & Ye, J., Jun 2018, In: IEEE Pervasive Computing. 17, 2, p. 11-21

  Research output: Contribution to journal › Review article › peer-review

  Open Access

  File

  • Assistive Technology 100%
  • Social Interaction 100%
  • Interaction Analysis 50%
  • Wearable Technology 50%
  • Negative Impact 50%
• 2016

  A robust reputation-based location-privacy recommender system using opportunistic networks

  Zhao, Y., Ye, J. & Henderson, T., 1 Dec 2016, Proceedings of The 8th EAI International Conference on Mobile Computing, Applications and Services. ACM

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Recommender Systems 100%
  • Location Privacy 100%
  • opportunistic network 100%
  • Privacy Threat 20%
  • People Data 20%

• Capturing social cues with imaging glasses

  Murray, L., Hands, P., Goucher, R. & Ye, J., 12 Sept 2016, Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. New York, NY: ACM, p. 968-972 5 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • Social Situation 100%
  • Facial Expression 100%
  • Streaming Video 100%
  • Social Conversation 100%
  • Visually Impaired People 100%

• Detecting abnormal events on binary sensors in smart home environments

  Ye, J., Stevenson, G. & Dobson, S., Dec 2016, In: Pervasive and Mobile Computing. 33, p. 32-49 18 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Recognition Accuracy 100%
  • Home Environment 100%
  • Sensor Reading 100%
  • Technology Driven 100%
  • Healthcare Delivery 100%

• Discovery and recognition of unknown activities

  Ye, J., Fang, L. & Dobson, S. A., 12 Sept 2016, p. 783-792. 10 p.

  Research output: Contribution to conference › Paper › peer-review

  Open Access

  • Research Question 100%
  • Solution Space 100%
  • Service Delivery 100%
  • pervasive system 100%
  • Human Activity Recognition 100%

• Real-time emotion detection technologies for potential health applications

  Ye, J., Morrell, T. & Murray, L., 3 Jun 2016.

  Research output: Contribution to conference › Abstract › peer-review

  Open Access

  File

• Spatial awareness in pervasive ecosystems

  Dobson, S. A., Viroli, M., Fernandez-Marquez, J.-L., Zambonelli, F., Stevenson, G. T., di Marzo Serugendo, G., Montagna, S., Pianini, D., Ye, J., Castelli, G. & Rosi, A., 7 Dec 2016, In: The Knowledge Engineering Review. 31, 4, p. 343-366

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • pervasive system 100%
  • Spatial Reasoning 100%
  • Spatial Interaction 50%
  • Computational Modeling 50%

• The effect of privacy concerns on privacy recommenders

  Zhao, Y., Ye, J. & Henderson, T., 7 Mar 2016, Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI '16). New York: ACM, p. 218-227 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Location Privacy 100%
  • Privacy Preference 100%
  • Privacy Concern 100%
  • Facebook 33%
  • Influence Factor 33%
• 2015

  Are our mobile phones driving us apart? Divert attention from mobile phones back to physical conversation!

  Eddie, T., Ye, J. & Stevenson, G., 24 Aug 2015, MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, p. 1082-1087 6 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • Social Situation 100%
  • Mobile Technology 50%

• Developing pervasive multiagent systems with nature-inspired co-ordination

  Zambonelli, F., Omicini, A., Anzengruber, B., Castelli, G., DeAngelis, F., di Marzo Serugendo, G., Dobson, S. A., Fernandez Marquez, J.-L., Ferscha, A., Mamei, M., Mariani, S., Molesini, A., Montagna, S., Nieminen, J., Pianini, D., Rosi, A., Stevenson, G. T., Viroli, M. & Ye, J., Feb 2015, In: Pervasive and Mobile Computing. 17, Part B, p. 236-252

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Multi Agent Systems 100%
  • Coordination Model 100%
  • Open Research 33%
  • Pervasive Computing 33%
  • Research Direction 33%

• Fault detection for binary sensors in smart home environments

  Ye, J., Stevenson, G. & Dobson, S., 23 Mar 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE Computer Society, p. 20-28 9 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Home Environment 100%
  • Sensor Reading 100%
  • Outlier Detection 100%
  • Fault detection 100%
  • Anomaly Detection 100%

• KCAR: a knowledge-driven approach for concurrent activity recognition

  Ye, J., Stevenson, G. T. & Dobson, S. A., May 2015, In: Pervasive and Mobile Computing. 19, p. 47-70 24 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Driven Approach 100%
  • Activity Recognition 100%
  • Concurrent Activity 100%
  • Recognize Activity 16%
  • Approximate Matching 16%

• Semantic web technologies in pervasive computing: a survey and research roadmap

  Ye, J., Dasiopoulou, S., Stevenson, G. T., Meditskos, G., Kontopoulos, E., Kompatsiaris, I. & Dobson, S. A., Oct 2015, In: Pervasive and Mobile Computing. 23, p. 1-25 25 p.

  Research output: Contribution to journal › Article › peer-review

  Open Access

  File

  • Semantic Web Technology 100%
  • Semantic Web 100%
  • Pervasive Computing 100%
  • Data Stream 50%
  • Reasoning Technique 50%

• USMART: an unsupervised semantic mining activity recognition technique

  Ye, J., Stevenson, G. T. & Dobson, S. A., Jan 2015, In: ACM Transactions on Intelligent Interaction Systems. 4, 4, 27 p., 16.

  Research output: Contribution to journal › Article › peer-review

  • Daily Activity 100%
  • Activity Recognition 100%
  • Learning System 50%
  • Machine Learning 50%
  • Annotation 50%
• 2014

  Privacy-Aware Location Privacy Preference Recommendations

  Zhao, Y., Ye, J. & Henderson, T., 2 Dec 2014, Proceedings of the 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (Mobiquitous). p. 120-129

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution