Wearable Data Streaming Eco-system

Objective

This project aims to develop a system that streams real-time heart rate data from the Google Pixel Watch to Unity games, enabling the game content to dynamically adapt based on the player's heart rate.

Method

We created a heart rate streaming platform consisting of three components: a Wear OS app running on the Pixel Watch, an Android app on a handheld device, and a C# script within Unity. Heart rate data is transmitted from the Pixel Watch to the Android device via the Data Layer, and then from the Android device to Unity using the LSL (Lab Streaming Layer) framework.

Contributors

Dr. Zilu Liang

GitHub Repo

https://github.com/PiranitaGomez/BiosensingDataLayer (will be made public)

Presentations

• Liang Z. (2024) Harnessing Consumer Smartwatches for Real-Time Heart Rate Streaming in Unity Game Engine. In Proceedings of 2024 IEEE Consumer Life Tech Conference (ICLT 2024), Sydney, Australia.  [Scopus]

• Liang Z. (2024) Middleware Solution for Real-Time Physiological Data Streaming from Consumer Smartwatches. In Proceedings of the 6th World Symposium on Software Engineering (WSSE 2024), Kyoto, Japan.  [Best Presentation Award]

Objective

We’re creating StreamHub—an advanced system designed to seamlessly aggregate real-time physiological data from widely-used wearable devices, such as the Empatica E4 wristband, PupilCore eye-tracker, and more. This project aims to bridge the gap between diverse physiological sensors, enabling researchers and developers to access and analyze multi-modal data effortlessly.

Method

StreamHub will be developed as either an Android app (using Java or Kotlin) or a Windows app (using C#), providing flexibility for different platforms and use cases.

Join Us!

We’re looking for passionate developers to contribute to this exciting project. If you’re interested in shaping the future of wearable data collection and want to get involved, please contact Dr. Liang / liang.zilu@kuas.ac.jp

GitHub Repo

Coming soon...

Presentations

Coming soon...