Immersive Feedback Using Inertial Sensors

Zero Point Motion is a start-up commercialising a new disruptive type of inertial sensor that uses photonics to achieve ultra-low noise tracking of motion, improving positioning accuracy by over 100x compared to existing sensors inside smartphones, cars or game controllers.

With additional sensitivity, our sensors enhance the ability to track complex and fine motion such as finger motion, enabling new interactions between user and AR/VR applications. An exciting and profound outcome of the sensitivity of our accelerometers is exploring the ability to detect the motion of the body as it recoils from the heart ejecting blood. This is known as ballistocardiography and provides measurements of both heart rate, as well as heart function.

With the improved sensitivity offered by our sensors, this project looks at tracking the motion of a single finger whilst simultaneously performing ballistocardiography with an armband or insole through simple initial demonstrations. For example, measuring the response to different choices presented on a screen or in VR, synchronised by the selected options through finger gestures. Basic puzzles that involve finger tracing can be used alongside the ballistocardiogram to understand game play and excitement. By providing early access of our sensor prototypes to our collaborators UWE and x-io, we strengthen our proof-of-concept by accessing deep expertise in the application of sensors for embedded systems, VR/AR, motion capture for biomechanics and wireless data logging. UWE has a world-class track record in intelligent systems, machine vision, and bio-sensing, with state of the art facilities in the AR/VR domain. This is a unique opportunity to become leaders in an emerging bioengineering market that has already produced ultrasonic sensors for hand-based interactions to infer emotional wellbeing. Unlike ultrasonic devices, our sensors are more capable of tracking 3D motions, and adding untapped information through ballistocardiography with additional resolution.

Upon completion of this initial industrial research, we can then initiate or inspire deeper studies with industry end-users such as content creators, and invite critical experts in bioengineering and psychology who can quantify the link between the physiological behaviour we detect through ballistocardiography with human emotion and immersion.