Quantum Imaging for Monitoring of Wellbeing & Disease in Communities

Lead Research Organisation: University of Glasgow
Department Name: School of Engineering

Abstract

We have identified the home as the place where future transformational healthcare changes will occur with the greatest impact potential. Our vision is that the home of the future will be an environment that has the ability to follow our everyday movements, behaviour and wellness. In this sense, it will become an extension of our physical bodies, providing us with feedback, advice and alerts in the presence of anomalies in the data streams collected by new-generation sensors. The analysis of the data-streams from the sensors will be based on clinically approved models, thus effectively bringing highly trained expertise directly to the living environment.

Remote detection and monitoring of parameters such as gait, macro and micro-movements, blood flow, heart rate and potentially even brain function, when combined with data-driven models, will allow to both monitor health and the onset of non-communicable diseases (NCDs) but also recovery from NCDs or surgery with personalised and continuously updated re-habilitation programmes.
This therefore takes the concept of precision medicine and extends it to our overall physical and mental well-being, with the vision of enabling "precision healthcare" delivered to the home.

The sensors we are proposing are based on new-generation quantum-inspired cameras. These cameras can detect extremely low levels of light, thus rendering their presence in the home completely unobtrusive. The cameras can also detect the arrival time of light at the sensor with very high precision and at very high frame rates. The combination of these features enables the measurement of both macro-movement (in a similar fashion to more common cameras) and micro-movement (not currently possible with current, low-cost or low form-factor cameras). Micro-movement detection is sufficiently precise to capture nanometric variations in skin/body shape and thus directly detect blood flow, monitoring the precise shape and variations of heart beat. Future, very ambitious plans, include extending this capability to the brain. Our cameras can also be combined with RF technology to provide richer data, e.g. Doppler signals directly related to speed of movement.

All these indicators will be fed into machine learning models that monitor, learn and are updated over time and, most importantly, adapt to the individuals inhabiting the home environment. Thus, the systems will quickly adapt and evolve for bespoke individuals, providing precision healthcare monitoring and feedback.

Alongside the engineers and computer scientists working on the sensors and data analysis, our programme involves clinicians who will provide the interpretation models for our data and also partners who will give us access to new-generation intelligent homes inhabited by users who are already beta-testing sensors monitoring for example gross movement.

Planned Impact

Currently, Non-Communicable Diseases (NCDs) pose a major public health challenge, affecting more than 42% of the population. These individuals require significant resource across primary, secondary and community care. Coronary heart disease remains the leading public health problem in the UK in terms of its economic burden in community care with costs outside of clinical treatment that are approaching £8B. Other NCDs are becoming increasingly important with estimates now suggesting that stroke consumes more than 7% of spending in community healthcare. These figures continue to increase as demographic changes accelerate towards an ageing population.

Economic and demographic trends are likely to impact significantly on community healthcare systems over the coming decades, with increasingly dependent, unwell individuals either living alone or within other community care settings. The capacity for sensing and intelligent feedback in such future homes has the potential to enable residents to initiate programmes of professionally validated therapies for a variety of health and wellness issues.

Bringing precision healthcare to the home environment is therefore the main impact expected from our research programme with all the consequences that this will bring associated to improved life expectancy, improved quality of life, reduced pressure on the NHS and consequent improvement of service quality with the redeployment of the financial resources.

Our technology has the ability to assess not only physical health of an individual but also to measure proxies for mental health, social health and happiness/wellness. It will transform rehabilitation strategies and fitness monitoring, either at home or in community settings. If fully realized, the technology may also have a broad applicability within hospital environments. In all of these cases this research programme has the potential to mitigate the increasing health, social care and wellness costs of an ageing population, with growing prevalence of NCDs, not only within the immediate term but also as we approach 2050 and beyond.

Beyond the long-term impact described above, the following impacts are expected from this project in the short term, namely:

1. Advances in scientific knowledge and understanding that maintain the UK leadership position in the development and exploitation of novel engineering and data science solutions to assess health and wellness;

2. Partnerships with healthcare providers to develop cutting edge technology targeted to accelerate translation and enhance health and wellness of patients and individuals.

3. Contributions to the economic competitiveness of the United Kingdom, through the translation and commercialization of scientific knowledge into new technologies, services and products.

4. Trained researchers with a set of multidisciplinary skills in engineering, healthcare technologists and computing science for both academic and non-academic professions.

In summary we aim to generate impact by revolutionising health and care in the community for 2050 using novel, quantum-inspired, imaging methods, transforming homes and healthcare centres into smart-health environments through innovative machine learning and quantum sensor technology that is unobtrusive and data privacy-friendly.

Publications

10 25 50
 
Description Google Soli donation
Amount $200,000 (USD)
Organisation Google 
Sector Private
Country United States
Start 12/2021 
 
Description Moodagent Closed-loop Search PhD Studentship
Amount £37,000 (GBP)
Organisation Moodagent 
Sector Private
Country Denmark
Start 03/2022 
End 09/2025
 
Title 5G-Enabled Contactless Multi-User Presence and Activity Detection for Independent Assisted Living 
Description The dataset represents a combination of activities captured through wireless channel state information, using two USRP X300/X310 devices, to serve a system that was designed to detect presence and activities amongst multiple subjects. The dataset was divided into 16 classes, each represents a particular number of subjects and activities. More details can be found in the readme file. 
Type Of Material Database/Collection of data 
Year Produced 2021 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1151
 
Title Intelligent Wireless Walls for Contactless In-Home Monitoring 
Description The dataset is about monitoring human activities in complex Non-line-of-sight (Non-LOS) environments. Radio frequency (RF) sensing was employed in particular to collect unique channel fluctuations induced by multiple activities. The data collection hardware consists of two USRP devices one used as a transmitter (Tx) and one as receiver (Rx). Both USRPs are placed in a position where Tx and Rx were not in LOS. One was corner scenario, and the other was multifloor scenario. In the corner scenario, Tx was in one corridor while the Rx was in the other corridor and reflecting intelligent surface (RIS) was placed at corner to steer the beam towards the subject. The activities were performed between Tx and RIS. In multifloor scenario, Tx was on 5th floor and Rx was 3rd floor along with RIS. Activities were performed between RIS and Rx. Two subjects participated in experiments where each activity was performed for 6 seconds. The considered activities were sitting, standing, walking and empty. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1281
 
Title NodeNS Human Activity Dataset 
Description To date, numerous types of collection devices have been used in the recognition of human activities. However, due to the scarcity of training data, the task of 3D point cloud labelling has not yet made significant progress. To overcome this challenge, it is aimed to deduce this data requirements gap, allowing deep learning methods to reach their full potential in 3D point cloud tasks. The dataset used for this process is comprised of dense point clouds acquired with the static ground sensor by the NodeNs company supported MIMO radar (NodeNs ZERO 60 GHz IQ radar). It contains multiple types of human being data ranging from one to four individuals and encompasses a range of human action scenarios, including standing, sitting, picking up, falling, and walking. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1354
 
Title Non-invasive Localization using Software-Defined Radios 
Description The dataset is about locating human activities in an office environment. Radio frequency (RF) sensing was employed in particular to collect unique channel fluctuations induced by multiple activities. The data collection hardware consists of two USRP devices that communicate with each other when activity takes place inside their coverage region. The USRPs are based on the National Instrument (NI) X310/X300 models, which are connected to two PCs by 1G Ethernet connections and have extended bandwidth daughterboard slots that cover DC-6 GHz and up to 120 MHz of baseband bandwidth. The two PCs were equipped with Intel(R) Core (TM) i7 7700.360 GHz processors, 16 GB RAM, and the Ubuntu 16.04 virtual operating system. For wireless communication, the USRPs were equipped with VERT2450 omnidirectional antennae. One participant performed in a room environment for the duration of the experiment, collecting 4300 samples for seven different activities in three zones and locations. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1283
 
Title On the Reduction of Uplink Electromagnetic Field Exposure Using Reflecting Intelligent Surfaces: An Experimental Validation 
Description The dataset represents the measured values of power captured during uplink transmission by an E-field probe near a head phantom model to evaluate Specific Absorption Rate (SAR) in the presence of a Reconfigurable Intelligent Surface (RIS). A combination of different configurations (effective unit cells which are switched on) of RIS. The head phantom was marked with 120 different positions. For each RIS configuration, 120 measurements were recorded to measure sensed power at a head phantom model using an E-field probe. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1335
 
Title Pushing the Limits of Remote RF Sensing: Reading Lips Under Face Mask 
Description The dataset is about reading lips in a privacy preserving manner. In particular, radio frequency (RF) sensing was used to capture unique channel variation due to lip movements. USRP x300 was utilised equipped with the VERT2450 omnidirectional antenna and HyperLOG 7040 X used for reception and transmission respectively. Further, the same experiment was repeated with a Xethru UWB radar, where doppler frequency shifts due to lip movements are captured. We consider six classes for lip movements. Five vowels (a, e, i, o, u) and one empty class where lips were not moving. We are able to read lips even under face masks. Three subjects 1 male and 2 females participated in the experiments. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1282
 
Title Recognizing British Sign Language using Deep Learning: A Contact-less and Privacy-Preserving Approach 
Description The dataset is about BSL in a privacy-preserving manner. In particular, radio frequency (RF) sensing was used to capture doppler frequency shifts due to Head and Hand movements. Xethru UWB Radar X4M03 was used for reception and transmission respectively. We consider fifteen classes for BSL movements. fifteen Signs such as drink, eat, help, stop, walk, confused, depressed, pleased, hate, sad, family, brother, father, mother, and sister were performed. Four subjects 1 male and 3 females participated in the experiments. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1350
 
Title Remote laser-speckle sensing of heart sounds for health assessment and biometric identification 
Description The paper describes a contactless, machine-learning assisted method for heart-sound identification and quantification based on the remote measurement of the reflected laser speckle from the human neck skin surface. For more details see Readme.rtf 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL http://researchdata.gla.ac.uk/id/eprint/1238
 
Description Demonstration of our QUEST activity to the CEO UKRI and STFC 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Policymakers/politicians
Results and Impact Demonstration of our QUEST activity to the CEO UKRI and STFC
Year(s) Of Engagement Activity 2023