Intelligent RF Sensing for Falls and Health Prediction - INSHEP
Lead Research Organisation:
University of Glasgow
Department Name: School of Engineering
Abstract
The proportion of elderly people is increasing worldwide. In the UK, the Office for National Statistics estimates that "The number of people aged 75 and over is projected to rise by 89.3%, to 9.9 million, by mid-2039; the number of people aged 85 and over is projected to more than double, to reach 3.6 million by mid-2039; and the number of centenarians is projected to rise nearly 6 fold, from 14,000 at mid-2014 to 83,000 at mid-2039". Consequently, conditions such as diabetes, obesity, dementia, Parkinson's disease are expected to increase their incidence, with more and more people affected by multiple conditions at the same time (multimorbidity).
Furthermore, statistics in the UK show that "falls and fractures in people aged 65+ account for over 4 million hospital bed days each year in England alone, and the healthcare cost associated with fragility fractures is estimated at £2bn a year". Physical consequences of fall events (fractures, contusions, open wounds, abrasions, strain, and concussions) often require treatment at A&E departments if not hospitalisation, but they also lead to anxiety and loss of independence. All these reduce the quality of life of the people affected and of their families, as well as generate public costs for healthcare provision.
Our project will investigate how radar technologies will help vulnerable individuals (older people and people with cognitive or physical impairments, or with multi-morbidity conditions) preserve their independence and quality of life, and provide caregivers and health professionals with individualised information on each patient. In practical terms, our system will monitor activity levels over longer periods of time to detect early signs of cognitive and functional decline, providing not only prompt detection of critical events (e.g. falls, strokes), but also predicting these events from indicators in the data that will enable individualised prompt treatment and intervention from health professionals.
Radar sensors transmit and receive electromagnetic waves similar to those used by common devices such as Wi-Fi routers, and the analysis of the received echoes can provide information on how and where a person moves. Radar offers the advantage of providing contactless and non-intrusive monitoring, with no need for the end-users to carry or interact with devices, or alter their behaviour, and no need to record direct optical images of them. This makes these sensors attractive as a potential alternative to wearable sensors and conventional video-cameras, or as a complementary sensor to those ones.
Our project will combine cutting-edge research in the field of electronic engineering and machine learning, with end-users engagement from the very early stages (older people, caregivers, health professionals, community members). We will take into account their inputs, requirements, issues, attitudes in relating with our technology, and inform the design and technical choices while developing our system. This will enable to address potential users' acceptance issues and barriers to the development and adoption of the technology, an element of strength to maximise the impact of our proposal.
Furthermore, statistics in the UK show that "falls and fractures in people aged 65+ account for over 4 million hospital bed days each year in England alone, and the healthcare cost associated with fragility fractures is estimated at £2bn a year". Physical consequences of fall events (fractures, contusions, open wounds, abrasions, strain, and concussions) often require treatment at A&E departments if not hospitalisation, but they also lead to anxiety and loss of independence. All these reduce the quality of life of the people affected and of their families, as well as generate public costs for healthcare provision.
Our project will investigate how radar technologies will help vulnerable individuals (older people and people with cognitive or physical impairments, or with multi-morbidity conditions) preserve their independence and quality of life, and provide caregivers and health professionals with individualised information on each patient. In practical terms, our system will monitor activity levels over longer periods of time to detect early signs of cognitive and functional decline, providing not only prompt detection of critical events (e.g. falls, strokes), but also predicting these events from indicators in the data that will enable individualised prompt treatment and intervention from health professionals.
Radar sensors transmit and receive electromagnetic waves similar to those used by common devices such as Wi-Fi routers, and the analysis of the received echoes can provide information on how and where a person moves. Radar offers the advantage of providing contactless and non-intrusive monitoring, with no need for the end-users to carry or interact with devices, or alter their behaviour, and no need to record direct optical images of them. This makes these sensors attractive as a potential alternative to wearable sensors and conventional video-cameras, or as a complementary sensor to those ones.
Our project will combine cutting-edge research in the field of electronic engineering and machine learning, with end-users engagement from the very early stages (older people, caregivers, health professionals, community members). We will take into account their inputs, requirements, issues, attitudes in relating with our technology, and inform the design and technical choices while developing our system. This will enable to address potential users' acceptance issues and barriers to the development and adoption of the technology, an element of strength to maximise the impact of our proposal.
Planned Impact
Our project aims to develop a system based on radar sensors to monitor activity levels of vulnerable people (older individuals and people with cognitive or physical impairments or with multimorbidity (two or more long-term conditions), detect critical events (e.g. falls), and predict the insurgence of these events by looking at deviations from normal behaviour that may be related to worsening health status.
This system will benefit older and vulnerable people, enabling them to live independently and for longer time in their homes, avoiding or postponing the need to move to specialised care facilities such as nursing homes, or hospitalization in case of acute treatment. This will also help families and caregivers, providing peace of mind and more accurate automatic monitoring of vulnerable patients, as well as support health professionals with more specific information on the patients. Degrading health conditions may cause subtle changes in the normal behaviour of the people affected, especially in the case of older individuals, but detecting these signs may be very challenging for health professionals and caregivers who can only visit each specific patient sporadically.
This can also have a significant economic and societal impact, contributing to a more cost-effective NHS that can provide better healthcare with reduced resources with the help of technological solutions. This is in line with the EPSRC delivery plan ambition to make the UK a "healthy nation", specifically the challenge of "transforming community health" (by promoting and supporting independent living of vulnerable people in their homes).
As one of the barriers to the adoption and use of ICT based solutions for activity monitoring and fall detection is the lack of confidence and awareness in both healthcare professionals and end-users [1], we will make sure to involve them from the very early stage of the design and testing of our technology. We will incorporate their inputs, requirements, and needs, as well as address any potential issues and concerns regarding the use and the interaction with our technology. We will involve a broad spectrum of end-users through engagement with members of the public and charities and community groups (e.g. Age Scotland, Glasgow Old People Welfare Association), as well as professional caregivers, health professionals in the NHS (NHS Greater Glasgow and Clyde Community Falls Prevention Programme, Greater Glasgow and Clyde or Lanarkshire Health Boards), and policy makers (Glasgow City Council). This engagement work will consist of a series of interviews/focus groups as well as actual testing and direct involvement feedback from the users on the technology, with the addition of two workshop events to bring together the different stakeholders and present the project's results and outputs. We will also leverage on existing support and multidisciplinary collaborations within the University to maximise the academic impact and reach of this work, for example liaising with colleagues at the Institute of Health and Wellbeing (Prof Frances Mair, professor of primary care, and Prof Neil Hawkins, professor of health assessment technologies). Part of these impact activities will also involve Chinese stakeholders (healthcare professionals and policy makers at the UESTC and Sichuan Provincials hospitals, and members of the China Britain Business Council), leveraging on the existing partnership of the University of Glasgow with the University of Electronic Science and Technology of China (UESTC) in Chengdu. The problem of aging populations and related challenges for effective healthcare provision are becoming more and more relevant in China, hence there is significant interest for research and market opportunities for assistive living solutions.
[1] "Report to Congress: Aging Services Technology Study", report by the US Department of Health and Human Services, Office for Disability, Aging and Long-Term Care Policy, June 2012.
This system will benefit older and vulnerable people, enabling them to live independently and for longer time in their homes, avoiding or postponing the need to move to specialised care facilities such as nursing homes, or hospitalization in case of acute treatment. This will also help families and caregivers, providing peace of mind and more accurate automatic monitoring of vulnerable patients, as well as support health professionals with more specific information on the patients. Degrading health conditions may cause subtle changes in the normal behaviour of the people affected, especially in the case of older individuals, but detecting these signs may be very challenging for health professionals and caregivers who can only visit each specific patient sporadically.
This can also have a significant economic and societal impact, contributing to a more cost-effective NHS that can provide better healthcare with reduced resources with the help of technological solutions. This is in line with the EPSRC delivery plan ambition to make the UK a "healthy nation", specifically the challenge of "transforming community health" (by promoting and supporting independent living of vulnerable people in their homes).
As one of the barriers to the adoption and use of ICT based solutions for activity monitoring and fall detection is the lack of confidence and awareness in both healthcare professionals and end-users [1], we will make sure to involve them from the very early stage of the design and testing of our technology. We will incorporate their inputs, requirements, and needs, as well as address any potential issues and concerns regarding the use and the interaction with our technology. We will involve a broad spectrum of end-users through engagement with members of the public and charities and community groups (e.g. Age Scotland, Glasgow Old People Welfare Association), as well as professional caregivers, health professionals in the NHS (NHS Greater Glasgow and Clyde Community Falls Prevention Programme, Greater Glasgow and Clyde or Lanarkshire Health Boards), and policy makers (Glasgow City Council). This engagement work will consist of a series of interviews/focus groups as well as actual testing and direct involvement feedback from the users on the technology, with the addition of two workshop events to bring together the different stakeholders and present the project's results and outputs. We will also leverage on existing support and multidisciplinary collaborations within the University to maximise the academic impact and reach of this work, for example liaising with colleagues at the Institute of Health and Wellbeing (Prof Frances Mair, professor of primary care, and Prof Neil Hawkins, professor of health assessment technologies). Part of these impact activities will also involve Chinese stakeholders (healthcare professionals and policy makers at the UESTC and Sichuan Provincials hospitals, and members of the China Britain Business Council), leveraging on the existing partnership of the University of Glasgow with the University of Electronic Science and Technology of China (UESTC) in Chengdu. The problem of aging populations and related challenges for effective healthcare provision are becoming more and more relevant in China, hence there is significant interest for research and market opportunities for assistive living solutions.
[1] "Report to Congress: Aging Services Technology Study", report by the US Department of Health and Human Services, Office for Disability, Aging and Long-Term Care Policy, June 2012.
Organisations
- University of Glasgow (Lead Research Organisation)
- University of Electronic Science and Technology of China (UESTC) (Collaboration)
- Innovation Centre for Sensor and Imaging Systems CENSIS (Collaboration)
- Angel Monitors Ltd (Collaboration)
- University of Alabama, Tuscaloosa (Collaboration)
- Cergy-Pontoise University (Collaboration)
- Government of Scotland (Collaboration)
- Groupement Hospitalier de Territoire Nord Ouest Vexin Val d'Oise (Collaboration)
- Nanjing University of Science and Technology (Collaboration)
- Innovation Centre for Sensor and Imaging Systems (Project Partner)
- Health and Social Care Alliance Scotland (Project Partner)
Publications
Abdur Rahman M
(2019)
A Secure Occupational Therapy Framework for Monitoring Cancer Patients' Quality of Life.
in Sensors (Basel, Switzerland)
Alam MS
(2022)
Repurposing of existing antibiotics for the treatment of diabetes mellitus.
in In silico pharmacology
Ding C
(2019)
Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar
in IEEE Transactions on Geoscience and Remote Sensing
Fioranelli D
(2019)
Radar sensing for healthcare Associate Editor Francesco Fioranelli on the applications of radar in monitoring vital signs and recognising human activity patterns
in Electronics Letters
Fioranelli F
(2019)
Radar for Health Care: Recognizing Human Activities and Monitoring Vital Signs
in IEEE Potentials
Fioranelli F
(2019)
Multistatic human micro-Doppler classification with degraded/jammed radar data
Fioranelli F
(2019)
Radar-based evaluation of lameness detection in ruminants: preliminary results
Fioranelli F
(2019)
Multistatic Human Micro-Doppler Classification with Degraded/Jammed Radar Data
Fioranelli F
(2021)
Radar sensing for human healthcare: challenges and results
Fioranelli F
(2019)
Radar-based Evaluation of Lameness Detection in Ruminants: Preliminary Results
Iloga S
(2021)
Human Activity Recognition Based on Acceleration Data From Smartphones Using HMMs
in IEEE Access
Kernec J
(2019)
Radar Sensing in Assisted Living: an Overview
Le Kernec J
(2019)
Radar Signal Processing for Sensing in Assisted Living: The Challenges Associated With Real-Time Implementation of Emerging Algorithms
in IEEE Signal Processing Magazine
Le Kernec J.
(2019)
Radar Sensing in Assisted Living: An Overview
Li H
(2020)
Bi-LSTM Network for Multimodal Continuous Human Activity Recognition and Fall Detection
in IEEE Sensors Journal
Li H
(2018)
A Multisensory Approach for Remote Health Monitoring of Older People
in IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology
Li H
(2019)
FMCW radar and inertial sensing synergy for assisted living
in The Journal of Engineering
Li H
(2019)
Magnetic and Radar Sensing for Multimodal Remote Health Monitoring
in IEEE Sensors Journal
Li H
(2021)
Sequential Human Gait Classification With Distributed Radar Sensor Fusion
in IEEE Sensors Journal
Li H
(2020)
Hierarchical Sensor Fusion for Micro-Gesture Recognition With Pressure Sensor Array and Radar
in IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology
Li J
(2019)
From Kinect skeleton data to hand gesture recognition with radar
in The Journal of Engineering
Li X
(2020)
Hierarchical Radar Data Analysis for Activity and Personnel Recognition
in Remote Sensing
Liang X
(2019)
Fusion of Wearable and Contactless Sensors for Intelligent Gesture Recognition
in Advanced Intelligent Systems
Patel J
(2019)
Fusion of Deep Representations in Multistatic Radar Networks to Counteract the Presence of Synthetic Jamming
in IEEE Sensors Journal
Shah S
(2022)
Data portability for activities of daily living and fall detection in different environments using radar micro-doppler
in Neural Computing and Applications
Shah S
(2019)
RF Sensing Technologies for Assisted Daily Living in Healthcare: A Comprehensive Review
in IEEE Aerospace and Electronic Systems Magazine
Shrestha A
(2019)
Activity recognition with cooperative radar systems at C and K band
in The Journal of Engineering
Shrestha A
(2019)
Elderly care: activities of daily living classification with an S band radar
in The Journal of Engineering
Shrestha A
(2018)
Activity recognition with cooperative radar systems at C and K band
Shrestha A
(2020)
Continuous Human Activity Classification From FMCW Radar With Bi-LSTM Networks
in IEEE Sensors Journal
Yang S
(2023)
The Human Activity Radar Challenge: Benchmarking Based on the 'Radar Signatures of Human Activities' Dataset From Glasgow University
in IEEE Journal of Biomedical and Health Informatics
Zhou B
(2021)
Simulation framework for activity recognition and benchmarking in different radar geometries
in IET Radar, Sonar & Navigation
| Description | This award started less than one year ago so it is still a work in progress, also supported by the complementary work of two PhD students (one self-funded, one supported by the College of Science and Engineering at the University of Glasgow). There are three main achievements to report at this stage: -the development/acquisition of a relatively large set of equipment (radar systems, data processing platforms) to support the research connected with this award at the University of Glasgow, and the ongoing collection of a set of data (human indoor activities and vital signs parameters such as respiration) within the university/lab environment -the initial development of promising results from data analysis, using conventional supervised learning and deep learning on the radar data - these have contributed to publications (listed separately on this website) in terms of academic outputs, some of them with international collaborators (UESTC, Nanjing University, University of Alabama Tuscaloosa) -the initial outreach work with partners that can support the co-development of the technology and its effective validation/deployment in realistic scenarios. Contacts include NG Homes in Glasgow, Albyn Housing in the Scottish Highlands, and Age UK West Cumbria. Current work on this is to finalise Ethics approval and specific methodology/deployment requirements to involve members of the public. |
| Exploitation Route | Our finding are still at an initial stage, but it is anticipated interest from the healthcare and policy/communities social sector. Our work can contribute to technology for contactless and privacy respectful monitoring of people, looking at their activities patterns to detect any anomaly, raise alarms in case of critical events such as falls, and monitoring of parameters such as gait or respiration. We are at initial stages of engagement with charities/housing associations interested in developing smart homes for their tenants/customers from a social perspective (listed above) and we have secured small extra funding through CENSIS Scottish Government Innovation Centre for a specific application of our technology to monitor vital signs. These activities are still in their infancy, but represents a good opportunity to translate our research outside of the university walls. |
| Sectors | Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Electronics,Healthcare,Pharmaceuticals and Medical Biotechnology |
| Description | CENSIS R&D Project |
| Amount | £46,000 (GBP) |
| Organisation | Innovation Centre for Sensor and Imaging Systems CENSIS |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 02/2019 |
| End | 08/2019 |
| Description | DIM-RSI |
| Amount | € 42,000 (EUR) |
| Funding ID | smart_gait : mobility lab for the study of frailty |
| Organisation | CY Cergy Paris University |
| Sector | Academic/University |
| Country | France |
| Start | 01/2021 |
| End | 01/2022 |
| Description | IMSHAPE: Intelligent Multimodal Sensing for falls and HeAlth PrEdictions |
| Amount | £7,500 (GBP) |
| Funding ID | 515095684 |
| Organisation | British Council |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 02/2021 |
| End | 02/2023 |
| Description | INEX CARING |
| Amount | € 106,000 (EUR) |
| Organisation | Cergy-Pontoise University |
| Sector | Academic/University |
| Country | France |
| Start | 11/2019 |
| Description | IPDF fund Glasgow for collaboration with University of Alabama Tuscaloosa |
| Amount | £1,800 (GBP) |
| Organisation | University of Glasgow |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 10/2018 |
| End | 07/2019 |
| Description | Interface Standard Innovation Voucher |
| Amount | £4,800 (GBP) |
| Organisation | Government of Scotland |
| Department | Scottish Funding Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 07/2018 |
| End | 09/2018 |
| Title | Radar signatures of human activities |
| Description | The dataset includes radar signatures of different indoor human activities performed by different people in different locations. The purpose is to offer the research community a set of data to develop and benchmark feature extraction and classification algorithms in the general context of assisted living, for example to detect falls or anomalies in the normal pattern of activities of people. The dataset includes a readme document with additional information and there is a related publication that we would ask users of the data to cite as an acknowledgement. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2019 |
| Provided To Others? | Yes |
| Description | CENSIS and Interface: activity and vital signs monitoring using radar |
| Organisation | Angel Monitors Ltd |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | My team and I contribute to expertise in radar and RF systems and algorithms to monitor human activities and vital signs. This includes access to the facilities we have at the Universtiy of Glasgow to validate radar systems for that specific purpose and perform the relevant data processing. |
| Collaborator Contribution | CENSIS provided further funding and helped liaise with Angelmonitors, an SME operating in Scotland and interested in vital signs and activity monitoring in custody environments. They brought expertise in this specific domain/application. Interface and SFC provided the initial small funding for de-risking reserach activity, which was instrumental to secure the larger project with CENSIS. |
| Impact | At this stage the output is just a conference paper arisen from the short work supported by the Interface voucher. A longer project is starting in February. |
| Start Year | 2018 |
| Description | CENSIS and Interface: activity and vital signs monitoring using radar |
| Organisation | Government of Scotland |
| Department | Scottish Funding Council |
| Country | United Kingdom |
| Sector | Public |
| PI Contribution | My team and I contribute to expertise in radar and RF systems and algorithms to monitor human activities and vital signs. This includes access to the facilities we have at the Universtiy of Glasgow to validate radar systems for that specific purpose and perform the relevant data processing. |
| Collaborator Contribution | CENSIS provided further funding and helped liaise with Angelmonitors, an SME operating in Scotland and interested in vital signs and activity monitoring in custody environments. They brought expertise in this specific domain/application. Interface and SFC provided the initial small funding for de-risking reserach activity, which was instrumental to secure the larger project with CENSIS. |
| Impact | At this stage the output is just a conference paper arisen from the short work supported by the Interface voucher. A longer project is starting in February. |
| Start Year | 2018 |
| Description | CENSIS and Interface: activity and vital signs monitoring using radar |
| Organisation | Innovation Centre for Sensor and Imaging Systems CENSIS |
| Country | United Kingdom |
| Sector | Charity/Non Profit |
| PI Contribution | My team and I contribute to expertise in radar and RF systems and algorithms to monitor human activities and vital signs. This includes access to the facilities we have at the Universtiy of Glasgow to validate radar systems for that specific purpose and perform the relevant data processing. |
| Collaborator Contribution | CENSIS provided further funding and helped liaise with Angelmonitors, an SME operating in Scotland and interested in vital signs and activity monitoring in custody environments. They brought expertise in this specific domain/application. Interface and SFC provided the initial small funding for de-risking reserach activity, which was instrumental to secure the larger project with CENSIS. |
| Impact | At this stage the output is just a conference paper arisen from the short work supported by the Interface voucher. A longer project is starting in February. |
| Start Year | 2018 |
| Description | GHT Novo Val d'Oise |
| Organisation | Groupement Hospitalier de Territoire Nord Ouest Vexin Val d'Oise |
| Country | France |
| Sector | Hospitals |
| PI Contribution | We bring our expertise in radar sensing in assisted living in the context of assisted living and in-home monitoring to help develop innovative solutions to transition patietns from primary care units toward community or in-home care with automated monitoring of the patients' helath. |
| Collaborator Contribution | The Head of the pneumology department is helping us develop expertise for patients with COPD and organise patient recruitment to test our tech with real-patients to try and quantify the accuracy for vital signs |
| Impact | A Secure Occupational Therapy Framework for Monitoring Cancer Patients' Quality of Life Sensors. 2019-11-29 | journal-article. DOI: 10.3390/s19235258 |
| Start Year | 2018 |
| Description | Nanjing University of Science and Technology |
| Organisation | Nanjing University of Science and Technology |
| Country | China |
| Sector | Academic/University |
| PI Contribution | Data sharing, co-development of algorithms for radar data analysis and co-supervision of PhD students |
| Collaborator Contribution | Data sharing, co-development of algorithms for radar data analysis |
| Impact | Academic papers |
| Start Year | 2018 |
| Description | UESTC and University of Cergy Pontoise |
| Organisation | University of Electronic Science and Technology of China (UESTC) |
| Country | China |
| Sector | Academic/University |
| PI Contribution | Data sharing, co-development of algorithms for radar data analysis and co-supervision of PhD students |
| Collaborator Contribution | Data sharing, co-development of algorithms for radar data analysis and co-supervision of PhD students |
| Impact | Academic papers |
| Start Year | 2018 |
| Description | University of Alabama Tuscaloosa |
| Organisation | University of Alabama, Tuscaloosa |
| Country | United States |
| Sector | Academic/University |
| PI Contribution | This is a research partnership between our two universities. One of my PhD student, whose work is closely aligned with this EPSRC project, visited for 10 weeks the laboratory run by Dr Sevgi Gurbuz. We have published one conference paper so far and working towards journal papers. Our contribution, besides from time and resources to support the student's visit, was mainly on data sharing and algorithms co-development. |
| Collaborator Contribution | Their contribution is mainly based on deep learning methods for analysis of radar data, as well as the generous access to their lab and facilities. |
| Impact | The current outputs have been of academic nature so far, i.e. papers at conferences and in preparation journal papers. |
| Start Year | 2018 |
| Description | University of Cergy Pontoise and UESTC |
| Organisation | Cergy-Pontoise University |
| Country | France |
| Sector | Academic/University |
| PI Contribution | Contributed to data sharing and co-development of algorithms for analysis of human activities using radar |
| Collaborator Contribution | Contributed to data sharing and co-development of algorithms for analysis of human activities using radar |
| Impact | Academic papers, joint funding applications |
| Start Year | 2018 |
| Title | Dispositif de caractérisation de l'actimétrie d'un sujet en temps réel |
| Description | L'invention présente un dispositif (1) pour caractériser en temps réel l'actimétrie d'un sujet, présentant : un radar (2) émettant et recevant des signaux radar et présentant une interface logicielle pour configurer la forme du signal émis ; des moyens de traitement et de calcul (3) couplés au radar (2), présentant un classifieur (3a) entrainé à l'aide d'une base de données, lesdits moyens de traitement et de calcul (3) étant configurés pour réaliser en temps réel: -une acquisition d'images micro-doppler (6) couleurs ayant plusieurs canaux de couleurs (R, V, B), présentant chacune des signatures micro-doppler (6a) avec des pixels couleurs dont la valeur est fonction d'une réflectivité et d'une vitesse du sujet; -un traitement des images micro-doppler (6) pour : calculer une image dite monochromatique ayant des pixels monochromatiques, ayant chacun une intensité monochromatique donnée, à partir des pixels couleurs de chaque image micro-doppler couleur ; transformation de l'image monochromatique en image binaire par segmentation, selon un seuil d'intensité, des pixels monochromatiques, réalisant des pixels binaires dont la valeur est dépendante de l'intensité chromatique du pixel monochromatique associé au pixel binaire, par rapport au seuil, Figure 1 |
| IP Reference | EP19306308 |
| Protection | Patent application published |
| Year Protection Granted | 2021 |
| Licensed | No |
| Impact | currently in progress. We do not know if this will be granted yet but the patent has been submitted. It is likely to be used to leverage for projects in the consortium we are forming. This has created opportunities to collaborate with France University Cergy-Pontoise, TU Deflt and the University of Glasgow who are now part of a consortium around asisted living to bid for projects in that area to leverage the IP (if it is granted). |
| Title | METHOD AND DEVICE FOR HUMAN ACTIVITY CLASSIFICATION USING RADAR MICRO DOPPLER AND PHASE |
| Description | The invention relates to the field of real-time detection and characterization of 5 the body motion of a subject. More particularly, the invention relates to a method and a device for real-time classification of human activity using micro-Doppler signatures. |
| IP Reference | EP21306742.4 |
| Protection | Patent / Patent application |
| Year Protection Granted | 2021 |
| Licensed | No |
| Impact | METHOD AND DEVICE FOR HUMAN ACTIVITY CLASSIFICATION USING RADAR MICRO DOPPLER AND PHASE EP21306742.4 this has been flagged for a high growth spin out but we ran into technical difficulties which has delayed this endeavour. |
| Description | AFRL Invited Talk |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Professional Practitioners |
| Results and Impact | Invited talk at the US Air Force Reserach Laboratory, supported by Window of Science travel grant. This took place for two days in Dayton, OH, in 2018, and saw the joint participation of Dr Fioranelli and Dr Gurbuz (collaborator at Universtiy of Alabama Tuscaloosa). The discussion outlined outstanding research challenges in the use of deep learning methods for radar data when analysing human signatures, and discussed possible forms of support/funding to address those. |
| Year(s) Of Engagement Activity | 2018 |
| Description | EMSIG UK Radar Society Meetings |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | The Electro Magnetic Systems Interest Group (EMSIG) - was established in 2017 to encourage discussion of research achievements and requirements for radiofrequency remote sensing systems and to promote research and development activities on such systems. One of the principal EMSIG activities is to promote networking and cooperation between experts working in Industry (from Prime Government Contractors to Small and Medium sized Enterprises), Academia (from Professorial staff to PhD students) and Government organisations (e.g. Ministry of Defence, Defence Science and Technology Laboratory, UK Research Councils, Innovate UK). The activities we took part in included organisation/participation of the annual plenary Forum (in Birmingham 2018) and two focus groups event (in Birmingham and Glasgow 2018) where two talks were given, covering the initial results generated in this EPSRC project. |
| Year(s) Of Engagement Activity | 2018 |
| Description | Invited Speaker - Radar sensing in assisted living: latest developments, International Conference on Electronics, Computing and Communication Technologies (CONECCT 2022), Bangalor, India |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | 8 Jul 2022 Invited Speaker - Radar sensing in assisted living: latest developments, International Conference on Electronics, Computing and Communication Technologies (CONECCT 2022), Bangalor, India. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Invited seminar - radar sensing in assisted living, 2021 European Microwave Week, London, UK |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | 7 April 2022 Invited seminar - radar sensing in assisted living, 2021 European Microwave Week, London, UK (delayed covid) |
| Year(s) Of Engagement Activity | 2022 |
| Description | Invited talk - Radar sensing in assisted living: latest developments, UK-China Biological Imaging and Sensing Workshop, NJUST, Nanjing, China |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | 1 April 2022 Invited talk - Radar sensing in assisted living: latest developments, UK-China Biological Imaging and Sensing Workshop, NJUST, Nanjing, China |
| Year(s) Of Engagement Activity | 2022 |
| Description | Keynote radar sensing in assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote, "Radar sensing in assisted living", 3rd international conference on integrated intelligent computing, communication and security ICIIC-2021, Bengaluru, India |
| Year(s) Of Engagement Activity | 2021 |
| Description | Keynote speaker - radar in assisted living, AEIC 2nd international conference on artificial intelligence, Automation and High Performance Computing (AIAHPC) 2022 |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | 25 Feb 2022 Keynote Speaker - Radar sensing in assisted living, AEIC 2nd International conference on Artificial Intelligence, Automation and High Performance Computing (AIAHPC) 2022, Zhuhai, China |
| Year(s) Of Engagement Activity | 2022 |
| Description | Keynote speaker, "radar sensing in assisted living : latest developments", International Conference on Data Science and Information System (ICDSIS - 2022), Hassan, India |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | 29 Jul 2022 Keynote speaker, "radar sensing in assisted living : latest developments", International Conference on Data Science and Information System (ICDSIS - 2022), Hassan, India |
| Year(s) Of Engagement Activity | 2022 |
| Description | Radar Sensing in Assisted Living - keynote |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote speaker, in the International Webinar on "Radar Sensing in Assisted Living" organized by Department of Electronics and Communication Engineering, GSSSIETW Mysuru in association with IETE Mysuru Centre, Karnataka, India. |
| Year(s) Of Engagement Activity | 2021 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | This is was a science cafe talk organised by the French consulate in Chengdu. I presented our research to the general public and undergraduate students. |
| Year(s) Of Engagement Activity | 2019 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | International Forum on Advanced Radar and Signal Processing - distinguished lecturer series - I was invited to present our work to a panel of signal processing experts alongside12 other participants in Beijing Institute of Technology. I made some good connections to continue working with postgraduates in China and a professor in Italy. |
| Year(s) Of Engagement Activity | 2019 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Undergraduate students |
| Results and Impact | I was presenting our research stemming from INSHEP and other research funds related to assisted living and our collaborations with our undergraduate students in China to spark interest in the research for year 1 and year 2 students. |
| Year(s) Of Engagement Activity | 2019 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Undergraduate students |
| Results and Impact | There was a mock conference organised by our Glasgow College UESTC in Chengdu and they were looking for Keynote speeches and judges for the research being presented. This helped spark interest in the topic and encouraging students to pursue their projects in areas of interests like health. |
| Year(s) Of Engagement Activity | 2019 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | I have been invited to deliver a talk at ICEDME 2020 a a keynote speaker, they have requested me to record a video because they like the presentation and want to post it online for public viewing. |
| Year(s) Of Engagement Activity | 2020 |
| URL | http://www.icedme.net/keynote |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | Advances in Radar IEEE LUMS chapter seminar series - Radar in Assiste Living - Islamabad, Pakistan |
| Year(s) Of Engagement Activity | 2020 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | IEEE Webinar series - "Radar sensing in assisted living" - IEEE joint Microwave Theory & Techniques, Antenna & Propagation and Electromagnetic Compatibility/Interference (MTT-AP-EMC) chapter - Pakistan - |
| Year(s) Of Engagement Activity | 2020 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | I was invited to give a talk in Radar sensing for assisted living in Smart Industry Workshop 2019 in Nottingham Trent University in the context of future applications of smart systems including robotics, healthcare, services, agriculture. |
| Year(s) Of Engagement Activity | 2019 |
| URL | https://twitter.com/UofGCSI/status/1083288377791836160 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | I gave an invited talk on radar for assisted living to a panel of experts at the ICSIDP conference in 2019 in Chongqing. This has spaked opportuinities for funding and collaboration with Italy, China and Canada. |
| Year(s) Of Engagement Activity | 2019 |
| URL | http://www.icsidp.org/page.asp?id=198 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Other audiences |
| Results and Impact | EMSIG-MODEST Workshop |
| Year(s) Of Engagement Activity | 2020 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | I was invited by University of Hainan in China to give a talk on radar for assisted living and we have applied for funding together. We are awaiting results on this particular topic. we combined UWB location with Radar sensing. |
| Year(s) Of Engagement Activity | 2019 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | Distinguished speaker - "Radar sensing in assisted living" IEEE ICCE 2020 - International Conference for Convergence in Engineering, Kolkata, India |
| Year(s) Of Engagement Activity | 2020 |
| Description | Radar for assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | Seminar - Radar sensing in assisted living - workshop on advances in radar, Xidian University, Xi'an, China. |
| Year(s) Of Engagement Activity | 2020 |
| Description | Radar in assisted living - UCL seminar series |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Seminar, "Radar sensing in assisted living", University College London, UK. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.youtube.com/watch?v=sn323hhoRj8 |
| Description | Radar sensing in assisted living - keynote |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote Speech - Radar for assisted living - ICEDME2021, Qingdao, China |
| Year(s) Of Engagement Activity | 2021 |
| Description | Seeds meeting H2020 |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | We are working with academics in health and ageing policy, health practitioners, industry service providers for the elderly and engineering academics to tackle the problem of creating assistive technologies that answer the needs of transitioning from primary care units to in-home care. |
| Year(s) Of Engagement Activity | 2020 |
| Description | an invited talk radar sensing in assisted living |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | 50 people attended the special session on microDoppler signatures at CIE international radar conference which sparked questions on assisted living after my invited talk and I got several contacts for further collaborations from this talk. |
| Year(s) Of Engagement Activity | 2021 |
| Description | seminar BIOSAN - radar sensing in assisted living and veterinary science |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Postgraduate students |
| Results and Impact | This seminar had 11 participants from a master degree course on biomed - the seminar was to widen the horizon of students on the use of radar in biomedical engineering. Students have asked questions on the applications during and after the presentation. |
| Year(s) Of Engagement Activity | 2021,2022 |