Wearable Deep Spinal Interfacing (WDSI)
Lead Research Organisation:
Imperial College London
Department Name: Computing
Abstract
require augmenting the capacity of humans to control and coordinate actions beyond the bodily limitations of having e.g. only a pair of hands. Augmentation beyond our present human limitations would have on the one hand, a revolutionary impact in our understanding of the working principles and limitations of the central nervous system, and, on the other hand, a breakthrough impact in a variety of technological scenarios. Applications where human augmentation would be game-changing include robotic surgery where surgeons may perform more complex procedures by using extra pair of hands, the ability to work in extreme environments by robotic teleoperation (e.g., in deep space, underwater or in dangerous plants), or next generation manufacturing where workers may use multiple limbs such as the confined spaces of aircraft assemble, and so on. The question whether or not human augmentation is at all possible, however, has no positive answer yet. The challenge is that existing approaches to interface human and machine, require us to repurpose the body's signals, e.g., signals that control the motion of our hand can be used to control a prosthetic hand. This is important for amputee patients that want to restore hand function but means that able-bodied people can either choose to control a robotic hand or their own hand but use both independently at the same time. Achieving the latter would be true human augmentation. Enabling human augmentation to operate technology while at the same time keeping our natural ability to act, talk and walk naturally intact would allow us to expand the capabilities and competitiveness of our species to novel technology domains enabled by artificial intelligence.
Human augmentation has currently not been realised with any existing technologies, partly because of the limitations of direct linking with the human brain. In this ambitious and high-risk project, we propose that some brain signals not directly related to a limb's movement "bleed-through" all the way to its muscles electrical activity. Recent work has shown that muscle electrical signals, which can be easily measured with wristwatch-like sensors, may indeed contain hidden brain information that could be read out to operate technology, while the user engages the muscles for normal physical activities.
Here, we propose a unique approach to realise human augmentation by combining wrist-watch-like sensors and artificial intelligence. We aim to show that we can enable a human user to control their arm movements, while at the same time using the signals from the arm muscles to operate an independent technological device. This would constitute a breakthrough achievement in human interfacing and a decisive demonstration of true human motor augmentation. The resulting augmentation technology will substantially differ from all current mainstream approaches in that it will not require surgery or alterations of the human body, as it will be applicable in the form of wearable sensors. As such, our work will have an impact not only for movement impaired individuals, such as in the control of prosthetic limbs, but also for everyday consumers, as a new way to interfacing with computers and other technology. To realise this goal we bring together two international leading teams of AI and medical engineers and propose a work plan of 18 months to build, a practical demonstration that our technology vision works.
Human augmentation has currently not been realised with any existing technologies, partly because of the limitations of direct linking with the human brain. In this ambitious and high-risk project, we propose that some brain signals not directly related to a limb's movement "bleed-through" all the way to its muscles electrical activity. Recent work has shown that muscle electrical signals, which can be easily measured with wristwatch-like sensors, may indeed contain hidden brain information that could be read out to operate technology, while the user engages the muscles for normal physical activities.
Here, we propose a unique approach to realise human augmentation by combining wrist-watch-like sensors and artificial intelligence. We aim to show that we can enable a human user to control their arm movements, while at the same time using the signals from the arm muscles to operate an independent technological device. This would constitute a breakthrough achievement in human interfacing and a decisive demonstration of true human motor augmentation. The resulting augmentation technology will substantially differ from all current mainstream approaches in that it will not require surgery or alterations of the human body, as it will be applicable in the form of wearable sensors. As such, our work will have an impact not only for movement impaired individuals, such as in the control of prosthetic limbs, but also for everyday consumers, as a new way to interfacing with computers and other technology. To realise this goal we bring together two international leading teams of AI and medical engineers and propose a work plan of 18 months to build, a practical demonstration that our technology vision works.
Organisations
Publications
Arnaud Robert
(2023)
Sample complexity of goal-conditioned hierarchical reinforcement learning
in Advances in neural information processing systems
Currie S
(2022)
Movement-specific signaling is differentially distributed across motor cortex layer 5 projection neuron classes
in Cell Reports
Han J
(2023)
EEG decoding for datasets with heterogenous electrode configurations using transfer learning graph neural networks.
in Journal of neural engineering
Kadirvelu B
(2023)
A wearable motion capture suit and machine learning predict disease progression in Friedreich's ataxia.
in Nature medicine
Nardi F
(2023)
Bill-EVR: An Embodied Virtual Reality Framework for Reward-and-Error-Based Motor Rehab-Learning.
in IEEE ... International Conference on Rehabilitation Robotics : [proceedings]
Ricotti V
(2023)
Wearable full-body motion tracking of activities of daily living predicts disease trajectory in Duchenne muscular dystrophy.
in Nature medicine
Wannawas N
(2023)
Towards AI-Controlled Movement Restoration: Learning FES-Cycling Stimulation with Reinforcement Learning.
in IEEE ... International Conference on Rehabilitation Robotics : [proceedings]
Wannawas N
(2022)
Neuromuscular Reinforcement Learning to Actuate Human Limbs through FES
| Description | We have been developing a novel way to interface human users, be that patients with movement impairments or healthy users that want to interface with computers and robots or other assistive technology (as consumers). The technology exploits our understanding of neuroscience of how the brain controls movement to develop a smart AI decoder that reads the intention of the user in an inobstusive way. |
| Exploitation Route | More coming through follow-up PhD projects and potential IP commercialisation. |
| Sectors | Communities and Social Services/Policy Creative Economy Digital/Communication/Information Technologies (including Software) Electronics Healthcare Pharmaceuticals and Medical Biotechnology |
| Description | Our work has inspired and promoted coverage and ultimately the hopes of the patient community, but also the creative industries, which can potentially use our technology proof of principle to interface users with machines in a more seamless way. The lead researcher on the project moved on to a faculty position. We are developing this technology further in an UKRI funded PhD. |
| First Year Of Impact | 2023 |
| Sector | Creative Economy,Healthcare,Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections |
| Impact Types | Cultural Societal Economic |
| Description | AI for decoding and executing human intentions |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Impact | Changes in regulatory pipelines have been evaluated and discussed in response to our inputs and are in active change. |
| Description | BBSRC AI strategy |
| Geographic Reach | National |
| Policy Influence Type | Contribution to a national consultation/review |
| Impact | Advised BBSRC on AI strategy which led to new BBSRC AI call. |
| Description | Elected Member of the German Ethics Council |
| Geographic Reach | Europe |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Impact | Please see the relevant press coverage. |
| Description | Membership in IEEE Standardisation Committe |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Impact | This IEEE IC-activity was one of the first initiatives directly focused on the study and development of voluntary consensus standards for BMI/BCI-related neurotechnology. Nonetheless, the awareness of the importance of this issue has been increasing thanks to efforts by this group and other stakeholders. Some relevant work includes: • OECD Recommendation on Responsible Innovation in Neurotechnology, Dec 2019 (Link) • US Food & Drug Administration (FDA) guidance "Implanted Brain-Computer Interface (BCI) Devices for Patients with Paralysis or Amputation - Non-clinical Testing and Clinical Considerations" (Link). • International Brain Initiative Working Group: Data Sharing and Standards (Link) • EU-funded projects EUROBENCH (Link) and INBOTS (Link). Although not related explicitly to neurotechnologies, these projects focus on benchmarking of robotics, which is one of the complementary technologies for BCI. • International Neuroinformatics Coordinating Facility, (INCF) in a non-profit organization that promotes community-supported standards and good practices in neuroinformatics (Link) • IEEE Brain Initiative and IEEE Neuroethics framework (Link) |
| URL | http://e.org/wp-content/uploads/import/governance/iccom/IC17-007-Neuro_Tech_for_Brain-Machine_Interf... |
| Description | AI HUB IN GENERATIVE MODELS |
| Amount | £10,250,181 (GBP) |
| Funding ID | EP/Y028805/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 02/2024 |
| End | 01/2029 |
| Description | Inference and Uncertainty Quantification for Offline Reinforcement Learning |
| Amount | £115,000 (GBP) |
| Funding ID | 2902181 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 08/2021 |
| End | 03/2025 |
| Description | MUlti-limb Virtual Environment (MUVE) for full body and augmented interactions |
| Amount | £1,027,493 (GBP) |
| Funding ID | EP/W036495/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 09/2022 |
| End | 09/2024 |
| Company Name | Ethomix Ltd |
| Description | |
| Year Established | 2024 |
| Impact | The company was recently formed, in the run up to the formation the company won several incubator and startup awards, and is now getting ready to trade with their first customer. |
| Description | BBC exclusive feature on our work (including TV, news, documentary and web features) |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | Exclusive coverage of our work in BBC |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.bbc.co.uk/news/science-environment-64326125 |
| Description | Co-organised Chatham House Event on Sovereign AI |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Last week, a thought-provoking discussion on Sovereign AI was co-led by Prof. Aldo Faisal (Imperial College London) at Chatham House, drawing from the recently published Sovereign AI white paper, which was first presented in Davos this January. In the AI Opportunities Action Plan, the UK government has emphasized the development of sovereign AI capabilities through relaxed planning processes for AI infrastructure, scaled cross-economy adoption, the creation of a National Data Library, and the cultivation of a domestic talent pipeline to support the AI businesses of the next decade. However, the path forward presents several challenges. These efforts must be interconnected, as outlined in the white paper. Much like the Industrial Revolution, when Britain leveraged more than just wool and unused buildings, Sovereign AI must go beyond data centers and repositories-it requires the development of AI factories and tools. The UK is neither the US nor China and does not possess the same depth of capital or computing power as Silicon Valley. Nor is it necessarily advantageous to attempt building a direct commercial competitor to ChatGPT. Instead, the UK has access to globally unique national data assets, unparalleled in scale due to either the smaller size of many digitally advanced nations or the commercial fragmentation of national services, such as the NHS in healthcare. This positions the UK to leverage its strengths in health and life sciences by integrating these data assets with strategic AI hardware investments. A "LifeGPT" model could be truly unique on a global scale-and might even contribute to offsetting the operational costs of the NHS. During the panel discussion, key questions were explored: Does the UK genuinely require sovereign AI capabilities? Why is this critical to national interests? What vulnerabilities arise from geopolitical shifts-such as supply chain disruptions or energy price shocks-and how can they be mitigated? What are the limits of UK AI sovereignty? How can financial, resource, and talent constraints be managed while maintaining momentum? Gratitude is extended to all participants of this closed-door discussion. It was inspiring to witness leaders from industry, academia, and policy convening to shape a strategic vision for sovereign AI. One key takeaway was that achieving AI sovereignty requires not only investment and policy but also strategic prioritization, cross-sector collaboration, and a clear understanding of the nation's unique strengths. Moreover, Sovereign AI can be developed in cooperation with others. This is why, in the white paper, David Shrier and Aldo Faisal proposed a Federation of Sovereign AI, aiming to register and connect over 11 global and regional Sovereign AI initiatives. Such a federation would facilitate the sharing of computing resources, data, and best practices. |
| Year(s) Of Engagement Activity | 2025 |
| URL | https://sovereign-ai.org/news/aldo-faisal-speaks-at-chatham-house/ |
| Description | Co-organiser of the International Conference on Complex Acute Illness (ICCAI) 2024 in Bethesda (MD, USA) |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | I have become a co-organiser and been nominated as board member of the leading serious and complex illness society and their annual conference (ICCAI). |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://iccai.org |
| Description | IEMTRONICS 2023 Keynote |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote at technology conference |
| Year(s) Of Engagement Activity | 2023,2024 |
| Description | Industry Keynote at FZI Karsruhe |
| Form Of Engagement Activity | Participation in an open day or visit at my research institution |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote at Forschungszentrum Informatik (FZI) in Karlsruhe (Germany) one of Germany's major private-public industry research institutes. |
| Year(s) Of Engagement Activity | 2023,2024 |
| Description | Keynote at Annual All-German-Medical-School conference (NUM) |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote at key event held in Berlin at which all German medical schools participated. |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.linkedin.com/posts/drgoeschl_num-convention-2024-activity-7154096014960771072-w_PO/ |
| Description | Keynote at Open Medical Forum held at TU Munich |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Keynote at major medical event held in Munich. |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://www.tum.de/en/news-and-events/all-news/press-releases/details/the-importance-of-a-transdisci... |
| Description | Keynote at annual governing political party closed-door retreat |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Gave keynote at an annual governing party retreat that has lead to government decisions and cabinet decisions. |
| Year(s) Of Engagement Activity | 2023,2024 |
| Description | Keynote at the American Association for the Advancement of Science (AAAS) in Washington DC 8/11/2023 |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | Keynote at global open forum on research in Washington, DC (USA). |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://www.science.org/content/webinar/ai-mental-health-opportunities-and-challenges |
| Description | Organised Workshop at Davos 2025 during the World Economic Forum |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Please see https://sovereign-ai.org/ |
| Year(s) Of Engagement Activity | 2025 |
| URL | https://sovereign-ai.org/ |
