Fundamentals for Motor Control of Robotic Augmentation
Lead Research Organisation:
University of Cambridge
Department Name: MRC Cognition and Brain Sciences Unit
Abstract
AUGMENT is centred around the unique challenge of controlling motor augmentation technology. We are witnessing the rise of a novel class of technologies, designed to resemble human limbs in their functionalities. These extra fingers and arms are robotic devices that are designed to extend the user's motor capabilities (hereafter X-devices). Beyond the traditional substitution of missing functions, X-devices can be further exploited to provide additional motor functions to already fully functional individuals. But what cognitive and physiological resources could we utilise to control extra limbs, in addition to our own? The goal of AUGMENT is to harness basic understanding of human motor learning and control to guide successful technological development of X-devices in abled and disabled individuals. An urgent question is how to provide motor commands and somatosensory feedback to and from the X-device without restricting the cognitive and motor control of the biological limbs. I will address this by first identifying the neurocognitive mechanisms best suited for successful X-devices motor control. Then I will investigate the optimal integration of somatosensory information from the X-device to afford intuitive and transferable motor skill learning. Finally, I will provide innovative solutions for increasing the functionality of disabled individuals in daily life, beyond traditional substitution, using novel X-devices. By identifying and solving the fundamental sensorimotor human-device interface challenges across diverse user groups and functional needs, AUGMENT will be crucial for the realisation of motor augmentation and other related technologies that aim to put the user at the centre of robot control, design and development.
People |
ORCID iD |
| Tamar Makin (Principal Investigator) |
Publications
Nisky I
(2024)
A neurocognitive pathway for engineering artificial touch
in Science Advances
| Description | Committee Member, National Committee on Brain/Commuter Interphase technology (BCT/1), British Standard Institute |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Description | PhD Medical Research Council Studentship |
| Amount | £60,000 (GBP) |
| Organisation | Medical Research Council (MRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 08/2022 |
| End | 09/2025 |
| Description | EPSRC Collaboration |
| Organisation | Cambridge University Hospitals NHS Foundation Trust |
| Country | United Kingdom |
| Sector | Public |
| PI Contribution | Academic contribution, data collection and analysis. |
| Collaborator Contribution | Dr Harry Mee (Cambridge University Hospitals): Rehabilitation medicine specialist, providing consultancy on the development of the research program. Dr Juan Alvaro Gallego (Imperial College London): Assisting with troubleshooting study setup and providing insights on data analysis. Prof. Luke Miller (Radboud University Nijmegen): Contributing expertise in computational modelling. |
| Impact | Ongoing collaboration with Dr Harry Mee (Cambridge University Hospitals), Dr Juan Alvaro Gallego (Imperial College London), and Prof. Luke Miller (Radboud University Nijmegen) bring together clinical, engineering, and neuroscience expertise to support the project's translational and multidisciplinary approach. |
| Start Year | 2024 |
| Description | EPSRC Collaboration |
| Organisation | Imperial College London |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Academic contribution, data collection and analysis. |
| Collaborator Contribution | Dr Harry Mee (Cambridge University Hospitals): Rehabilitation medicine specialist, providing consultancy on the development of the research program. Dr Juan Alvaro Gallego (Imperial College London): Assisting with troubleshooting study setup and providing insights on data analysis. Prof. Luke Miller (Radboud University Nijmegen): Contributing expertise in computational modelling. |
| Impact | Ongoing collaboration with Dr Harry Mee (Cambridge University Hospitals), Dr Juan Alvaro Gallego (Imperial College London), and Prof. Luke Miller (Radboud University Nijmegen) bring together clinical, engineering, and neuroscience expertise to support the project's translational and multidisciplinary approach. |
| Start Year | 2024 |
| Description | EPSRC Collaboration |
| Organisation | Radboud University Nijmegen |
| Country | Netherlands |
| Sector | Academic/University |
| PI Contribution | Academic contribution, data collection and analysis. |
| Collaborator Contribution | Dr Harry Mee (Cambridge University Hospitals): Rehabilitation medicine specialist, providing consultancy on the development of the research program. Dr Juan Alvaro Gallego (Imperial College London): Assisting with troubleshooting study setup and providing insights on data analysis. Prof. Luke Miller (Radboud University Nijmegen): Contributing expertise in computational modelling. |
| Impact | Ongoing collaboration with Dr Harry Mee (Cambridge University Hospitals), Dr Juan Alvaro Gallego (Imperial College London), and Prof. Luke Miller (Radboud University Nijmegen) bring together clinical, engineering, and neuroscience expertise to support the project's translational and multidisciplinary approach. |
| Start Year | 2024 |
| Description | EPSRC Collaboration |
| Organisation | University of Pisa |
| Country | Italy |
| Sector | Academic/University |
| PI Contribution | Academic contribution, data collection and analysis. |
| Collaborator Contribution | Prof. Matteo Bianchi (University of Pisa) provides consultancy on the project, contributes to study design and analysis, and supplies experimental materials. |
| Impact | Prof. Matteo Bianchi (University of Pisa): A paper is currently being prepared as a result of this collaboration. |
| Start Year | 2023 |
| Description | Broadcast about the Third Thumb and the lab's research |
| Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | The work of Prof. Tamar Makin's Plasticity lab, mostly focusing on the Third Thumb and brain plasticity, was broadcast on the following channels: - A Brief History of the Future, PBS, United States: Our research and collaboration with Dani Clode was featured in the episode 'Human' of the six-part PBS documentary series called 'a brief history of the future', which focused on exploring the potential of humanity. URL: https://www.pbs.org/show/a-brief-history-of-the-future/ - The Naked Scientists, BBC Radio 5, UK: Invited to speak on Naked Scientists science podcast to discuss the Third Thumb, our research and specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. URL: https://www.thenakedscientists.com/articles/interviews/how-does-person-get-grips-extra-thumb - Quirks & Quarks, CBC Radio One, Canada: Invited to speak on Quirks & Quarks science podcast to discuss the Third Thumb, our research and specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. URL: https://www.cbc.ca/listen/live-radio/1-51-quirks-and-quarks/clip/16075119-what-third-thumb-research-suggests-brain-quickly-adapt - BBC Radio Cambridgeshire, Cambridge, UK: Invited to speak on live radio at BBC Radio Cambridgeshire during their primetime 'Chris Mann's DriveTime' show to discuss the Third Thumb, our research and specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. URL: https://www.bbc.co.uk/programmes/p0j2wf4l - Tech Life, BBC World Service, UK: Interviewed for special programme on recent developments in artificial limb tech, discussing the Third Thumb and our research.URL: https://www.bbc.co.uk/programmes/w3ct5wm8 - Radio 4 World at 1: Radio interview about our research with the Third Thumb, specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. Quoted in article. - Robot talk podcast recorded at the V&A, Humans 2.0: robotically augmented people: Podcast recording about the Third Thumb and the lab's research. URL: https://www.robottalk.org/2024/06/21/episode-90-robotically-augmented-people/ - Lithuanian National Radio: radio interview about the Third Thumb and the lab's research. URL: https://www.lrt.lt/mediateka/irasas/2000355044/neuromokslininke-viktorija-pavalkyte-greitai-naudosime-papildomas-robotines-rankas?embed=&srsltid=AfmBOopOZxVDNr0fKuF3DWOLJyevm7AQoyyMfwoTU6nYxWVfF7PIqtm- |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.pbs.org/show/a-brief-history-of-the-future/ |
| Description | Engagement activities |
| Form Of Engagement Activity | Engagement focused website, blog or social media channel |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | The lab members were engaged in the following activities: - Trainee Professional Development Award interview for the Society for Neuroscience: Invited for video interview as one of a few selected society for neuroscience trainee professional development award winners, to be posted on SFN website and social media channels later in 2025. URL: https://www.youtube.com/@sfnvideo - BBC Radio Cambridgeshire, Cambridge, UK: Interviews for BBC Radio Cambridgeshire's social media channels discussing the Third Thumb, our research and specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. - University of Cambridge Social Media, UK: Promotional engagement video in collaboration with University of Cambridge social media channels discussing our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. URL: https://www.youtube.com/watch?v=UI-t21QcXM4 |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.youtube.com/watch?v=UI-t21QcXM4 |
| Description | Events and demonstrations |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Public/other audiences |
| Results and Impact | The Plastcity Lab members were invited to the following events to demonstrate their work, especially the Third Thumb: - Cognition and Brain Science Unit Science Night: The Plasticity Lab members demonstrated the Third Thumb and Yoga projects at the MRC Cognition and Brain Science Unit hosted an open "Science Night" evening "Mind Matters - An evening looking into the brain". - UK Sensorimotor, Cambridge, UK: The Plasticity Lab organised and hosted the annual national UK Sensorimotor meeting at the University of Cambridge. - REACH weekend 2024: Third Thumb demonstration during a volunteer-led charity REACH annual meeting. We got lots of engagement and feedback from children born with limb differences, their parents and industry professionals. In addition, we collected lots of contact details for potential new participants. URL: https://www.reach.org.uk/events/annual-family-weekend-2024-25-27-october#:~:text=Aim%20higher-,Annual%20Family%20Weekend%202024%2D%2025%2D27%20October,to%20our%20fabulous%20Gala%20dinner! - RAREfest24: Third Thumb demonstration during Rarefest24 event, which is a festival for people with rare diseases. We got lots of engagement and feedback from the patients, their careers and the general audience. In addition, we collected lots of contact details for potential new participants and for networking reasons. URL: https://www.camraredisease.org/rarefest24/ |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.camraredisease.org/rarefest24/ |
| Description | Media |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | The work of the lab has been featured in the following: - The Daily Telegraph, UK; The Daily Mail, UK; Trouw, Netherlands; BBC Cyborg interview; Bloomburg UK; Forbes, US; Popular Science, US; The Economist, UK; Nature, UK and other 600 articles worldwide: Newspaper report based on our research with the Third Thumb, specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. Quoted in article. URLs: https://www.telegraph.co.uk/news/2024/05/29/robotic-thumb-allows-people-to-open-a-bottle-with-one-hand/; https://www.dailymail.co.uk/sciencetech/article-13475213/third-thumb-Robotic-prosthetic-one-hand.html; https://www.bbc.co.uk/news/articles/cg58r70yj43o; https://www.bloomberg.com/news/newsletters/2024-07-05/the-handy-benefits-of-having-a-third-thumb; https://www.forbes.com/sites/lesliekatz/2024/06/05/robotic-third-thumb-set-to-supercharge-your-productivity/; https://www.popsci.com/technology/robotic-third-thumb/; https://www.economist.com/science-and-technology/2024/02/01/why-prosthetic-limbs-need-not-look-like-real-ones; https://www.nature.com/articles/d41586-024-01686-1. - BBC Science Focus Magazine, UK: Magazine article based on our research with the Third Thumb, specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. Quoted in article. URL: https://www.sciencefocus.com/future-technology/prosthetic-thumb. - The Times, UK: Front page newspaper report based on our research with the Third Thumb, specifically our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. Quoted in article. URL: https://www.thetimes.com/uk/science/article/researchers-test-robotic-thumb-that-can-be-controlled-by-the-toes-chtvckjtt. - The Times, UK: Follow-up article following visit from Journalist to test the Third Thumb and interview us about our research. URL: https://www.thetimes.com/uk/science/article/can-a-third-thumb-make-me-the-first-robotically-enhanced-reporter-bvqnrtbqn. - |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.nature.com/articles/d41586-024-01686-1 |
| Description | Poster presentations |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | The Plasticity Lab members participated in the following conferences, where they presented multiple posters with their research: - Society for Neuroscience (SFN) Meeting, Chicago, United States: Poster presentations at the Society for Neuroscience (SfN) meeting 2024. Presented poster twice - during exclusive early career poster session for award winners, sponsors and press, as well as during main meeting. Title: Comparison Integration of Sensory Feedback for Wearable Devices. URL: https://www.sfn.org/-/media/SfN/Documents/NEW-SfN/Meetings/Neuroscience-2024/General-Info-and-At-the-Meeting/2024ProgramandExhibitGuide.pdf - UK Sensorimotor, Cambridge, UK: Multiple poster presentations at the national UK Sensorimotor conference 2024 demonstrating the lab's conducted research. - Neural Control of Movement (NCM) Meeting, Dubrovnik, Croatia: Poster presentations at the international neural control of movement (NCM) conference 2024. Presented 2 first-author posters at the satellite meeting and 2 first-author posters during the main meeting. Titles: Can the Somatosensory System Integrate a Tactile Model for an Extra Robotic Body Part? & Comparison of Pathways for Sensory Feedback for Wearable Devices. URL: https://ncm-society.org/wp-content/uploads/2024/05/NCM2024FinalApril20.pdf |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.sfn.org/-/media/SfN/Documents/NEW-SfN/Meetings/Neuroscience-2024/General-Info-and-At-the... |
| Description | Talks of the lab members |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Postgraduate students |
| Results and Impact | The Plasticity Lab members gave talks at the following events: - Wednesday Lunch-Time Seminar, Cambridge, UK: 30-minute presentation to staff and postgraduate students within the MRC Cognition and Brain Sciences Department. Title: Can the somatosensory cortex integrate a tactile representation of an extra robotic body part? - International Conference on Biomedical Robotics and Biomechatronics (BioRob), Heidelberg, Germany: 20-minute talk and additional panel session as an invited speaker at the "A multidisciplinary overview of upper limb prosthetics development: challenges and opportunities" workshop during BioRob 2024. Title: Neuroscience, Body Augmentation and Artificial Tactile Feedback. URL: https://www.santannapisa.it/it/biorob2024/multidisciplinary-overview-upper-limb-prosthetics-development. - Symposium on human interfacing and augmentation, London, UK: 15-minute talk as an invited speaker at the symposium on human interfacing and augmentation at Imperial College London. Title: Can the Somatosensory System Integrate a Tactile Model for an Extra Robotic Body Part? URL: https://www.imperial.ac.uk/human-robotics/events/symposium-on-human-interfacing-and-augmentation/. - Innovate UK KTN webinar on Human Augmentation: Invited to speaker for Innovate UK KTN webinar on Human Augmentation to discuss the Third Thumb, our research and specificially our paper - evaluating initial usability of a hand augmentation device across a large and diverse sample. - UK Sensorimotor, Cambridge, UK: 20-minute talk about motor skill generalisation and transfer effects while using the Third Thumb. - Presentation about the Third Thumb at Addenbrooke's hospital: a few lab members presented their recent work to practitioners to show the benefits and future possibilities of the Third Thumb in clinical settings. |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.imperial.ac.uk/human-robotics/events/symposium-on-human-interfacing-and-augmentation/ |
| Description | Talks or presentations delivered by Tamar Makin |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | Tamar Makin: Invited talks to the following INTERNATIONAL events/places: Nature Conference, Technologies for Neuroengineering, China (URL: https://conferences.nature.com/event/97e94fb8-50d2-4242-bc83-92f478ce9908/summary); Royal Society & Israel Academy of Sciences and Humanities workshop: Signal Processing, UK; Peking University Seminar, China; University of Laurance Seminar, France; TUM-JHU Workshop on Sensory Integration in Neuroprostheses, Rehabilitation, and Humanoid Robots, Germany (delivered virtually). Tamar Makin: Invited talks to the following NATIONAL events/places: Imperial College London, Bioengineering Department Seminar, UK (URL: https://www.imperial.ac.uk/events/174761/hybrid-bioengineering-department-and-centre-for-neurotechnology-seminar-prof-tamar-makin/); Lightning talks - SciFoo, Cambridge, UK, organised by Digital Science, Google, O'Reilly Media and Nature, for people from diverse areas of science and technology (URL: https://www.youtube.com/watch?v=-XGIATH0vSY&list=PLgrfN3HX0L2XTis8aSrNSB-3KCUcTXWSu?dex=18); Advanced Research +Invention Agency (ARIA), Programme Workshop, UK. Tamar Makin: Invited talks to the following LOCAL events/places: Cambridge University Psychiatry Department PI day, UK; Addenbrookes Cambridge University Hospital Hand Clinic Seminar, UK; Shaping The Future of Closed-loop Neuromodulation Workshop, Cambridge University, UK |
| Year(s) Of Engagement Activity | 2024 |