📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

Demonstrator of Flower Federated Learning Tool: DEFT

Lead Research Organisation: University of Cambridge
Department Name: Computer Science and Technology

Abstract

Building upon recent results from the ERC StG REDIAL project, we seek to develop a commercial proof-of-concept of federated learning technology. Core innovation in the REDIAL project has been been made in the direction of scalable simulation and efficient training of federated systems -- along with enabling methods for unsupervised video understanding and speech. The technical breakthrough is the enabling of machine learning systems (e.g., detection of cancer, performing drug discovery, detecting financial fraud) that can be trained even if the data remains at the originating institution -- and yet a model can be built that benefits from the complete set of data that spans all of these locations. Often due to legal, ethical, intellectual property, difficulty of system compatibility -- models are trained on data sets far smaller than would be expected because of the difficulties of bring data into one single data center. A secondary motivation behind interest in the ability to build privacy preserving user systems, such as federated forms of digital assistants, IoT devices and smartphone services.
The commercial opportunity extends from the fact REDIAL technology has been integrated within a highly popular completely open-source federated learning toolkit called FLOWER -- which has also developed in the lab of the PI of REDIAL. More than 420,000 downloads of FLOWER with REDIAL based technology have occurred. There is a growing user base and community around FLOWER. But developing federated solutions remains too hard for mainstream use -- and companies require more support, and easy to use specific tools. This proof-of-concept grant would be to facilitate the development of a hardened simple set of tools (we call it LEAP) and support for companies build federated learning applications. We believe they will come in the areas such as healthcare, preventative maintenance, financial analysis, and drug discovery.

Publications

10 25 50
 
Description We found that it was difficult to generate commercial interest in the platform we proposed that targeted simplifying the building of federated learning networks between companies. The market appears to be strong, but within the time frame we could not achieve enough traction. However, we did discover that companies were very interested in "internal" forms of federated learning. This is where they would build a federation of data within a large company that often spans various locations, countries and hardware configurations. We pivoted to better explore demand for this work and during the process we found significant interest in LLM training across physically distant GPUs. We continue to try and commercialize this with on-going discussions involving AMD and a data center company called tsloop.
Exploitation Route All software outcomes (technique and platforms) are open source and are available for use for others to take forward
Sectors Digital/Communication/Information Technologies (including Software)

Security and Diplomacy

 
Description We used the platform build during DEFT to enter and win a Privacy Enhanced Technology competition run by the UK and US government. We presented results to the HMS Treasury and were placed first in the UK. Presented and demo-ed our federated learning technology to the CTO of Qualcomm in San Diego, at the request of Qualcomm
First Year Of Impact 2022
Sector Digital/Communication/Information Technologies (including Software)
Impact Types Societal