10065901Delivering large scale digital clinical trials for artificial intelligenceClosedCollaborative R&DInnovate UKThe project aims to speed up the deployment, evaluation, and commissioning of AI in healthcare by creating a near real-time evaluation toolkit for AI applications. The cost of clinical trials for AI applications can be prohibitively expensive for small and medium-sized businesses, making it difficult for them to prove the safety and efficacy of their products. To address this issue, the project has three main goals: to determine the appropriate performance metrics for identifying safe and trustworthy AI applications in healthcare, to gather feedback from clinical users in near real-time without interrupting their workflows, and to generate evidence of efficacy at a large scale while maintaining data privacy. The project will use mixed methods research and a privacy-preserving federated AI software evaluation toolkit to achieve these goals, and once completed, will be used to evaluate AI at a large scale with the help of SMEs, healthcare providers, and commissioners.