Use of automated lip reading to communicate with Tracheostomised Covid-19 patients

The COVID pandemic will result in large numbers of patients who need to be weaned off ventilators over several weeks. In order to do this, patients will need a tracheostomy. From experience with existing patients it is known that these patients will not be sedated, will be in an unfamiliar environment, confused, frightened, weak and unable to vocalise. By utilising AI technology the SRAVI app can lip read and then translate to written or verbalised language on a handheld device - allowing these patients to communicate effectively with carers and relatives. The App, when pointed towards the patient, will capture video of the patient mouthing phrases, decipher 'speech' from the lip movements and vocalise the result. This can be done both at the patient bedside or remotely if they continue to be infectious. This will help mental health, pain relief and early rehabilitation.

The project will deliver -

* A fully-featured, productised version of SRAVI capable of commercial use in ICUs/General Wards.
* A Feasibility study using the SRAVI App in two (or more) ICUs - Usability measures will be built into the app to capture feedback and allow ongoing development and evaluation of the app. A range of outcome measures will be collected from patients, families and staff to inform the healthcare impact and market potential of SRAVI.

In a follow-on phase the productised version of SRAVI that will be completed at the end of the on-site Feasibility Study will be prepared for commercially release - and then commercially launched on the Android and Apple App stores. This commercial version will then be evaluated in a clinical setting at Royal Preston Hospital. In addition the Liopa team will implement internal systems and processes for the future development and operation of the SRAVI service that conform to the regulations required to obtain Class 1 Medical Device certification.