AI for automatic vertebral motion tracking of fluoroscopic images

Lead Research Organisation: Bournemouth University
Department Name: Faculty of Science and Technology

Abstract

For centuries, doctors have been presented with spinal disorders that followed injury or overuse and were therefore thought to be due to loss of spinal stability. In the past, this could not be confirmed, but using a technology called Quantitative Fluoroscopy (QF), which relies on low-dose motion X-ray images captured during motion, it now can.

QF is regarded as the gold standard for spinal motion measurement, but due to lack of readiness for routine use, it is rarely available to scientists, researchers and clinicians (mainly spinal surgeons and physical therapists). In this project we aim to bring Artificial Intelligence (AI) to bear on QF so it can be used more widely in research and patient care.

The reason QF is not in wide use is that it involves the locating and tracking of vertebral motion images by a computer, allowing movement of vertebrae to be measured automatically. Without automation, the process is too time consuming for routine use. At the same time, automatic measurement poses multiple challenges if the images are not very clear and well aligned. Distorted (e.g., due to scoliosis), degraded (e.g., by fat in obese people) or fading (e.g., people with osteoporosis) images currently lead to almost inevitable failure of measurement process - denying the ability to use QF widely for investigating spinal disorders.

We will apply AI methods so that computers can be trained to do both the registration and the tracking of vertebral images at incredible speed, even using images of poor quality. This will allow a huge number of inspections to be performed very quickly, resulting in much more detailed scrutiny and verification and at a much higher speed than a human operator. This will initiate a new era in spine care research.

This project will leverage the QF data which has already been collected over multiple years of prior research, where the participants consented for their data to be used for future research. No additional participants will be recruited, hence no additional X-ray radiation risk will be required for this project.

Technical Summary

Low back pain is the greatest cause of disability and is thought to be largely related to spinal mechanics. However, the world of spinal biomechanics research is some way away from being able to provide detailed patient-specific assessments of the mechanics of spinal linkages that could lead to better treatments. The hurdle to be crossed is the provision of an efficient method for measuring the motion of the vertebral linkages and analysing the outputs from dynamic sequences of specific movements for abnormalities.

Prof. Breen and his team have developed such a method using fluoroscopy (low-dose motion X-rays) - and called Quantitative Fluoroscopy (QF). Use of QF in research has seen international growth, largely due to developments in semi-automatic image analysis, enabling processing of large numbers of images and allowing the identification of biomarkers for nonspecific back pain in patients. However, its potential has always been limited by the processing time and limitation to pristine spinal images. This research aims to overcome these barriers.

The team led by Prof. Budka will develop a system using AI and Computer Vision techniques for real-time vertebral detection, identification and tracking, using the existing database of individual in vivo vertebral fluoroscopic images compiled by Prof. Breen. Traditional Computer Vision approaches to object detection rely primarily on object appearance and do not explicitly leverage the hierarchical structure of the scene like the part-whole relationships. Exploiting such structure is key in situations where the image quality is poor and the objects themselves are partially or sometimes even fully occluded.

The methodologies and algorithms we develop will be applied to the analysis of an independent sample of spinal motion sequences obtained at the Royal Hampshire County Hospital as a check on their robustness and universality of application, and indication of any necessary domain adaptation.

Publications

10 25 50
publication icon
Samaratunga R Automated Lumbar Spine Tracking in Quantitative Fluoroscopy (in preparation) in IEEE Transactions on Medical Imaging

 
Title Trained Convolution Neural Network for vertebral identification in fluoroscopic images 
Description Ready-to-use, pre-trained model based on resnet-50 architecture. Takes input of 224x224 3-channel images and outputs predicted 18 points; 4 points for L2-L5 vertebra bounding boxes and top left and top right points of the SACRUM's bounding box. 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? Yes  
Impact The pre-trained model, offers further scope for application on other sections of the spine. The model also gives researchers access to applying transfer learning on similar imaging modalities, without requiring significant and costly processing power. 
URL https://osf.io/z2jby/
 
Title Weight-bearing lumbar flexion fluoroscopic images 
Description Dataset consisting of healthy control participants imaged during weightbearing (standing/seated) flexion movement of the spine. There are 96 unique participants with 43 of them having initial and follow-up sequences. This makes a total of 139 separate sequences. The total no. of frames for the whole data set = 45,968 at 224x224px resolution 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? Yes  
Impact This will be the first publicly available database of weightbearing flexion .jpg images using the QF technique for imaging on healthy participants. This will make such clinical studies more accessible to machine learning researchers as the images have been converted to an industry standard format that can be used by the majority of deep learning model architectures currently in use. 
URL https://osf.io/z2jby/
 
Title Model Inference Code 
Description Inference Code to pass data through the pre-trained model is provided as a Python Jupyter notebook, with accompanying custom Python library for data loading and plotting. 
Type Of Technology Webtool/Application 
Year Produced 2023 
Impact The inference code and interactive plotting libraries allow anybody with basic technical knowledge to perform inference on their own spine images collected in a similar fashion to the ones published as part of this project. The results of the inference can then be used in a number of different downstream tasks like calculation of angles between the vertebrae or assessment of stability of the spine movement. 
URL https://github.com/dsibournemouth/project-maid