CellPhe 2: Machine Learning-based Phenotyping To Predict Cell Fate In Heterogeneous Populations
Lead Research Organisation:
UNIVERSITY OF YORK
Department Name: Biology
Abstract
Within the BBSRC remit "understanding the rules of life", advancements in high-throughput time-lapse imaging has led to a proliferation of large datasets reporting temporal changes in cell behaviours in mechanistic functional studies, target validation, and phenotypic screens. These large and complex datasets can answer fundamental questions in biology but require more advanced tools for analysis.
As part of a BBSRC-funded NPIF PhD studentship in AI, we developed CellPhe, a software package that enables phenotyping of cells in time-lapse microscopy datasets. Whilst some other software systems allow visualisation of the time series for a limited number of size and shape metrics, CellPhe is unique in that the time series for over 70 features, including movement, texture and density, are calculated for each tracked cell. Quantitative attributes are extracted from each of these time series and used in machine learning algorithms to classify cell subpopulations, thereby filling a fundamental gap in the bioimaging field. In this project, we aim to significantly enhance CellPhe's capability whilst making the software more widely accessible to the bioimaging community.
To harness CellPhe's capability for more complex datasets of heterogeneous cell populations, we will employ a novel analytical approach where we consider "tracklets" of imaging data rather than the complete time series. These short segments of the time series will allow interesting short-term behaviour to be identified that would be missed by characterising the time series in full. This approach will be used to identify key cellular processes that may induce phenotypic shifts in response to treatment, e.g. timing of cell division, number and type of transient cell-cell interactions, migration, local density, etc.
A common limitation with time-lapse imaging data is the inability to accurately segment and track individual cells across multiple frames, particularly in more confluent populations. To address this issue when it arises in specific datasets, we will explore the alternate utility of analysing a population of cells across a whole field of view without segmentation, using machine learning to separate behaviours based on whole image metrics.
Furthermore, to demonstrate utility for discrimination of responding/non-responding populations following exposure to specific interventions (e.g. during drug treatment or CRISPR screening), we will also run the data in reverse to determine the features that provide early indication of particular cell behaviours. This approach will aid classification models for the prediction of cell fate, e.g. early detection of differentiation, or drug response, and could allow analysis of phenotypic imaging data to be combined with additional downstream assays, e.g. spatial transcriptomics, to relate imaging data to function.
We will achieve our goal of making CellPhe more accessible by integrating it with the widely used state of the art open-source image analysis package, CellProfiler Analyst. Its companion program CellProfiler, led by our international partner, is recognised as the leading solution for image segmentation and cell tracking. The collaboration will allow segmentation and tracking to be integrated with automated analysis of the tracked cells. Further collaborations with two large pharmaceutical companies will provide access to industrially relevant high throughput imaging datasets for testing these new analytical capabilities. Our proposal thus addresses the BBSRC theme "AI to transform bioscience research and discovery", opening up a significant new opportunity for analysis of high dimensional time series datasets applicable to cellular bioimaging and beyond.
As part of a BBSRC-funded NPIF PhD studentship in AI, we developed CellPhe, a software package that enables phenotyping of cells in time-lapse microscopy datasets. Whilst some other software systems allow visualisation of the time series for a limited number of size and shape metrics, CellPhe is unique in that the time series for over 70 features, including movement, texture and density, are calculated for each tracked cell. Quantitative attributes are extracted from each of these time series and used in machine learning algorithms to classify cell subpopulations, thereby filling a fundamental gap in the bioimaging field. In this project, we aim to significantly enhance CellPhe's capability whilst making the software more widely accessible to the bioimaging community.
To harness CellPhe's capability for more complex datasets of heterogeneous cell populations, we will employ a novel analytical approach where we consider "tracklets" of imaging data rather than the complete time series. These short segments of the time series will allow interesting short-term behaviour to be identified that would be missed by characterising the time series in full. This approach will be used to identify key cellular processes that may induce phenotypic shifts in response to treatment, e.g. timing of cell division, number and type of transient cell-cell interactions, migration, local density, etc.
A common limitation with time-lapse imaging data is the inability to accurately segment and track individual cells across multiple frames, particularly in more confluent populations. To address this issue when it arises in specific datasets, we will explore the alternate utility of analysing a population of cells across a whole field of view without segmentation, using machine learning to separate behaviours based on whole image metrics.
Furthermore, to demonstrate utility for discrimination of responding/non-responding populations following exposure to specific interventions (e.g. during drug treatment or CRISPR screening), we will also run the data in reverse to determine the features that provide early indication of particular cell behaviours. This approach will aid classification models for the prediction of cell fate, e.g. early detection of differentiation, or drug response, and could allow analysis of phenotypic imaging data to be combined with additional downstream assays, e.g. spatial transcriptomics, to relate imaging data to function.
We will achieve our goal of making CellPhe more accessible by integrating it with the widely used state of the art open-source image analysis package, CellProfiler Analyst. Its companion program CellProfiler, led by our international partner, is recognised as the leading solution for image segmentation and cell tracking. The collaboration will allow segmentation and tracking to be integrated with automated analysis of the tracked cells. Further collaborations with two large pharmaceutical companies will provide access to industrially relevant high throughput imaging datasets for testing these new analytical capabilities. Our proposal thus addresses the BBSRC theme "AI to transform bioscience research and discovery", opening up a significant new opportunity for analysis of high dimensional time series datasets applicable to cellular bioimaging and beyond.
Publications
Arponen O
(2024)
23Na MRI: inter-reader reproducibility of normal fibroglandular sodium concentration measurements at 3 T.
in European radiology experimental
Capatina AL
(2024)
Hypoxia-induced epigenetic regulation of breast cancer progression and the tumour microenvironment.
in Frontiers in cell and developmental biology
Hogg K
(2026)
Spatial profiling of central nervous system cellular markers in murine breast cancer to brain metastases
in Wellcome Open Research
Issitt T
(2025)
Chloroform release from ageing cells and Drosophila DJ-1 mutants
Leslie TK
(2024)
A novel Nav1.5-dependent feedback mechanism driving glycolytic acidification in breast cancer metastasis.
in Oncogene
Pantazis A
(2024)
Worldwide Sodium Channel Conference, January 31st-February 2nd, 2024, Grindelwald, Switzerland.
in Bioelectricity
Wiggins L
(2025)
CellPhePy: A python implementation of the CellPhe toolkit for automated cell phenotyping from microscopy time-lapse videos.
in Journal of microscopy
| Description | CellPhe provides functions to phenotype cells from time-lapse videos. The Python package is a port of the original R implementation with additional features for segmentation and tracking. |
| Exploitation Route | Use of the software for automated cell phenotyping and analysis from timelapse microscopy videos addressing further research questions. |
| Sectors | Manufacturing including Industrial Biotechology Pharmaceuticals and Medical Biotechnology |
| Description | Removing barriers to advanced imaging and machine learning-based analysis |
| Amount | £504,734 (GBP) |
| Funding ID | 310891/Z/24/Z |
| Organisation | Wellcome Trust |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 11/2024 |
| End | 04/2026 |
| Description | Dr Beth Cimini |
| Organisation | Broad Institute |
| Country | United States |
| Sector | Academic/University |
| PI Contribution | Research collaboration leading to development of new AI/ML tools for automated cell phenotyping and analysis. |
| Collaborator Contribution | Software engineering expertise from CellProfiler program |
| Impact | See publications and further funding. |
| Start Year | 2023 |
| Title | CellPhePy |
| Description | CellPhe provides functions to phenotype cells from time-lapse videos and accompanies the paper: Wiggins, L., Lord, A., Murphy, K.L. et al. The CellPhe toolkit for cell phenotyping using time-lapse imaging and pattern recognition. Nat Commun 14, 1854 (2023). https://doi.org/10.1038/s41467-023-37447-3 The Python package is a port of the original R implementation. |
| Type Of Technology | Software |
| Year Produced | 2024 |
| Open Source License? | Yes |
| Impact | See publications and further funding. |
| URL | https://github.com/uoy-research/CellPhePy |
