PhenoImageShare - a phenotype image annotation, sharing and discovery platform

Lead Research Organisation: Heriot-Watt University
Department Name: S of Mathematical and Computer Sciences

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Technical Summary

Bio-imaging is key to observing and quantifying morphological and histological phenotype. There are major sets of image data capturing 3D and high-res histology images for adult and embryo phenotype. In general the phenotype resources may be searched individually, but there is no mechanism for integration, cross-query and analysis, especially with respect to human abnormality and disease phenotype. Furthermore the annotations will typically be traits found by manual scanning, secondary analysis for subtle variation especially at the cellular level remains rather difficult. Finally none of the data will be in the context of a spatio-temporal framework for spatial analysis and interoperability with atlas-based resources such as the Allen Brain Atlas and eMouseAtlas.

PhenoImageShare will provide a toolkit for complex image annotation, sharing, discovery and query from federated biological images supporting phenotype description. Feasibility will be demonstrated using high throughput phenotype images from KOMP2 and IMPC, histology images of adult tissues early post-natal (EUCOMMTOOLS) and embryo (EMAGE). Images will be a combination of 3D (OPT, uCT, uMR) and high-resolution histology sections. All tools will be applicable to other model systems. We will develop:

1. federated phenotype query capabilities across image archives;
2. standards for phenotype and spatial annotation with server technology for interoperability;
3. interfaces to annotate phenotype with standard ontologies and within image and atlas spatial markup;
4. a referencing protocol ("data-track") for spatial queries and visualisation with respect to atlas frameworks;
5. plug-in to an open image-archiving system (OME) enabling lab-publication of annotations to be integrated via the central DB.

The use-cases include demonstrating federated query of multiple image sources using the ontology-based annotation as well as direct spatial queries from a standard atlas framework such as eMouseAtlas.

Planned Impact

As reference genomes and large scale programmes to generate mutants and knock-outs are completed there has been matching effort to establish and codify phenotype with genomic coverage. In parallel Bio-imaging is emerging as a primary mechanism to observe and quantify morphological and histological phenotype in mouse embryos and adults. There are also other major collections of image data, for example from the Sanger Institute's Zebrafish phenotype screens and plant screens. Current phenotyping effort will deliver annotations held in independent databases associated with the primary data, which may be searched individually, but there is no mechanism for integration, cross-query and analysis, especially with respect to human abnormality and disease phenotypes. Furthermore the image annotations will be "obvious" traits by manual scanning but will not include or allow deeper investigation for more subtle variation especially at the cellular level. Finally current data will not be published in the context of a common spatio-temporal framework allowing more complex analysis and interoperability with other atlas-based resources such as the Allen Brain Atlas and eMouseAtlas gene expression databases. PhenoImageShare addresses the need to locate, share annotation, map to spatial references, provide semantic and spatial queries between images and map these to image and genomic/transcriptomic objects for co-query. Mouse images will be used within the project as these are an excellent set for prototyping and freely available, but the technology and toolkit are accessible to any phenotype images from any species. The ability to index and share annotation on existing images will be delivered early, with latter stages devoted to spatial queries for complex images. Technology will be delivered to the community at low granularity image tagging, while working towards integration with reference atlases. PhenoImageShare beneficiaries:
- Biological researchers: will be able to access and query phenotype (images underlying) in context of genome/transcriptome, and be able to make spatial queries between large image sets.
- Bioinformatics resource providers: benefit as they will be able to access the annotations on images from the annotation server, register their own images, access annotation and viewing tools for images without importing all the images.
- Image collection owners: will be able to provide their image annotation and location using a standard protocol realising low cost provision of access to public images. Image queries will be provided at a range of granularities, allowing collection owners to iterate and provide increasingly rich data as their images are annotated as projects progress.
- Publishers: will be able to provide image annotations related to papers.
- Translational researchers in industry and academia: the images in question support cellular phenotyping, complex phenotypes, many of the image subjects are models for disease research.
- Funders: images archived, well annotated, shared and re-used, maximising value for research spend and researcher effort as well as promoting data sharing.
- Image analysis experts: a searchable corpus of images on which to develop methodology.
- Scientists in training: seeing images in the context of a reference atlas is an excellent way to learn.
- Owners or funders of reference atlases: spatial queries vs. a reference promotes use of the reference set and the precision and granularity of image annotation, providing a sliding scale of tagging to precise spatial query.
- This project supports the three Rs benefiting animal welfare, as images are shared, promoting use of existing animals and related data, not generation of new images.
- Pharma and SMEs both consume images from the research sector, and generate their own images, e.g. during cellular phenotyping. The resulting toolkit will promote access to research images, and allow sharing of internal images across sites.

Publications

10 25 50
 
Description In the current stage of the project we have implemented the core databases, SOLR indexes and the associated services to deliver a functioning web-interface (www.phenoimageshare.org) that allow data submission and data annotation. There are about 360.000 images already included in the DB with primary annotations and we are implementing the links through to OMERO, spatial reasoning using atlases. With respect to the latter, we developed the concept of the straight mouse which facilitates searching images based on spatial descriptions of anatomical regions in an image using biological direction and axes. A paper on this work has recently been published in "Databases". The project work has been presented at a number of workshops and conferences, and a journal paper has been published.
Exploitation Route ELIXIR-UK has selected Expression Atlases as one of its strategic areas, involving Edinburgh University, Heriot-Watt University and Newcastle University, under the umbrella of the "Biomedical Atlas Centre". The PhenoImageShare outputs will contribute to the atlasing services of this centre and thus potentially reach a large user audience in the UK, Europe and beyond.
Sectors Agriculture, Food and Drink,Digital/Communication/Information Technologies (including Software),Healthcare,Pharmaceuticals and Medical Biotechnology

URL http://www.phenoimageshare.org
 
Title PhenoImagShare 
Description A database for sharing, integrating and annotating image based phenotype data. 
Type Of Material Database/Collection of data 
Year Produced 2014 
Provided To Others? Yes  
Impact Improved annotation of public data. Improved querying of public data. Definition of specification for ontology tool components. 
URL http://www.phenoimageshare.org
 
Description EBI-PhIS 
Organisation EMBL European Bioinformatics Institute (EMBL - EBI)
Country United Kingdom 
Sector Academic/University 
PI Contribution Research and Development contribution to the PhenoImageShare software system (specifically middleware components and spatial reasoning research).
Collaborator Contribution Research and Development contribution to the PhenoImageShare software system (specifically database backend, data sources and user evaluation).
Impact PhenoImageShare software
Start Year 2013
 
Description ELIXIR-UK 
Organisation ELIXIR
Department ELIXIR UK
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Contributed to the establishment of the Expression Atlases strategic area for ELIXIR-UK. (Also involves Edinburgh University - lead of PhenoImageShare.)
Collaborator Contribution ELIXIR-UK leads and coordinates the UK activities in the context of the European ELIXIR programme.
Impact Interdisciplinary: biomedical informatics (biomedical research, computer science research)
Start Year 2016
 
Description MRC HGU Edinburgh Mouse Atlas Project 
Organisation Medical Research Council (MRC)
Department MRC Human Genetics Unit
Country United Kingdom 
Sector Academic/University 
PI Contribution Provided biomedical informatics expertise.
Collaborator Contribution Provided biomedical use case application.
Impact Publications and further grants (details submitted in other sections).
 
Title PhenoImageShare 
Description Query service and schema for representing and query of phenotype-image data 
Type Of Technology Software 
Year Produced 2014 
Open Source License? Yes  
Impact PhenoImageShare (PhiS) is an online cross-species, cross-repository tool enabling semantic discovery, browsing and complex annotations of phenotype images. PhIS provides web tools that support the discovery, search and sharing of these annotations and associated metadata and genotype information. The tools also allow for submission or registration of new image instances and their annotations. PhenoImageShare also provides services which can be deployed in other platforms and these provide sustainability for the project. 
URL http://www.phenoimageshare.org
 
Description Dissemination and demonstration of PhenoImageShare GUI at ISMB PhenoDay Special Interest group 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact A presentation and live demonstration of the PhenoImageShare platform resulted in engagement with the audience and follow up from three representatives of the user community who offered requirements for new features for the project. A conference paper was accepted, and a full journal paper has been submitted.
http://phenoday2015.bio-lark.org/PhenotypeDay2015.pdf
Year(s) Of Engagement Activity 2015
URL http://phenoday2015.bio-lark.org/PhenotypeDay2015.pdf
 
Description ELIXIR all-hands 2015 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Presentation about biomedical atlases to ELIXIR interoperability group.
Year(s) Of Engagement Activity 2015
 
Description Medical Image Analysis Workshop 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 27 May 2015* Dundee Medical Image Analysis workshop
Year(s) Of Engagement Activity 2015
 
Description SWeL seminar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Presentation to local Semantic Web research interest group.
Year(s) Of Engagement Activity 2015