(N00014-16-R-FO05) Semantic Information Pursuit for Multimodal Data Analysis
Lead Research Organisation:
University of Surrey
Department Name: Vision Speech and Signal Proc CVSSP
Abstract
Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.
Publications
Li H
(2020)
MDLatLRR: A novel decomposition method for infrared and visible image fusion.
in IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
Xu T
(2023)
Towards Robust Visual Object Tracking with Independent Target-Agnostic Detection and Effective Siamese Cross-Task Interaction.
in IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
Song X
(2018)
Dictionary Integration Using 3D Morphable Face Models for Pose-Invariant Collaborative-Representation-Based Classification
in IEEE Transactions on Information Forensics and Security
Zhao S
(2024)
Pluggable Attack for Visual Object Tracking
in IEEE Transactions on Information Forensics and Security
Wang R
(2021)
Graph Embedding Multi-Kernel Metric Learning for Image Set Classification With Grassmannian Manifold-Valued Features
in IEEE Transactions on Multimedia
Zhu X
(2022)
Robust Visual Object Tracking Via Adaptive Attribute-Aware Discriminative Correlation Filters
in IEEE Transactions on Multimedia
Chen Z
(2023)
Discriminative Dictionary Pair Learning With Scale-Constrained Structured Representation for Image Classification
in IEEE Transactions on Neural Networks and Learning Systems
Chen Z
(2022)
Relaxed Block-Diagonal Dictionary Pair Learning With Locality Constraint for Image Recognition.
in IEEE transactions on neural networks and learning systems
Wang R
(2022)
SymNet: A Simple Symmetric Positive Definite Manifold Deep Learning Method for Image Set Classification.
in IEEE transactions on neural networks and learning systems
Akbari A
(2023)
A Theoretical Insight Into the Effect of Loss Function for Deep Semantic-Preserving Learning.
in IEEE transactions on neural networks and learning systems
Description | The project developed state of the art algorithms for visual object tracking, landmark retrieval from large databases, and information theory measures for deep distribution learning, multidimensional regression and object classification. |
Exploitation Route | The outcomes are relevant for many diverse artificial intelligence applications. |
Sectors | Aerospace Defence and Marine Digital/Communication/Information Technologies (including Software) Electronics Healthcare Leisure Activities including Sports Recreation and Tourism Government Democracy and Justice Retail Security and Diplomacy Transport |
Description | Some of the findings are commercialised by a University spinout, Sensus Futuris. |
First Year Of Impact | 2022 |
Sector | Digital/Communication/Information Technologies (including Software) |
Impact Types | Economic |
Description | Multimodal Video Search by Examples (MVSE) |
Amount | £863,564 (GBP) |
Funding ID | EP/V002856/1 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 03/2021 |
End | 09/2024 |
Description | Anomaly detection |
Organisation | Bilkent University |
Country | Turkey |
Sector | Academic/University |
PI Contribution | Joint research on one class classification methods for applications to anomaly detection |
Collaborator Contribution | The kernel null-space technique and its regression-based formulation (called one-class kernel spectral regression, a.k.a. OC-KSR) is known to be an effective and computationally attractive one-class classification framework. Despite its outstanding performance, the applicability of kernel null-space method is limited due to its susceptibility to possible training data corruptions and inability to rank training observations according to their conformity with the model. This work addresses these shortcomings by studying the effect of regularising the solution of the null-space kernel Fisher methodology in the context of its regression-based formulation (OC-KSR). In this respect, first, the effect of a Tikhonov regularisation in the Hilbert space is analysed where the one-class learning problem in presence of contaminations in the training set is posed as a sensitivity analysis problem. Next, driven by the success of the sparse representation methodology, the effect of a sparsity regularisation on the solution is studied. For both alternative regularisation schemes, iterative algorithms are proposed which recursively update label confidences and rank training observations based on their fit with the model. Through extensive experiments conducted on different data sets, the proposed methodology is found to enhance robustness against contaminations in the training set as compared with the baseline kernel null-space technique as well as other existing approaches in a one-class classification paradigm while providing the functionality to rank training samples effectively. |
Impact | Paper submitted for publication |
Start Year | 2018 |
Description | International Joint Laboratory for Pattern Recognition and Computational Intelligence |
Organisation | Jianghan University |
Country | China |
Sector | Academic/University |
PI Contribution | Supervising visiting PhD students/researchers from Jiangnan University, visiting Jiangnan University to collaborate with the local research team. |
Collaborator Contribution | Working on joint problems in machine learning. |
Impact | See the Publications section |
Start Year | 2016 |
Company Name | Sensus Futuris Ltd |
Description | Sensus Futuris is a specialized Artificial Intelligence company with a focus on advanced image and video analytics for solutions in security, law enforcement, retail, and other applications. They provide state-of-the-art facial recognition systems and age estimation systems, among other products. |
Year Established | 2018 |
Impact | Product development stage |
Website | http://sensusfuturis.com/ |
Description | Biometrics technology demonstration |
Form Of Engagement Activity | Participation in an open day or visit at my research institution |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Industry/Business |
Results and Impact | This was an open day organised by the Centre for Vision, Speech and Signal Processing on the occasion of the 30th anniversary of its founding. The research and technologies developed at the Centre were demonstrated to circa 250 attendees, mainly form industry. |
Year(s) Of Engagement Activity | 2019 |
URL | https://www.surrey.ac.uk/centre-vision-speech-signal-processing/about/30th-anniversary |
Description | CAIEP-UK Seminar of Foreign Experts |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | This seminar was hosted in London by the State Administration of Foreign Affairs, China to solicit feedback on various aspects of scientific endeavour in China. The feedback may impact on future cooperation in the field of science and technology between China and the UK. |
Year(s) Of Engagement Activity | 2018 |
Description | Invited keynote talk on Quantifying Semantic Information, presented at the IAPR S+SSPR 2018 Workshop |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Postgraduate students |
Results and Impact | Josef Kittler presented an invite keynote talk on Quantifying Semantic Information, at the International Association for Pattern Recognition Workshop on Statistical, Structural and Syntactic Pattern Recognition, held at Fragrance Hill, Beijing, China on August 17-19, 2018. |
Year(s) Of Engagement Activity | 2018 |
URL | http://ssspr2018.buaa.edu.cn |
Description | ORBIT Seminar: Responsible Innovation for Industry - An Introduction to PAS 440 |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | An RBIT seminar on responsible engineering. |
Year(s) Of Engagement Activity | 2020 |
URL | http://www.orbit-rri.org |
Description | WISE 2019 |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Professor Kittler presented an invited talk on aspects of Artificial Intelligence at the Westlake International Symposium 2019. The title of his talk was: The changing face of the curse of dimensionality reduction in machine learning. |
Year(s) Of Engagement Activity | 2019 |