Privacy-Protected Human Identification in Encrypted/Transformed Domains

Lead Research Organisation: Northumbria University
Department Name: Fac of Engineering and Environment

Abstract

Biometrics has been widely utilized in the past two decades in many areas such as healthcare, banking, surveillance, and security control. Given the increased uptake of internet and mobile computing globally, many companies have been turning to biometric privacy and security to ensure secure communication. However, biometric verification over third-party or public network servers may be abusively exploited in an unauthorized way. To protect the privacy and improve the security, it has been advocated to carry out biometric verification in encrypted or transformed domains, where privacy and security can be more effectively guaranteed.

The basic idea behind the project is that the biometrics in the irreversible encrypted/transformed domains contains exactly the same amount of information as its original one, and hence one can establish a pattern recognition methodology to determine/extract useful information from chaotic signals in encrypted/transformed domains. This First Grant Scheme project aims to investigate how to discover and evaluate the information from chaotic signals for discriminative power, and develop robust pattern recognition schemes for biometric/multi-biometric verification in encrypted/transformed domains. The proposed methods/schemes will be vigorously validated over typical wild face/speech/gait datasets, and two practical demo systems (biometric banking and pedestrian profiling) will be designed and tested in real world environments.

The project will focus on both theoretical understanding of chaotic information and application-specific exploitation of chaotic pattern recognition. Considering multiple data structures hidden beneath a set of given chaotic signals, I will develop a robust way to find out the underlying various data structures for data understanding, clustering and classification. On the other side, given a specific issue such as encrypted/transformed biometric verification, one need to examine the generic theoretic findings in this specific topic and develop a robust scheme for biometric human identification.

The work of this project is within the areas of signal processing, machine learning and pattern analysis. The research on encryted/transformed biometric verification has come from the practical new needs of the UK's emerging new businesses. The project will provide the understanding needed to allow the future development of robust biometric verification methods with novel applications.

Planned Impact

The rapid advancement in biometric technology has generated huge impact in UK's usual life, ranging from financial service, public security, legal service, immigration control, to daily medical service and healthcare. As a result, biometric industry in UK has experienced drastic expansion in its market. For example, biometric banking has been widely endorsed by major UK banks. Public surveillance is also becoming a thriving market in UK. The value of new biometric markets has achieved $15 billion in 2015 and been estimated to grow further to $45 billion by 2021 (Global Biometrics Market, Markets & Markets, 2015). However, accompanying with the wide spread of biometric uses, people are more and more concerned about its security and privacy issues, especially when Internet-of-Things becomes booming and biometrics are used over public network severs. Developing safe and robust biometric technologies is a key priority for the UK to maintain and reinforce its world-leading role in this new research area and business market.

A key sector in the UK economy is banking and financial services, which accounts for 10% GDP (Financial services industry of the United Kingdom, Wikipedia) and 33% of the UK's trade balance. Biometric banking is now growing in importance due to the increased popularity and spread of mobile banking. People can easily access their accounts by scanning their face/iris/fingerpring. In the past two years, biometrics such as fingerprints/veins have been utilized by major banks such as HSBC and Barclays. Atom Bank has developed a solution to exploit face and voice recognition, which can be more conveniently integrated with mobile banking. This project will address key security and privacy issues linked to mobile banking, and Atom's involvement will give invaluable insight into industrial requirements for advanced technology exploiting biometric verification in the encrypted domain. I will also develop a mobile-based biometric banking demo with Atom Bank's professionals. Atom bank is a potential partner for future spin-off projects funded directly (under non-disclosure agreements), via InnovateUK (KTPs or otherwise) or with other partners in, for example in EU Horizon 2020 projects.

Public surveillance is another UK's thriving industry with a market value estimated around £6 billions (Securing the Nation's Future, British Security Industry Association). In this project, I will develop a surveillance demo system in collaboration with Warwick team and their spin-out, which is about pedestrian profiling using scrambled gait/face to provide real-time city monitoring on google map. Potentially, this may lead to a further KTP project via InnovateUK or a SME project via EU Horizon 2020.

The training of the postdoctoral researcher and a university funded PhD student with skills relevant to digital technologies will benefit both the individuals and UK industry. The experience gained will include signal processing, artificial intelligence, vision and image, and security systems. They will receive training in public understanding and engagement and will be involved in outreach work through Think Physics and Digital Living activities and attend exhibitions at Sunderland Software Cities and North East Catapult Centre (Sunderland). This will benefit the individuals and also attract wider interest from the public by promoting the spirit of science and highlighting everyday impacts which arise from this research.
 
Description So far, from the project, we have following key findings.
1) The encrypted/scrambled biometrics, though similarly chaotic as noises in their signals, contain sufficient information for classification. Hence, such encrypted/biometric patterns can be used as their original ones for identification verification, with little compromise on accuracy.
2) So far we tested new methods such as DAE and CNNs. DAE can work well on these chaotic patterns, but CNNs have drastic drops on their accuracy when handling the scarmbled/encrypted patterns.
3) A novel information measure is developed to measure the amount of information in such chaotic patterns.
4) A set of datasets were prepared and will be publically avalable for the research community.
5) The above findings will be published subsequently in 2020.
Exploitation Route Further research bids were submitted to EPSRC to implement the privacy-protected face-based passenger screening for security purpose, jointly with industry partners.
Sectors Aerospace, Defence and Marine,Agriculture, Food and Drink,Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education,Electronics,Financial Services, and Management Consultancy,Healthcare,Government, Democracy and Justice,Manufacturing, including Industrial Biotechology,Security and Diplomacy,Transport

 
Description Face2Gene: Genetic Identity behind Deep Facial Features
Amount £46,000 (GBP)
Organisation The Leverhulme Trust 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2020 
End 02/2021
 
Description Biometrics-based Mobile Banking with Atom Bank 
Organisation Atom Bank
Country United Kingdom 
Sector Private 
PI Contribution The initial collaboration between my team and Atom Bank has been reinforced by this EPSRC project. A number of meetings and joint actions have been planned and hopefully, this will enable our novel research on biometrics for Atom Bank's mobile banking service.
Collaborator Contribution Atom bank has kindly shared their experience on commercialized mobile banking services with us, making our research more tightly bound with the needs of the financial industry.
Impact The partner has provided their support letter to our EPSRC bidding and promise nearly £20k in-kind support to our research.
Start Year 2016
 
Description Human Activity Analysis in Smart Cities 
Organisation University of Warwick
Country United Kingdom 
Sector Academic/University 
PI Contribution Collaboration with Professor Chang-tsun Li in Computer Science, Warwick University, on Human Activity Analysis.
Collaborator Contribution Provide key support on developing joint research and producing papers on relevant topics. Also help organize a Springer book and special issue (in preparation) about the core research topics in this project.
Impact Two co-edited Springer books on biometrics and smart cities are under press (2019 - 2020).
Start Year 2017
 
Description Co-editing of a Springer Book on Biometrics with Warwick University 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact A Springer book on "Deep Biometrics" was organized by the collaboration of Dr Richard Jiang and Professor Chang-tsun Li. The book included 15 contributions from worldwide researchers, including the collaborative work between the PI and Warwick University.
Year(s) Of Engagement Activity 2019
 
Description EPSRC RISE Connector Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Based on the research in this project, I was selected as an EPSRC RISE Connector and attended the RISE workshop held in Tower Hotel, London, Dec 5-6 2018.

In the workshop, a plan for further dissemination to industry and parliament (if possible) was advised and developed.
Year(s) Of Engagement Activity 2018
 
Description Meeting with Atom Bank 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Industry/Business
Results and Impact A meeting was withheld with key engineers from Atom Bank in Durham, May 1st 2018. A brief introduction of the project was presented by Dr Richard Jiang. RA and PhD students attended the meeting.

The industry experts gave us key advice on challenges the industry (particularly mobile banking) is facing. Potential plan for further development was discussed.
Year(s) Of Engagement Activity 2018
 
Description Participation of further bid for InnovateUK with industry partners 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact The briefing seminar (Edinburgh, Feb 28, 2019) by KTN to academics and industry partners. A potential bid with a wide range of industry and academic partners (worth of £2-3m) is under preparation, leading by PI and Atom Bank.
Year(s) Of Engagement Activity 2018