High Integrity Metrology under Adversarial Uncertainty
Lead Research Organisation:
University of Strathclyde
Department Name: Computer and Information Sciences
Abstract
"Metrology 2.0" is a working group of the Keysight Metrology Initiative, assigned to prototype a data analytics system which will fundamentally disrupt ritualized processes within the T&M industry. Metrology 2.0 will enable electronic traceability and automatic calculation of reference plane Measurement Uncertainty (MU), by inventing a cloud-based data-driven approach to instrument specification setting. This will deliver competitive differentiation through new services such as modern machine readable data-driven datasheets, enhanced traceability and data provenance of a measurement systems' accuracy, and the opportunity to be at the center of a measurement uncertainty service ecosystem.
Datasheets are no longer fit for purpose. The process to author datasheets and 'Spec Setting' has become ritualized over 30 years from a pre-computer era. Data sheets present data in an unstructured non-extensible fashion, with content which is unsuitable and inaccessible for MU analysis. System-level MU calculation is a judgement-laden, timeconsuming and inefficient process, resulting in inaccuracies. Our customers' performance demands will soon result in MU becoming a dominating factor in their measurement systems.
The Metrology 2.0 concept, applies the state-of-the-art in data science to the metrology processes of datasheet specification, calibration traceability, and measurement uncertainty calculation, to:
- Invent Electronic Datasheets, which self-populate specifications from pilot and production measurement data, and leverage modern semantic data structures such as Ontology, to present datasheets and Measurement Uncertainty in a consistent, precise, data-driven, and programmatically accessible manner.
- Invent Mechanisms for Traceability to National Standards to create a decentralized system, with appropriate cryptography and trust architecture to provide Electronic calibration Certificate provenance, using Blockchain technology.
- Develop a Cloud-Based Measurement Uncertainty Ecosystem which promotes the sharing of multi-vendor MU data, in a clearing house to facilitate MU system-level calculation, certified by National Accreditation Bodies
Initial pathfinding work to design an Ontology capable of describing Keysight Instruments and Software has been completed within. An architecture has been implemented which will be evaluated using pilot, environmental and production data of the N8480 Power Sensor. This will be combined with 3D calibration data from worldwide service centers to evaluate the efficacy of the data models for MU calculation and datasheet population.
Datasheets are no longer fit for purpose. The process to author datasheets and 'Spec Setting' has become ritualized over 30 years from a pre-computer era. Data sheets present data in an unstructured non-extensible fashion, with content which is unsuitable and inaccessible for MU analysis. System-level MU calculation is a judgement-laden, timeconsuming and inefficient process, resulting in inaccuracies. Our customers' performance demands will soon result in MU becoming a dominating factor in their measurement systems.
The Metrology 2.0 concept, applies the state-of-the-art in data science to the metrology processes of datasheet specification, calibration traceability, and measurement uncertainty calculation, to:
- Invent Electronic Datasheets, which self-populate specifications from pilot and production measurement data, and leverage modern semantic data structures such as Ontology, to present datasheets and Measurement Uncertainty in a consistent, precise, data-driven, and programmatically accessible manner.
- Invent Mechanisms for Traceability to National Standards to create a decentralized system, with appropriate cryptography and trust architecture to provide Electronic calibration Certificate provenance, using Blockchain technology.
- Develop a Cloud-Based Measurement Uncertainty Ecosystem which promotes the sharing of multi-vendor MU data, in a clearing house to facilitate MU system-level calculation, certified by National Accreditation Bodies
Initial pathfinding work to design an Ontology capable of describing Keysight Instruments and Software has been completed within. An architecture has been implemented which will be evaluated using pilot, environmental and production data of the N8480 Power Sensor. This will be combined with 3D calibration data from worldwide service centers to evaluate the efficacy of the data models for MU calculation and datasheet population.
Studentship Projects
| Project Reference | Relationship | Related To | Start | End | Student Name |
|---|---|---|---|---|---|
| EP/R512114/1 | 01/10/2017 | 31/12/2022 | |||
| 2095629 | Studentship | EP/R512114/1 | 01/10/2018 | 30/11/2022 | Ryan Shah |
| Description | As a starting note, the award is still not complete and more outputs of work achieved/discovered is still planned until completion. In terms of the most significant achievements, working alongside industrial partners, we have identified several inadequacies and flaws in the current state-of-the-art in metrology -- specifically calibration and calibration verification. We observed that when we consider more systems and devices becoming internet-connected (IoT devices and systems), these inadequacies are notably present and could not only hinder device and system operation, but improper calibration within cyberspace could lead to safety failures that in some cases (such as surgical robots) could mean the difference between life and death. Specifically, in accordance with the award objectives, it is noted that system-level calibration is a judgement-laden, manual, time-consuming and inefficient process, resulting in inaccuracies - to which we propose potential solutions to improve efficiency and security calibration processes with an aspiration for the calibration industry to move to an entirely digitised process. In terms of award objectives, I will highlight these again: - Invent mechanism for traceability to national standards to create a secure decentralised system using blockchain technology. - Develop a cloud-based measurement uncertainty ecosystem which promotes the sharing of multi-vendor MU data certified by national accreditation bodies In this award, we have proposed a new decentralised blockchain-based calibration system which meets these requirements and rectifies any concerns regarding integrity of calibration and availability and distribution of data across multiple vendors. We have also proposed a new access control model specific to calibration and traceability that factors in potential competition (adversarial relationships) between calibration providers, as well as confidentiality and integrity of calibration processes and actors involved. Ultimately we observe that blockchains may not be the only way forward as the requirements for the proposed access control model are not fully met by the blockchain alone, and thus this is a point for future work which could allow for more secure calibration (and anonymous verification among others...) In terms of the aim for inventing electronic datasheets, this is currently a work-in-progress research being done collectively by national measurement institutes internationally, so for the purpose of my research (secure calibration in accordance with the aims of the research award) we have implemented a simple electronic datasheet (calibration report/certificate) which enables a digitised approach. Ultimately in terms of taking this work forward and how it might be used, is that it shows that simply moving to a digitised calibration environment is not as straight forward. There are many security concerns and vulnerabilities which need to be addressed before calibration can be safely maintained and regulated in cyberspace, especially with consideration to IoT systems such as robotic systems. The outcomes of this award provide the first steps into building a secure digitised calibration environment, and would be made use of by national measurement agencies as well as intermediary calibration facilities, among others involved in calibration of their devices. As well as this, we observe that the implications of unsecured metrological processes has a direct impact on the safety and security of robotics systems - leading onto further investigations in this field of compromising operational confidentiality of robotic workflows through various side channel attacks. |
| Exploitation Route | Ultimately in terms of taking this work forward and how it might be used, is that it shows that simply moving to a digitised calibration environment is not as straight forward. There are many security concerns and vulnerabilities which need to be addressed before calibration can be safely maintained and regulated in cyberspace, especially with consideration to IoT systems such as robotic systems. The outcomes of this award provide the first steps into building a secure digitised calibration environment, and would be made use of by national measurement agencies as well as intermediary calibration facilities, among others involved in calibration of their devices. Calibration ultimately encompasses many pieces of equipment we use day-to-day, including cables for our devices to whole systems and sensors, to even mechanical rulers we may use when building furniture for example. Thus, the sectors to which this funding is most relevant (below) is fairly wide ranged, however the sectors most relevant are only selected. The implications of demonstrations of various side channel attacks has identified several inadequacies in existing defence measures and professional/legal standards which require immediate review before we see further deployments of robotic systems in the real-world. |
| Sectors | Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Electronics,Healthcare,Manufacturing, including Industrial Biotechology,Security and Diplomacy |
| Description | Industry Placement |
| Organisation | Keysight Technologies |
| Country | United States |
| Sector | Private |
| PI Contribution | I worked with Keysight (Edinburgh branch) looking into the existing state-of-the-art in industry-led calibration and metrological processes, to observe any potential weaknesses and vulnerabilities in current systems and devise a co-designed threat model for digitisation of a subset of calibration-related processes. |
| Collaborator Contribution | Provided us with the perspectives of industry-led calibration and metrology, showcasing state-of-the-art equipment for calibration in industry. |
| Impact | No outputs, but preliminary investigations helped lead to the division of calibration-related threat models in two of my publications. |
| Start Year | 2019 |