Novel optical instrumentation for robotic manufacturing

Lead Research Organisation: CRANFIELD UNIVERSITY
Department Name: Sch of Aerospace, Transport & Manufact

Abstract

The aim of this proposal is to undertake research into novel optical instrumentation to support future manufacturing aims for more agile and flexible manufacturing systems as well as to improve precision of traditional robot-based manufacturing operations. New optical instrumentation will be developed combining two complimentary optical measurements techniques, range-resolved interferometry and laser speckle pattern correlation. These will be capable of remote, high quality and high-bandwidth measurements of the relative motion and orientation between a robotic end-effector mounted sensor and the workpiece, cumulating in a combined multi-parameter sensor.

The applications of these sensors are common to many areas of manufacturing and can be grouped into three main areas:
i) The stabilisation and control of the end-effector relative to the workpiece.
ii) Motion tracking to lock the robot to a moving assembly line.
iii) Relative positioning operations.
In these application areas there is a need for new effective, low cost instrumentation to provide real-time feedback about their relative motion and orientations, which this proposal will attempt to address.

In the first application area, the stabilisation and control of a tool's motion, positioning and orientation is required in the presence of end-effector and/or workpiece vibrations. For example contact tasks such as polishing, drilling, and riveting are often challenging tasks due to the comparatively low mechanical stiffness of typical industrial robots. This can result in excessive tool-tip deflection, vibration, and resulting poor quality of the finished part. Other methods of monitoring the motion suffer from limitations; vision systems can have limited update rates, whilst laser scanning/tracking systems are expensive and inflexible in that the scanning system needs to be mounted externally to the robot and maintain a line-of-sight.

The motion tracking of robotic manipulators to follow moving assembly lines is an important application in many manufacturing operations. Currently vision-systems can provide a flexible sensor capable of determining the relative position and orientation of objects to good precision, but their slow update rate and latency make them unsuitable for many feedback loops for real-time motion control. In addition, these visual systems sometimes require visual markers or beacons for operation and unless the cameras are mounted directly on the end-effector, the field-of-view can sometimes be obscured towards the end of the manoeuvring operation, at the point where control is most critical.

Finally, in the area of relative positioning many applications require high accuracy relative to a reference and this makes the adoption of standard robots difficult. For example, in airframe manufacturing the high accuracies of between 0.2 mm and 0.02 mm relative to a local reference a few meters away are required for drilling, fettling and component location operations and in remote laser cutting there is a requirement for high precision in the positioning of the cutting beam between scans, with any misalignment leading to multiple grooves and failure to cut the workpiece. Here laser speckle correlation may offer a solution with the proposed sensors capable of precise relative positioning between the end-effector and workpiece (potentially down to <1 micron in mm's and <50 micron in m's) while relying on other means, such as the robot encoders or vision systems, to reference to an absolute position.

Planned Impact

In many areas of robotics there is requirement for robots capable of performing complex tasks autonomously, and this is of great importance in manufacturing to fulfil the desire to move to more agile and flexible manufacturing systems, permitting smaller production runs and faster reconfiguration to new product lines. One proposed means of achieving this is via a new generation of flexible robot systems, with a higher degree of autonomy. As such the positioning and control of robotic end-effectors with respect to the workpiece is of great importance and there is a need for new effective, low cost instrumentation to provide real-time feedback about their relative motion and orientation.

This is an applied research proposal, requesting funds to research and construct novel optical instrumentation to support future manufacturing aims for more agile and flexible manufacturing systems but also to increase the operating precision of traditional robotic manufacturing operations; by providing new instruments capable of remote, high quality and high-bandwidth measurements of the relative motion and orientation between a robotic end-effector mounted sensor and the workpiece. The ultimate goal for such a project is the development of the resulting prototypes into commercial devices for the technical instrument market, benefiting both scientific research and the UK economy. At this stage, the aim is to demonstrate that the technology can be successfully implemented.

At first the potential impact will be mainly academic, providing manufacturing and automation researchers both in academia and industry with a new sensing technique. The intended applications of these sensors are common to many areas of manufacturing and can be grouped into three main areas; i) the stabilisation and control of the end-effector relative to the workpiece, ii) motion tracking to lock the robot to a moving assembly line and iii) moderate-to-high accuracy relative positioning operations. As the applications of the sensors are wide there is potential impact across a broad range of manufacturing areas. For example in automobile assembly lines it is desired to have robotic manipulators follow moving assembly lines whilst performing operations. In this area vision systems are limited by high processing requirements and their need for visual markers, which can become obscured during operation, while laser scanner systems are accurate, but are expensive, less flexible and have limited update rates. The proposed sensors will offer complementary data providing fast tracking information at higher data rates. In other areas the stabilisation and control of a tool's motion, positioning and orientation in the presence of end-effector and/or workpiece vibrations is required to ensure quality of the manufactured parts, in particular contact tasks such as polishing and drilling are often challenging due to the comparatively low mechanical stiffness of typical industrial robots. The provision of new, low cost, sensors capable of high date rates will enable researchers to investigate new control implementations. Later, economic and societal impact is envisaged in two ways, through the economic exploitation of the sensor concept by UK instrumentation companies, and by using the sensor as enabling technology to improve manufacturing processes within the UK manufacturing community.

To facilitate uptake and implementation of the sensors by researchers investigating solutions to specific manufacturing problems, we will publish open-access papers in relevant journals and conferences. In addition, reference designs and algorithm implementations will be made openly available and technology demonstrator systems will be constructed in the project. For dissemination to the wider manufacturing community, it is intended to demonstrate the sensor capabilities at manufacturing and automation conferences, trade fairs and exhibits, as well as to potential collaborators and end-users.

Publications

10 25 50
 
Description We have developed an optical interferometry technique that is capable of being used to measure the height of a part, in real time, during the additive layer manufacturing process. This is important as it enables feedback to the process to improve the quality of the finished part. We have have also developed an instrument based on laser speckle that tracks the speed of manufacturing robots that provides information that can be used to programme the robots to produce higher quality parts in the additive layer manufacturing process.
Exploitation Route The instrumentation can be used on manufacturing robots in-situ to provide real-time information of layer heights of parts and also the speed of robots. Both techniques are able to provide information to improve the quality of parts built during additive layer manufacturing. We are currently collaborating with the welding group at Cranfield with instruments installed on their robot systems, and more recently with the Manufacturing Technology Centre (MTC).
Sectors Aerospace, Defence and Marine,Manufacturing, including Industrial Biotechology

URL http://openoptics.info/munich-portal/flyers/speckle-odometry/
 
Description Instrumentation used by users groups including team at Cranfield. Instrumentation originally developed here has been trialed at the MTC. Instrumentation partially supported by this grant has been licenced to 3 companies.
First Year Of Impact 2021
Sector Aerospace, Defence and Marine,Manufacturing, including Industrial Biotechology
 
Description Direct Fibre Optic Shape Sensing for Large Scale Engineering Structures
Amount £1,378,766 (GBP)
Funding ID EP/V020218/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2021 
End 09/2025
 
Description Integrated optical position and orientation sensing for manufacturing robotics
Amount £1,101,012 (GBP)
Funding ID EP/S01313X/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2020 
End 01/2024
 
Description LASIMM - Large additive subtracted integrated modular machine
Amount € 4,868,263 (EUR)
Funding ID 723600 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 09/2016 
End 09/2019
 
Description New Wire Additive Manufacturing (NEWAM)
Amount £5,886,209 (GBP)
Funding ID EP/R027218/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 05/2018 
End 06/2024
 
Description Paul Instrument Fund - Self-referencing multi-surface precision interferometer
Amount £74,835 (GBP)
Funding ID PI150046 
Organisation The Royal Society 
Sector Charity/Non Profit
Country United Kingdom
Start 09/2016 
End 09/2019
 
Description RCUK Catapult Researchers in Residence (HVM MTC) - Application of novel optical positioning & orientation instrumentation in manufacturing robotics
Amount £50,000 (GBP)
Funding ID EP/R513519/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 03/2018 
End 03/2022
 
Title Data supporting the publication 'In-process range-resolved interferometric (RRI) 3d layer height measurements for wire + arc additive manufacturing (WAAM)' 
Description Data and data analysis code supporting Institute of Physics, Measurement Science and Technology publication. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
URL https://cord.cranfield.ac.uk/articles/dataset/Data_supporting_the_publication_In-process_range-resol...
 
Title Optical fibre based interferometry 
Description IP based on our optical fibre based interferometry research has been licenced 
IP Reference  
Protection Trade Mark
Year Protection Granted 2021
Licensed Commercial In Confidence
Impact 3 licence agreements have been signed between 2 UK companies and the university and 1 international company and the university.
 
Description Display stand at Laser World of Photonics Exhibition, Munich 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Instrumentation demonstrators from several EPSRC funded programmes exhibited at a major international exhibition & conference. The aim was to increase impact of the our research by engaging with end users. A number of useful new contacts were made that are currently being further developed.
Year(s) Of Engagement Activity 2017
URL http://openoptics.info/munich-portal/
 
Description Display stand at Photonex exhibition, UK, 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Instrumentation demonstrators from several EPSRC funded programmes exhibited at a major international exhibition & conference. The aim was to increase impact of the our research by engaging with end users. A number of useful new contacts were made that are currently being further developed.
Year(s) Of Engagement Activity 2017