How do you teach a robot to find scratches? With artificial intelligence

With the help of artificial intelligence, a new robot will automatically find scratches and errors on components and provide quality control that is more effective than the human eye. In a MADE research project, VOLA and B&O are developing a prototype in collaboration with the Danish Technological Institute (DTI).

Stainless taps and aluminium-coated hi-fi equipment are all products with glossy reflective surfaces that must not be scratched.

VOLA manufactures kitchen taps, which have exactly this type of shiny surfaces. VOLA has always concentrated on quality and consistency. Today, quality control is performed by operators who manually inspect the items produced by the company.

– It is crucial for us to be part of such a project because we focus on quality and design. The challenge is that quality control is manual today, says Peter Krogh, Technical Manager at VOLA.

– We give people guidelines for inspecting items, but it will still always be an individual interpretation. We hope that we can achieve greater consistency on the issues once the solution is automated. There is great potential.

That's why the Danish Technological Institute's robot vision specialists are now trying to develop a method that can reliably detect scratches. This work is part of a MADE project together with VOLA and B&O and originates from MADE researcher Anne Juhler Hansen's work at AAU.

Due to the shiny and reflective nature of the products, you have to go beyond traditional inspection methods with simple camera technology.

DTI therefore makes use of a very special vision technology called deflectometry.

Lights, cameras and robots

Deflectometry is a way of effectively inspecting glossy and reflective items. Here, lights, cameras and robots are used to handle the item precisely during the inspection.

– Conceptually, it involves projecting a known pattern of light onto the item and then filming with a regular camera how that pattern appears, says Thomas Giselsson, consultant from DTI.

– If there are small recesses, holes, notches or scratches, you will be able to see them by processing the data you generate, he adds.

Deep learning to automate quality assurance

The benefits of the new system do not stop here.

Not only does deflectometry make it possible to identify defects that you would otherwise find difficult, you can also automate the whole process of finding defects and evaluating the quality. One of the methods for this is 'deep learning'.

– Initially, the operator helps the system by highlighting where the problem shows. When you have done this for a large amount of data, you will at some point be able to create a deep learning system that can make the same annotations on new items that the system has not seen before, says Thomas Giselsson.

– We should not have to tell the computer how to build the system. It can figure it out for itself. The system will then be able to see many of the problems we get people to identify today, he adds.

– This process is still in the experimental stage – and quality control is part of VOLA's development and implementation of new automation solutions, as are our new self-driving robots, which now manage parts of the internal logistics at the Horsens factory, explains Peter Krogh, Technical Manager at VOLA.

The project with VOLA, B&O and DTI is part of MADE research within the theme Sensor Technology and Production Data, funded by the Innovation Fund. In June 2020, a meeting has been agreed with VOLA, where DTI will discuss the options for introducing an automation plant in VOLA's factory in Horsens.

When is something a fault?

Other news

Article
Article
Article
Article
Article
Video