Thanks for visiting Imaging and Machine Vision Europe.

You're trying to access an editorial feature that is only available to logged in, registered users of Imaging and Machine Vision Europe. Registering is completely free, so why not sign up with us?

By registering, as well as being able to browse all content on the site without further interruption, you'll also have the option to receive our magazine (multiple times a year) and our email newsletters.

Artificial intelligence enables image fusion technology

Share this on social media:

Artificial intelligence is being used in a new multi-modal image fusion technology that automatically combines the best parts of images from different sources. The technology, jointly developed by NEC Corporation and the Tokyo Institute of Technology, can combine visible images taken by standard cameras with non-visible images taken by specialised devices, such as thermal or terahertz cameras.

Specialised non-visible imaging devices, such as infrared and x-ray cameras, can now be used in an extended range of environments, including night time monitoring under severe weather conditions. However, these cameras tend to provide images with poor resolution and quality in comparison to images taken of visible subjects. To overcome this, non-visible images are often compared or combined with clearer visible images of the same subject; however, in the past this has lead to abnormalities or hazards within the images being overlooked.

'This technology eliminates the need for such manual work, using artificial intelligence to effectively and automatically combine images taken by different cameras,’ said Professor Masatoshi Okutomi of the Tokyo Institute of Technology. ‘This also increases visibility by actively utilising the strong points of each visible image and non-visible image, even when the images are difficult to visualise.’

The artificial intelligence carries out detailed examinations of each image and assess the degree of visibility of each part. The best areas of each image are then automatically extracted and combined in a multi-modal image, taking into account environmental characteristics such as brightness, light direction and obstacles.

‘As this technology enables instant visual clarification, even under harsh conditions, it allows users to make well informed evaluations,’ commented Akio Yamada, general manager of Data Science Research Laboratories at NEC. ‘For example, it can be applied to monitoring systems to assist with night time observations, or for infrastructure inspection devices to improve the detection of interior and exterior abnormalities, such as cracking.’ 

The artificial intelligence also analyses and detects abnormalities and hazards in non-visible camera images while simultaneously avoiding image breakdowns, such as clipped highlights and crushed blacks. Image analysis is a common use of artificial intelligence and deep learning. In April, system-on-chip manufacturer Socionext and Japanese AI software company Soinn presented results of a trial using deep learning algorithms to assist technicians and detect human errors in medical image handling.

NEC and Tokyo Tech presented the technology on 7 June at the 23rd Symposium on Sensing via Image Information in Yokohama City, Japan.

Company: 

Related news

Recent News

04 October 2019

Each pixel in Prophesee’s Metavision sensor only activates if it detects a change in the scene – an event – which means low power, latency and data processing requirements

18 September 2019

3D sensing company, Outsight, has introduced a 3D semantic camera that combines lidar ranging with hyperspectral material analysis. The camera was introduced at the Autosens conference in Brussels

16 September 2019

OmniVision Technologies will be showing an automotive camera module at the AutoSens conference in Brussels from 17 to 19 September, built using OmniVision’s OX03A1Y image sensor with an Arm Mali-C71 image signal processor

09 September 2019

Hamamatsu Photonics claims it is the first company to mass produce a mid-infrared detector that doesn’t use mercury and cadmium, which are restricted under the European Commission’s RoHS directive