Thanks for visiting Imaging and Machine Vision Europe.

You're trying to access an editorial feature that is only available to logged in, registered users of Imaging and Machine Vision Europe. Registering is completely free, so why not sign up with us?

By registering, as well as being able to browse all content on the site without further interruption, you'll also have the option to receive our magazine (multiple times a year) and our email newsletters.

Open-source project builds robot vision for shiny objects

Share this on social media:

Contract R&D organisation, Southwest Research Institute, has developed a vision solution that improves robot handling of shiny metallic objects.

The project integrates intelligent part reconstruction using the second generation of the Robot Operating System (ROS2) framework, an open-source software consortium for robotics applications.

Southwest Research Institute is demonstrating its technology at Automate in Chicago, from 8 to 11 April.

Within the ROS framework is ROS-Industrial, which extends ROS capabilities to robotics in manufacturing and automation. This latest Southwest Research Institute and ROS-Industrial solution uses ROS2 to integrate cameras affixed to a robotic arm, collecting point cloud data at a high frame rate to create a 3D output mesh that optimises path planning.

Some machine vision cameras and algorithms can struggle to render accurate 3D images of metallic objects because of light scattering off highly reflective surfaces. This challenge limits automation of welding and surface finishing processes in aerospace and automotive manufacturing.

Southwest Research Institute, in collaboration with ROS-Industrial, overcomes this challenge by integrating truncated sign distance field algorithms that stitch together several images, or point clouds, at a higher rate. The solution uses TrajOpt, or trajectory optimisation for motion planning, within the ROS-Industrial Scan-N-Plan framework, to enable real-time trajectory planning from 3D scan data.

‘This is a great case study in the benefits and challenges of integrating ROS2 into industrial robotics,’ said Matt Robinson, a Southwest Research Institute manager who supports ROS-Industrial. ‘It also shows how advanced perception algorithms can enable faster, more reliable scanning of metallic objects.’

Robinson said the project also underscores the benefits of a ROS-based approach, as this solution is hardware agnostic. The sensors and robot may be changed with relatively little effort.

ROS-Industrial provides manufacturers with standard software drivers for end effectors and fine-motor movement hardware that typically use earlier ROS software.

‘This project was ultimately a successful bridge from ROS to ROS2,’ Robinson said. ‘But we know it’s going to be a big task to move toward ROS2 as so many dependent packages and capabilities are still in ROS.’

Southwest Research Institute initiated the development of ROS-Industrial in 2012 through an internal research programme conducted with industry collaborators. Southwest Research Institute maintains the ROS-Industrial software repository and manages the ROS-Industrial consortium.

The ROS-Industrial consortia – with branches in the Americas, Europe, and Asia – provide cost-shared applied research and development for advanced factory automation.

Related news

Recent News

04 October 2019

Each pixel in Prophesee’s Metavision sensor only activates if it detects a change in the scene – an event – which means low power, latency and data processing requirements

18 September 2019

3D sensing company, Outsight, has introduced a 3D semantic camera that combines lidar ranging with hyperspectral material analysis. The camera was introduced at the Autosens conference in Brussels

16 September 2019

OmniVision Technologies will be showing an automotive camera module at the AutoSens conference in Brussels from 17 to 19 September, built using OmniVision’s OX03A1Y image sensor with an Arm Mali-C71 image signal processor

09 September 2019

Hamamatsu Photonics claims it is the first company to mass produce a mid-infrared detector that doesn’t use mercury and cadmium, which are restricted under the European Commission’s RoHS directive