Getting a grip on polished hips and knees

Share this on social media:

Tahir Rabbani of Viztronics spoke at the Vision show about a 3D solution for imaging shiny orthopaedic implants. Greg Blackman reports

Image: Denis Simonov/shutterstock.com

Orthopaedic implants are difficult to image. They are made from materials like titanium or chromium, polished to a mirror finish, and the surfaces are curved and irregular.

Viztronics, a start-up based in Dublin, Ireland, offering deflectometry solutions, has worked on a project to automate moving the metal blanks between processing stations and packing the final implants using robot bin picking.

Viztronics proposed a couple of 3D imaging techniques – depending on whether looking at the diffuse metal blanks or the highly polished finished implant – to get enough coverage of the implant to find it’s pose and pick it up reliably with a robot.

Automation and inspection are becoming more important for implant production, according to Dr Tahir Rabbani, R&D director of Viztronics, speaking at the Vision trade fair in Stuttgart. He said: ‘The whole process of manufacturing is moving to 3D printing, and as you 3D print these parts it’s very important to inspect the dimensions and also automate the manufacturing process.’

Unpolished implants have a diffuse metallic finish and can be imaged easily using any standard 3D vision technique. Viztronics used a structured light approach, using its ZFlex sensor, which comes in two versions, between them covering a field of view of 300 to 2,000mm and 50 to 500µm resolution.

Rabbani said: ‘The diffused part has a very good structure under structured light illumination, where you can clearly see the stripes... But using the same technique on the polished implant, you’re seeing the reflections from the sides of the bin rather than from the projector, and the point cloud is mainly noise and not really usable for bin picking.’

For the polished implant, Viztronics proposed deflectometry, a 3D imaging technique that exploits the reflective surface to generate a point cloud. Viztronics’ set-up uses an LCD pattern projector, which goes through a sequence of structured light patterns that are reflected by the object. Two or more cameras image the reflections to calculate the point cloud. The technique doesn’t give 3D information directly; it gives a surface normal and a surface curvature, from which a 3D surface can be calculated.

Deflectometry doesn’t work well with binary light patterns because the camera can’t focus on both the pattern and the surface at the same time – a binary pattern won’t give a meaningful result. Viztronics’ technology is based on phase shift, which is resistant to defocus and works well for deflectometry.

To calibrate a deflectometry set-up, the first step is to calibrate the two or more cameras, including the lens distortion. Then there’s a multi-view geometric calibration, and the position of the LCD projector is taken into account.

For the structured light, Viztronics uses a progressively increasing set of frequencies, both in x and y axes. By analysing the pattern reflected by the object, Viztronics’ software can calculate which pixel on the LCD screen was reflected and seen by the camera.

The image gives a point cloud with enough coverage for the robot to pick up the part. Rabbani said: ‘The point cloud doesn’t have a full coverage of the implant, but there are enough points there that once you match it to the CAD model, you know the pose of the object as well as the position of the implant in the bin, and that’s enough information for the robot to pick it up.’

Viztronics’ deflectometry system is called DeflectoZ; combined with its Smart Phaze software, it’s used for imaging reflective surfaces, such as ceramics, polished metal, glass and in this case orthopaedic implants.

As a next step, Viztronics wants to expand its solution to image both polished and unpolished implants using one sensor. For that, Rabbani said, the proposal is to use an LCD screen and the stereo cameras for both problems – to use triangulation for diffuse parts and deflectometry for polished parts in a single bin picking system.

Credit: Messe Stuttgart

27 September 2021