Machine vision solution developed to read Braille

Share this on social media:

In-situ, a Munich-based specialist for vision and sensor systems, has developed a vision solution for checking Braille text on medication packaging. The DotScan inspection system recognises Braille dots and evaluates their tactile quality with high precision.

Testing is non-contact using an industrial camera from IDS's USB uEye series. The monochrome CMOS camera captures 2D images. The height information is then calculated using a shape-from-shading algorithm. Lighting plays a key role in this process: to obtain accurate results, telecentric light sources are required, which illuminate the Braille embossed folding box from four directions at an angle from above. The telecentric light ensures that the 3D shape of a raised dot can be accurately derived from its shading pattern.

For the DotScan system, the system integrators at In-situ have developed custom lamps with a large field of illumination of 150 x 75mm. High power LEDs produce blue light by using a narrow band filter. ‘The advantage of blue light is that it has a short wavelength, so there is less reflection and that is better for analysing the raised dots,’ explains In-situ managing director Rainer Obergrußberger.

After embossing the Braille dots, the box is assembled and pasted. It is then folded flat and positioned on a drawer in the unit. The compact USB camera is positioned above the packaging. With a resolution of 1.3 Megapixels, the UI-1540SE-M model offers the ideal ratio of accuracy to data volume. The uEye captures 25fps at full resolution, which allows for fast inspection. The scene to be captured has a very high dynamic range, however. The shading has to be clearly discernible without overexposure in reflecting areas. Things are made even more difficult by the fact that the Braille dots are sometimes embossed on a black background, which is a major challenge in image acquisition. For this reason, the camera takes a series of images with different exposure times and superimposes them to determine the required dynamic range.

To accommodate the quick exposure time changes between the individual images, the developers at In-situ chose the software-triggered image acquisition mode. The camera was integrated using the proprietary uEye API programming interface.

The main challenge in developing the system was programming the algorithm. The shape-from-shading process was very slow at first and unsuitable for industrial use. After a long development phase, the developers succeeded in significantly improving the process: the image analysis, which initially took 10-20 seconds per image, can now compute up to 20 images per second. Obergrußberger said: ‘A lot of hard work and time went into the process. But we saw the potential of this method: Shape from shading offers the best price/performance ratio for this application.’

The DotScan system delivers an accuracy of +/-0.02mm depending on the surface properties of the folding box. The required calibration is carried out with special calibration standards.

In the field, the Braille inspection is performed by sampling. The system checks not only if the raised dots have the correct shape, but also if the information given in the Braille labelling meets the specifications.

Recent News

23 September 2020

The software will help engineers develop event-based vision systems, an imaging method that records changes in a scene rather than capturing an image frame by frame

14 September 2020

Messe Stuttgart has set a date of 5 to 7 October 2021 for the Vision show, which was cancelled because of the coronavirus pandemic. The show will be held in parallel with Motek

03 September 2020

Terahertz imaging company, Tihive, has been awarded €8.6m from the European Innovation Council's Accelerator programme to scale up its industrial inspection technology

01 September 2020

The robotics market in North America is down 18 per cent so far compared to the same period last year