Thanks for visiting Imaging and Machine Vision Europe.

You're trying to access an editorial feature that is only available to logged in, registered users of Imaging and Machine Vision Europe. Registering is completely free, so why not sign up with us?

By registering, as well as being able to browse all content on the site without further interruption, you'll also have the option to receive our magazine (multiple times a year) and our email newsletters.

Bonseyes EU project to bring AI to embedded devices

Share this on social media:

An €8.5 million European project to bring artificial intelligence development to low power cloud and edge devices has reached the midway point in its three-year duration.

Professor Oscar Deniz Suárez, from the Visilab group of the Universidad de Castilla-La Mancha in Ciudad Real in Spain, described the Bonseyes project, along with the Eyes of Things European project, which has just finished, in a keynote presentation at the European Machine Vision Forum in Bologna, Italy, held from 5 to 7 September.

Bonseyes will aim to be an AI marketplace, a repository where labelled data and trained models are shared. The site will also contain a deep learning toolbox to help users create their final model for deep learning inference, a model that will be able to run on an embedded device.

Suárez commented during his presentation that intelligence on the edge – or onboard a device – is not only advisable in terms of user experience, it's also probably mandatory because there's not enough bandwidth to stream images to central servers and respond to that data.

There is a trend for edge processing, according to Suárez, and to have many small devices able to run cognitive data processing and therefore provide instant response to the user everywhere.

There are, however, some obstacles to this, a big one being that to do something useful with deep learning requires labelled data and lots of it. This is what Suárez refers to as the ‘data wall’, which is what the Bonseyes project hopes to remove to some extent.

‘If you use the cloud, then you shouldn't have any problem with deep learning,’ Suárez said. ‘The problems start to come when you want to use [deep learning] in an embedded device – in a car, a robot, a toy – especially in terms of power consumption, latency, memory.’ It's these challenges that Bonseyes is looking to tackle. The project’s deep learning toolbox should help users carry out deep learning inference on the edge.

The marketplace’s front-end will be a web-based GUI, while the AI artefact layer, the back-end, will be made up of a typical machine learning pipeline. One of the steps in the pipeline will convert a model into something smaller that will run on an embedded device.

The project partners, which include big names like Arm, are currently investigating methods that would approximate a model into something more lightweight, so it takes less memory, and can run with lower latency and lower power consumption.

Bonseyes tools and programming environments will be supported by several reference platforms with pre-integrated middleware via open source and vendor packages.

Suárez also spoke about the Eyes of Things project, which is an open hardware platform based on Movidius’s, now Intel, Myriad2 system-on-chip. The prototype board presented at the project’s final meeting cost €112 for the bill of materials, although this was for a prototype volume, and Suárez said it could be made cheaper.

As part of the project, the partners made an automatic museum audio guide, building a device with a camera attached that the user would wear. The demonstrator was programmed to recognise paintings and relay information about the artist to the wearer.

Related news

From left: Dr Christopher Scheubel, Patrick Bilic, and Dr Andreas Franz

08 November 2019

The Moon landing was 50 years old in 2019. Zeiss lenses were used to capture this image

23 December 2019

From left: Dr Christopher Scheubel, Patrick Bilic, and Dr Andreas Franz

08 November 2019

Michał Czardybon (left), Adaptive Vision CEO, and Zbigniew Kawalec, QZ Solutions CEO

06 March 2020

Recent News

23 March 2020

Infervision's coronavirus AI system has now been installed at the Campus Bio-Medico University Hospital in Rome to screen and diagnose Covid-19 patients

19 February 2020

Sony and Prophesee have developed a stacked event-based vision sensor, it was announced at the International Solid-State Circuits Conference in San Francisco

17 January 2020

The lens-free technology from CEA-Leti, which digitally reconstructs microscope images and will be presented at SPIE Photonics West, opens up fast, automated cell screening

24 October 2019

Imec says the new production method promises an order of magnitude gain in fabrication throughput and cost compared to processing conventional infrared imagers