Thanks for visiting Imaging and Machine Vision Europe.

You're trying to access an editorial feature that is only available to logged in, registered users of Imaging and Machine Vision Europe. Registering is completely free, so why not sign up with us?

By registering, as well as being able to browse all content on the site without further interruption, you'll also have the option to receive our magazine (multiple times a year) and our email newsletters.

Smartphone deep learning app developed for crop disease diagnosis

Share this on social media:

Farmers could soon diagnose crop diseases using their smartphones thanks to a deep learning algorithm developed by scientists from École Polytechnique Fédérale de Lausanne (EPFL) in France and Penn State University in the USA.

The algorithm, which is part of the PlantVillage project, will be used to build a smartphone app that can analyse pictures of crops. The work represents the first successful proof of concept for plant disease diagnosis through smartphone pictures, and was published in Frontiers in Plant Science in September.

The PlantVillage project, formed by Marcel Salathé at EPFL and David Hughes at Penn State, employs algorithms to train computers to diagnose crop disease. The aim of the project is to put the algorithms in the hands of farmers, agriculturists, and everyday gardeners in the form of a smartphone app. ‘People will be able to snap a photograph of their sick plant with the app and get a diagnosis within seconds,’ said Salathé.

The Frontiers in Plant Science paper demonstrates the use of deep learning, a type of machine learning that uses algorithms to find patterns in big sets of data. In the paper, the researchers assigned every one of 54,306 photographs of diseased and healthy plant leaves to one of 38 classes of crop-disease pairs, such as tomato plant-tomato early blight and apple tree-apple scab as examples.

The researchers then trained a deep convolutional neural network to identify plants and diseases (or lack thereof for healthy plants), and measured how accurately it could assign each image to the correct class. In total, working with 14 crop species and 26 different plant diseases, the system could identify diseases on images it had never seen before with an accuracy of 99.35 per cent.

Despite the time and computing power needed to build the algorithm and train the model, the resulting code is small enough to be installed on a smartphone. 

‘We do believe that the [smartphone] approach represents a viable additional method to help prevent yield loss,’ said Hughes. ‘With the ever-improving number and quality of sensors on mobile devices, we consider it likely that highly accurate diagnoses via the smartphone are only a question of time.’

The photographs used to train the neural network were taken under controlled conditions, which do not always reflect the conditions of an open field. To address this, the team is now expanding their database of images to about 150,000 in order to improve the system’s ability to identify diseases. 

‘At this point, we’re relying on a photograph taken by a user in a field under natural conditions,’ explained Salathé. ‘But in the future, we would like to also bring in time, location, epidemiological trends, weather conditions and other signals to bear upon the network, which would vastly improve its abilities.’

Recent News

23 March 2020

Infervision's coronavirus AI system has now been installed at the Campus Bio-Medico University Hospital in Rome to screen and diagnose Covid-19 patients

19 February 2020

Sony and Prophesee have developed a stacked event-based vision sensor, it was announced at the International Solid-State Circuits Conference in San Francisco

17 January 2020

The lens-free technology from CEA-Leti, which digitally reconstructs microscope images and will be presented at SPIE Photonics West, opens up fast, automated cell screening

24 October 2019

Imec says the new production method promises an order of magnitude gain in fabrication throughput and cost compared to processing conventional infrared imagers