Layered visual system gives vehicle 'brains'

Share this on social media:

An innovative vision system that mimics the structure of the human brain could be the winning strategy for one of the automated vehicles in this year’s Darpa Urban challenge. The challenge will see vehicles navigating a pretend city using their own initiative, without a human driver to guide them, while adhering to strict Californian driving laws.

One of the competitors, Caltech, believes a vision system involving eight different cameras could be the answer to preventing its vehicle, Alice, from crashing into obstacles and other vehicles. Six of the cameras will face forward, one will face backwards, and one will be mounted on top with the ability to look left and right.

The cameras will feed into a computer system that contains different layers of processing. Lower layers will perform calculations based on information from the cameras, and this will then be fed up the hierarchy to computers that actually make the final decision.

‘It’s like having multiple parts of your brain telling you what to do,’ says Richard Murray, the leader of the project. The technique will provide the vehicle with greater flexibility by allowing it to evaluate problems for itself, he says.

The approach builds on a similar technique, developed by the Jet Propulsion Laboratory in the US to build extra-terrestrial rovers that explore the surfaces of other planets.

Recent News

29 July 2020

The Perseverance rover contains 19 cameras, including seven scientific instruments. It will analyse the climate and geology of Mars, looking for signs of past life, as well as monitoring the Martian atmosphere

02 July 2020

Norwegian seafood firm, Lerøy, has installed hyperspectral cameras on processing lines to sort fish. The system is able to measure the amount of blood in white fish, which gives a grade of quality

09 June 2020

Hyperspectral imaging is being used in a research programme at hospitals in Maryland and New York to investigate the prognostic value of skin findings associated with Covid-19 infection

27 May 2020

The composite picture of The Night Watch, made of 528 exposures stitched together digitally, makes it possible to zoom in on individual brushstrokes and even particles of pigment in the painting