Sony releases event-based sensors with Prophesee

Share this on social media:

Credit: Sony Semiconductor Solutions

Sony Semiconductor Solutions has announced the upcoming release of two types of stacked event-based vision sensors. The industrial sensors, with a 4.86μm pixel pitch, are the result of work with Prophesee presented last year at the International Solid-State Circuits Conference.

The sensors have a dynamic range of 86dB, and resolutions of 1,280 x 720 pixels (IMX636) and 640 x 512 pixels (IMX637).

Event-based vision sensors asynchronously detect luminance changes for each pixel and output the changed data. This is combined with information on pixel position (xy coordinates) and time, thereby enabling high-speed, low latency data output.

This is different to standard frame-based imaging, where the entire image is output at certain intervals determined by the frame rate.

The sensors are based on Sony’s stacked structure using Cu-Cu connection to achieve conduction between the pixel chip and the logic chip. The logic chip is equipped with a signal processing circuit for detecting luminance changes, for each pixel.

The sensors are equipped with event filtering functions developed by Prophesee for eliminating unnecessary event data. Using these filters helps eliminate events that aren't needed for the recognition task, such as the LED flickering that can occur at certain frequencies (anti-flicker), as well as events that are highly unlikely to be the outline of a moving subject (event filter).

The filters also make it possible to adjust the volume of data when necessary to ensure it falls below the event rate that can be processed in downstream systems (event rate control).

Prophesee’s Metavision Intelligence Suite is available for application development and provides solutions for various use cases. Prophesee has also released an evaluation kit for developing applications with the sensors.

Related news

Image: Martial Red/shutterstock.com

06 July 2021

The involvement by Sinovation and its founder Dr Kai-Fu Lee strengthens Prophesee's presence in China

Credit: CEA; metamorworks-shutterstock - 2021/01

25 May 2021

The face recognition imager consumes 10,000 times less energy than a typical camera and processor. CEA-Leti is working with STMicroelectronics on the imager

Image: Silina

26 July 2021

Being able to curve multiple image sensors simultaneously opens up the ability to scale the process. Curving a sensor improves image quality without complex lenses

06 May 2021

The GTOF0503 sensor features a 5µm three-tap iToF pixel, incorporating an array with a resolution of 640 x 480 pixels