Skip to main content

Single-pixel imaging enables 3D tracking at unprecedented speeds

Tsinghua 3d tracking

The optical setup used to track fast-moving objects at unprecedented high speeds (credit: Zihan Geng, Tsinghua University)

Researchers have developed a 3D method that can track fast-moving objects more than 200 times faster than traditional methods. 

The real-time tracking approach – which is based on data-efficient single-pixel imaging – could be used to improve autonomous driving, industrial inspection and security surveillance systems.

“Our approach does not require reconstructing the object's image to calculate its position, which significantly reduces data storage and computational costs,” said research team leader Zihan Geng from Tsinghua University in China. 

“Specifically, acquiring a 3D coordinate requires only 6 bytes of storage space and 2.4µs of computation time,” Geng continued. “By reducing computational costs and improving efficiency, it could lower the cost of equipment needed for high-speed tracking, making the technology more accessible and enabling new applications.”

The tracking method doesn’t require any prior motion information and can be performed with minimal computational resources.

“This technology could enhance the perception abilities of technologies like self-driving cars, improve security surveillance systems and offer more efficient monitoring and quality control for industrial inspection,” said Geng. 

Improving the usability of single-pixel imaging

Single-pixel imaging is a computational method that acquires measurements using a single detector, rather than the traditional array of pixels. It typically involves illuminating a scene with a sequence of patterns and then measuring the corresponding intensity values with a single-pixel detector.

To create a more practical single-pixel imaging system for object tracking, the researchers implemented a non-orthogonal projection approach, which is more efficient than the orthogonal method typically used. This involves projecting geometric light patterns onto two non-orthogonal planes, which creates 3D coordinates used to calculate the object's position. 

Non-orthogonal projection also reduces the overall system size, making it easier to assemble and implement.

High-speed tracking enabled by lasers and optics

After validating their method using simulations, the researchers conducted experiments using a single-pixel imaging setup that included a 532nm laser for active illumination, a digital micromirror device (DMD) with a 20kHz modulation rate to create the light patterns and two single-pixel detectors to collect the light signals.

To test the tracking ability, they allowed a metal sphere with a central hole to move down a curved spiral wire under gravity while being illuminated with light patterns. They used the detectors’ signals to calculate the object's 3D position and then used coordinate system rotation to obtain the calculated motion trajectory of the object. With this approach, they achieved a tracking rate of 6,667Hz with the DMD at a modulation rate of 20kHz.

The researchers say that the primary challenge with this technology is that it can currently only be used to track a single object. They are now developing methods that will allow multiple objects to be tracked with single-pixel imaging.

Topics

Read more about:

3D imaging, High-speed imaging

Media Partners