Skip to main content

The key to next-gen 3D vision for autonomous cars is … praying mantis goggles?

New 3D vision discovered in praying mantises
Researchers at the U.K.’s Newcastle University may have discovered a new way to more efficiently model computer vision systems — and it’s all thanks to a multi-year project that involves putting tiny 3D goggles on praying mantises.

“The 3D glasses we use are similar to the old-school 3D glasses we used to use in the cinema,” Dr. Vivek Nityananda, part of Newcastle’s Institute of Neuroscience, told Digital Trends. “The idea behind these is that having different color filters on each eye allows each eye to see a different set of images that the other eye can’t see. By manipulating the geometry of the images the eyes see we could create the 3D illusions, exactly like you see in the cinema. For our glasses, we cut out teardrop shapes from the color filters and fitted them onto the mantis using beeswax. They were then allowed to recover overnight, and we could try them in experiments the next day. Since we used beeswax, we could melt the wax and remove the glasses once the experiment was over.”

Recommended Videos

The glasses allowed the researchers to demonstrate that mantises have a way of computing stereoscopic distance to objects that differs from that of any other animal, including humans. Instead of comparing the stationary luminance patterns across the two eyes, as other vision systems do, mantises rely on matching motion or other kinds of change in each eyes’ view of the world.

Newcastle University
Newcastle University
Please enable Javascript to view this content

This could be exciting because detecting change simultaneously in both eyes is a simpler computational problem than figuring out which details of each eye’s view matches those of the other. It suggests that mantis stereo vision could be easier to model in computer vision applications and robotics, especially in situations where less computational power is available.

“So far we’ve been designing these systems to see and react to the world in the same way we do, but our brains are immensely complex and power hungry machines that may not be the ideal biological model to inspire efficient design,” Dr. Ghaith Tarawneh, another researcher on the project, told Digital Trends. “Mantis 3D vision uses the exact sort of computational trickery that challenges our way of seeing things: A view of the world radically different from ours, but evidently more fit for purpose. Adapting autonomous cars and drones after insect vision can give them the same capabilities: A superior ability to see the details that matter with shorter reaction times and longer battery life.”

A paper describing the work was recently published in the journal Current Biology.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Rivian tops owner satisfaction survey, ahead of BMW and Tesla
The front three-quarter view of a 2022 Rivian against a rocky backdrop.

Can the same vehicle brand sit both at the bottom of owner ratings in terms of reliability and at the top in terms of overall owner satisfaction? When that brand is Rivian, the answer is a resonant yes.

Rivian ranked number one in satisfaction for the second year in a row, with owners especially giving their R1S and R1T electric vehicle (EV) high marks in terms of comfort, speed, drivability, and ease of use, according to the latest Consumer Reports (CR) owner satisfaction survey.

Read more
Hybrid vehicle sales reach U.S. record, but EV sales drop in third quarter
Tesla Cybertruck

The share of electric and hybrid vehicle sales continued to grow in the U.S. in the third quarter, the Energy Information Administration (EIA) reported this month.

Taken together, sales of purely electric vehicles (EVs), hybrids, and plug-in hybrids (PHEVs) represented 19.6% of total light-duty vehicle (LDV) sales last quarter, up from 19.1% in the second quarter.

Read more
Tesla’s ‘Model Q’ to arrive in 2025 at a price under $30K, Deutsche Bank says
teslas model q to arrive in 2025 at a price under 30k deutsche bank says y range desktop lhd v2

Only a short month and half ago, Tesla CEO Elon Musk told investors that outside of the just-released driverless robotaxi, a regular Tesla model priced at $25,000 would be “pointless” and “silly”.

"It would be completely at odds with what we believe,” Musk said.

Read more