Skip to main content

MIT camera can ‘see’ around corners by analyzing nearly invisible shadows

Using Cameras to See Around Corners
If you drive, chances are that you’ve picked up the ability to “see around corners” by looking for visual clues such as another car’s headlights on the road when you’re coming up to a turn. Researchers at the Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory (CSAIL) have been attempting to solve that same problem for
Recommended Videos
autonomous cars, courtesy of a new camera system which uses almost invisible information about light reflections to detect objects or people that are otherwise hidden in a scene, and measure their speed and trajectory — all in real time.

“Our system uses video of how light reflects on the ground to be able to detect moving objects around the corner from the camera,” Katie Bouman, a PhD from MIT CSAIL who worked on the project, told Digital Trends. “For example, imagine walking down an L-shaped hallway, and there’s a wall between you and some objects around the corner. Those objects reflect a very small amount of light on the ground in front of you, which is referred to as the ‘penumbra.’ Because different slices of the hidden scene are being reflected from different points on the ground, you can recover and interpret how light is changing in the hidden scene over time.”

MIT CSAIL
MIT CSAIL

MIT’s system uses video of that penumbra to create a series of one-dimensional images which cumulatively reveal information about things that are moving around the corner. To be clear: The technology isn’t able to see identifying details of particular objects, just the fact that there are moving objects. However, it could still be extraordinarily useful.

“The ability to see around obstructions would be valuable for many tasks, including emergency response and self-driving cars,” Bouman continued. “For instance, someday we could use this sort of technology to alert drivers to pedestrians who are about to dart out into the road. There’s also the possibility of using it in hostage situations [or] in search-and-rescue, like when firefighters are trying to find people in burning buildings.”

Next up, the lab hopes to get this technology working for cameras that are attached to moving objects (kind of a vital step when you’re dealing with car technology!), as well as making it sufficiently robust to account for light conditions that are constantly changing. The tech is unlikely to be ready for commercialization any time soon, but there’s no reason why CornerCameras — as MIT is calling the technology — couldn’t one day be as integral a part of our cars as parking sensors.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Range Rover’s first electric SUV has 48,000 pre-orders
Land Rover Range Rover Velar SVAutobiography Dynamic Edition

Range Rover, the brand made famous for its British-styled, luxury, all-terrain SUVs, is keen to show it means business about going electric.

And, according to the most recent investor presentation by parent company JLR, that’s all because Range Rover fans are showing the way. Not only was demand for Range Rover’s hybrid vehicles up 29% in the last six months, but customers are buying hybrids “as a stepping stone towards battery electric vehicles,” the company says.

Read more
BYD’s cheap EVs might remain out of Canada too
BYD Han

With Chinese-made electric vehicles facing stiff tariffs in both Europe and America, a stirring question for EV drivers has started to arise: Can the race to make EVs more affordable continue if the world leader is kept out of the race?

China’s BYD, recognized as a global leader in terms of affordability, had to backtrack on plans to reach the U.S. market after the Biden administration in May imposed 100% tariffs on EVs made in China.

Read more
Tesla posts exaggerate self-driving capacity, safety regulators say
Beta of Tesla's FSD in a car.

The National Highway Traffic Safety Administration (NHTSA) is concerned that Tesla’s use of social media and its website makes false promises about the automaker’s full-self driving (FSD) software.
The warning dates back from May, but was made public in an email to Tesla released on November 8.
The NHTSA opened an investigation in October into 2.4 million Tesla vehicles equipped with the FSD software, following three reported collisions and a fatal crash. The investigation centers on FSD’s ability to perform in “relatively common” reduced visibility conditions, such as sun glare, fog, and airborne dust.
In these instances, it appears that “the driver may not be aware that he or she is responsible” to make appropriate operational selections, or “fully understand” the nuances of the system, NHTSA said.
Meanwhile, “Tesla’s X (Twitter) account has reposted or endorsed postings that exhibit disengaged driver behavior,” Gregory Magno, the NHTSA’s vehicle defects chief investigator, wrote to Tesla in an email.
The postings, which included reposted YouTube videos, may encourage viewers to see FSD-supervised as a “Robotaxi” instead of a partially automated, driver-assist system that requires “persistent attention and intermittent intervention by the driver,” Magno said.
In one of a number of Tesla posts on X, the social media platform owned by Tesla CEO Elon Musk, a driver was seen using FSD to reach a hospital while undergoing a heart attack. In another post, a driver said he had used FSD for a 50-minute ride home. Meanwhile, third-party comments on the posts promoted the advantages of using FSD while under the influence of alcohol or when tired, NHTSA said.
Tesla’s official website also promotes conflicting messaging on the capabilities of the FSD software, the regulator said.
NHTSA has requested that Tesla revisit its communications to ensure its messaging remains consistent with FSD’s approved instructions, namely that the software provides only a driver assist/support system requiring drivers to remain vigilant and maintain constant readiness to intervene in driving.
Tesla last month unveiled the Cybercab, an autonomous-driving EV with no steering wheel or pedals. The vehicle has been promoted as a robotaxi, a self-driving vehicle operated as part of a ride-paying service, such as the one already offered by Alphabet-owned Waymo.
But Tesla’s self-driving technology has remained under the scrutiny of regulators. FSD relies on multiple onboard cameras to feed machine-learning models that, in turn, help the car make decisions based on what it sees.
Meanwhile, Waymo’s technology relies on premapped roads, sensors, cameras, radar, and lidar (a laser-light radar), which might be very costly, but has met the approval of safety regulators.

Read more