What corner-seeing LiDAR on an iPhone really means
Corner-seeing LiDAR on an iPhone refers to using the phone’s built‑in depth sensor to detect, track, and roughly reconstruct objects that sit outside the camera’s direct view, turning scattered light from nearby surfaces into a map of hidden motion and shape. Researchers at the MIT Media Lab have shown that the iPhone LiDAR sensor, originally added for augmented reality and depth effects, can power this kind of non‑line‑of‑sight imaging. Instead of giving you a sharp photograph of what is around the bend, the system reveals that something is present, estimates how it moves, and guesses its outline. According to MIT Media Lab researchers, this is the first time a “low‑power LiDAR sensor already embedded in our smartphones” has been used to reach this performance, challenging the idea that corner detection technology needs lab‑grade equipment.
How MIT turned consumer LiDAR into corner detection technology
The MIT team’s key insight is that motion can turn noisy iPhone LiDAR data into something far more informative. As you move your phone, the system treats each slightly different viewpoint as a small sample of a larger virtual aperture, a strategy they describe as an aperture sampling model. Over time, it stitches together these imperfect depth readings from walls or floors where light has bounced off a hidden object. The result is not a photo but a growing statistical picture: first that an object is there, then how it is moving, and finally a rough outline of its shape. This is a form of non‑line‑of‑sight imaging, similar in spirit to echolocation but using light instead of sound. One quotable detail: the team has made its code publicly available and built compatible sensor hardware for under USD 50 (approx. RM230).
From iPhone LiDAR sensor to object tracking iPhone apps
On paper, this breakthrough turns the iPhone LiDAR sensor into the core of a future object tracking iPhone platform that does more than today’s portrait blur and room scans. The researchers demonstrated four abilities: tracking a single hidden object, reconstructing its shape, tracking multiple hidden objects, and localizing the camera itself using out‑of‑view landmarks. That last capability is especially important, because it means a phone or robot can understand where it is relative to things it cannot see directly. For now, you cannot install this on your phone, because, as researcher Siddharth Somasundaram notes, it would require companies to release raw LiDAR data they usually keep locked down. Even so, the public code and low hardware barrier show that existing devices already have the sensing power needed for advanced corner detection technology.
New safety, navigation, and computational photography uses
If phone makers open up lower‑level LiDAR data, developers could turn this research into real products. In safety, a phone placed near a doorway could warn about people or vehicles coming from outside the frame, helping with accident avoidance in crowded hallways or driveways. As a navigation aid, an app could describe motion around a corner or behind an obstacle, giving earlier cues than a standard camera view. For computational photography, corner‑aware depth signals could refine motion blur, subject isolation, or even guide when to capture frames before a subject comes into view. Devices such as delivery robots, home robots, or drones could combine this with existing sensors to orient themselves using hidden landmarks, improving path planning in tight spaces. The bigger story is that this work reframes the iPhone LiDAR sensor as a flexible 3D tool, not just a portrait and AR helper.