What it means to see around corners with iPhone LiDAR
Non-line-of-sight imaging, in the context of iPhone LiDAR technology, is the process of using reflected light to detect, infer, and track objects that lie completely outside the camera’s visible field of view, such as those hidden around a corner, enabling phones to form useful estimates of object presence, motion, and shape without capturing a direct image. MIT Media Lab researchers have shown that the same LiDAR sensor already inside some iPhones and iPad Pro models can perform this kind of corner detection. While previous non-line-of-sight imaging systems relied on powerful and expensive lab-grade lasers, this work shows that consumer-grade, low‑power hardware can deliver meaningful results. Instead of sharp photos, users get inferences: that something is there, how it moves, and its approximate form. This shift turns iPhone LiDAR technology from a depth helper for photos into a potential early-warning and awareness tool.
How MIT’s aperture sampling model works
The MIT team’s system depends on motion and a method they call an aperture sampling model. As the iPhone or iPad moves, the LiDAR sensor collects a stream of noisy, partial distance readings from surfaces near a corner. Over time, the algorithm stitches these incomplete samples together, tracking the hidden object’s position, its rough shape, and the camera’s changing viewpoint. The result is less like a photograph and more like echolocation with light: a coarse but informative map of what lies out of sight. According to Digital Trends, the researchers demonstrated four abilities: tracking a single object, reconstructing its shape, tracking multiple objects, and performing camera self‑localization using hidden landmarks. That last capability is especially important for future devices that need to orient themselves reliably in complex, cluttered spaces where direct visibility is limited.
Why consumer-grade LiDAR makes this breakthrough practical
What makes this research stand out is its reliance on inexpensive, off‑the‑shelf hardware. The team achieved their non-line-of-sight imaging results using the same kind of low‑power corner detection sensor already baked into current iPhone LiDAR technology. The prototype sensor hardware can be assembled for under USD 50 (approx. RM230), which keeps it in the realm of realistic future phone components rather than exotic lab gear. Equally important, the researchers have released their code publicly, meaning Apple and other device makers can study and build on the approach without starting from scratch. While everyday users cannot yet enable this on their phones—current platforms do not expose the raw LiDAR data required—the combination of low cost and open software shortens the path from research demo to commercial feature in mainstream smartphones.
Potential new iPhone features: safety, photography, and AR
If Apple adopts techniques like MIT’s aperture sampling model, iPhone LiDAR technology could gain powerful new AR capabilities. A phone might warn you about a cyclist approaching from behind a corner, or help robots and delivery devices avoid collisions by detecting motion before it enters the frame. In photography, future camera modes could estimate the outline of subjects about to walk into view and adjust focus or exposure in advance, making action shots easier. Augmented reality apps could anchor digital content to hidden landmarks, keeping virtual objects stable even when the reference surfaces are out of sight. The system’s strength is not in rendering crisp hidden images, but in delivering reliable, real‑time awareness about what lies beyond direct sight—an ability that can make phones feel more perceptive and more helpful in everyday use.