What dual-function pixels are—and why they matter
Dual-function pixels are picture elements that can both create images by emitting light and capture images by recording incoming light within the same tiny structure, merging display and sensor pixels into a single bidirectional component for future hybrid devices. This is a sharp break from the split world we know today, where screen pixels shine and camera pixels watch from separate hardware. The new design, developed by a research team led by David Norris, combines these roles into one pixel that can both steer light and analyze it. In other words, every pixel on a future phone screen could double as part of the camera and as a light detection display, instead of hiding separate camera modules around the panel. If that sounds like science fiction, it is not—working prototypes already exist.
How a pixel can both see and shine
The ETH team’s so‑called Fourier pixels rely on the wave nature of light to combine light emission and light detection in the same structure. The pixel converts incoming light into a surface wave that propagates across the chip’s sculpted surface, then scatters back out as a light wave at another position; the interference of these waves creates patterns and images. To form a picture, light enters a carved region, triggers a surface wave, and then re‑emerges as conventional light; careful geometry makes outgoing waves overlap so bright spots appear where waves add and dark spots where they cancel. The magic is that this process works in reverse for sensing: incoming light mixes with a continuous reference wave, producing a pattern that reveals not only brightness but also phase and polarization of the light—detail that standard camera pixels cannot capture.
Why dual-function pixels beat today’s split hardware
Today’s devices treat display and sensor pixels as different species: one set on screens displays light information, while another set in camera sensors records it, and they cannot swap jobs. Dual-function pixels overturn that rule by creating and recording light in the same component. The payoff is not academic. Combining display and sensor pixels into one layer promises thinner devices, fewer cut‑outs, and cleaner front panels, because there is no need to reserve separate real estate for cameras. At the same time, these pixels can steer light and analyze its intensity, phase, and polarization, giving them richer optical data than conventional camera sensors. In short, this is less about a minor spec bump and more about compressing two optical systems—screen and camera—into a single intelligent layer that both sees the world and shines back at it.
From lab demo to camera–display hybrids
This technology is not a vague concept: researchers have already built working Fourier pixels and used them to create images, including a millimetre‑tall letter “E” logo that could appear in different colors depending on how the pixel was driven. The research, described in a Nature paper, has progressed far enough to support a patent application and even a spot in an innovation award competition. According to the Optical Materials Engineering Laboratory’s director David Norris, “Our new pixels for control and analysis could, therefore, become a useful tool in many areas.” In the near term, the realistic goal is a matrix of Fourier pixels, turning isolated prototypes into dense arrays that can act as complex camera–display devices. Once that matrix exists, any surface built from it becomes a light detection display—both screen and sensor at the same time.
What this could mean for future phones and headsets
The most exciting part of dual-function pixels is what they might unlock when scaled into full panels. A phone built from these display and sensor pixels could, in principle, act as one giant camera–display hybrid, making front faces more compact and flexible than today’s cut‑out‑ridden designs. Advanced head‑mounted displays could gain pixel‑level sensing, enabling screens that not only project images into your eyes but also read detailed light information from the environment and from your gaze, thanks to their ability to analyze phase and polarization. In the short term, the smart move is cautious optimism: we have matrices of Fourier pixels to build and manufacturing hurdles to cross. But the direction is clear. When every pixel can both see and shine, screens stop being passive canvases and start becoming active optical instruments—and that will reshape how mobile devices look, feel, and see the world.
