High-Contrast Projection Mapping under Light Field Illumination with LED Display and Aperiodic Lens Array

IEEE Transactions on Visualization and Computer Graphics

Abstract

Projection Mapping (PM) is a technology that projects images onto the surfaces of physical objects, allowing multiple users to share an augmented reality experience without special devices. However, its practical use has been constrained by the need for dark environments to ensure high-quality projection. To overcome this “dark-room constraint,” we propose a novel target-excluding lighting method that selectively illuminates the surrounding environment while avoiding the PM target. Our system achieves light-field illumination by combining an LED display panel with an optimized aperiodic lens array. The key contributions include a compact form factor that provides a large effective light source area, reproducing natural soft shadows comparable to typical lighting, while maintaining the spatial controllability needed to precisely avoid the target. We also introduce a computational technique for optimizing aperiodic lens placement to suppress undesired dark spots caused by crosstalk under target-excluding lighting, and three efficient methods for computing LED luminance patterns, including one that enables dynamic PM. Experiments with a prototype system demonstrate that our approach achieves high-contrast PM even in bright environments.



Prototype
Prototype

Target-excluding lighting
Target-excluding lighting

Comparison under target-excluding lighting. Unintended dark spots caused by a conventional periodic lens arrangement (left), and their significant mitigation through the proposed optimized lens placement (right).
Comparison under target-excluding lighting. Unintended dark spots caused by a conventional periodic lens arrangement (left), and their significant mitigation through the proposed optimized lens placement (right).


Citation

Kotaro Fujimura, Hiroki Kusuyama, Masaki Takeuchi, and Daisuke Iwai, “High-Contrast Projection Mapping under Light Field Illumination with LED Display and Aperiodic Lens Array,” IEEE Transactions on Visualization and Computer Graphics (Proceedings of 2026 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)), 2026.

Previous