Hologram: Realtime Holographic Overlays via LiDAR Augmented Reconstruction
This addresses the need for efficient, real-time holographic technology in augmented reality and telepresence, though it appears incremental by building on existing reconstruction methods.
The paper tackled the problem of creating real-time holographic overlays by developing a system using LiDAR-augmented 3D reconstruction that runs on portable devices like an iPhone 14 Pro, enabling metric-accurate facial reconstructions for interactive applications.
Guided by the hologram technology of the infamous Star Wars franchise, I present an application that creates real-time holographic overlays using LiDAR augmented 3D reconstruction. Prior attempts involve SLAM or NeRFs which either require highly calibrated scenes, incur steep computation costs, or fail to render dynamic scenes. I propose 3 high-fidelity reconstruction tools that can run on a portable device, such as a iPhone 14 Pro, which can allow for metric accurate facial reconstructions. My systems enable interactive and immersive holographic experiences that can be used for a wide range of applications, including augmented reality, telepresence, and entertainment.