Lighting Copy + Paste
AR experience in which you can copy and paste real lights, virtually relighting your home as you go.
Role
Solo Developer
Technologies
Overview
Snap a picture with a hand gesture to create interactive 3D objects. If you snap a picture of an indoor light or lamp, the app will virtually relight your environment.
Inspired by Takahiro Horikawa's Image-To-Object prototype and Takashi Yoshinaga's physical ↔ virtual interaction work. Two "ooh, shiny" moments that made the direction immediately clear. Read the full writeup
Successes
Got camera access working on Quest using Julian Triveri's passthrough workaround. Integrated Stability's Image-To-3D API for .glb generation (with a custom URP shader because the package defaults were broken). Added virtual relighting using OpenAI's API for light detection.