SC.12Journal/May 15, 2023
How we’re using virtual sets with AI for music video production
By Austin Hein · 2 min read

In the fast-paced world of music video production, creativity knows no bounds. Artists and directors are always pushing the boundaries of visual storytelling, which often means diverse, captivating locations.
The challenge
Imagine a video that needs a beach, a New York City skyscraper, a dramatic bedroom, an apartment kitchen and a starry night in a field. Pulling all of that into a single shoot day seems impossible without big location fees and travel. New technology changes that math.
Virtual sets with AI
To tackle an extensive shot list with limited time, we partnered with Lume Studios, a projector studio in SoHo. Its high-powered projectors cover the floor and three surrounding walls of the room.

The key was generating AI backgrounds for each scene. Instead of traveling to multiple locations, we created realistic, dynamic backgrounds with AI image tools and projected them onto the walls and floor.

The results
The project, built mostly on AI-generated backgrounds, exceeded our expectations and showed how far virtual set creation can stretch a production.

What’s next
As the technology improves, virtual sets will only get more accurate and realistic. AI tools paired with projector studios like Lume offer a more accessible, efficient and cost-effective way to bring diverse locations to life, with more creative room for artists and directors.