Research

Introducing SwitchX 3.0

Introducing SwitchX 3.0

Introducing SwitchX 3.0

SwitchX is a video-to-video model where you can switch the background, lighting, and literally anything in your video with production-level quality.

Today we're announcing SwitchX 3.0.

SwitchX × MiniMax H3

MiniMax H3 is an open, general-purpose video model. We took it apart and rebuilt it for one job, video-to-video for production: our own dataset, our own architecture, and a final pass up to 4K that reads your original footage again for detail.

The heart of SwitchX stays the same. Source-Locked Rendering uses your alpha to lock your performance pixel for pixel, frame for frame, so only the light and the world around it change.

Source-Locked Rendering
Source
SwitchX 3.0
From an office to a subway car. The performance stays locked to the source while the world and its light switch.
One frame of a presenter that blends from the source on the left, an office, into the SwitchX 3.0 output on the right, a subway car, with a green glow tracing his silhouette.
Source on the left, SwitchX 3.0 on the right. The performance inside the alpha is locked and only relit.

What's new in 3.0

3.0 keeps the workflow and the lock, and brings four major updates:

Four updates in SwitchX 3.0: multiple references, dynamic backgrounds, camera tracking, and prompt control
  • Multiple references: up to four images in a single job.
  • Dynamic backgrounds: the generated world moves, instead of sitting still behind you.
  • Perfect camera tracking: handheld, orbit, and running shots, with no markers and no match move.
  • Tighter prompt control: describe what happens in the scene, how it moves, and when.

01 · Multiple references

The most requested feature since launch: SwitchX now takes up to four images as references. A wide of a whole set, a close-up of a prop, even a storyboard. 3.0 understands what each of these images is and uses it to create your final video.

One location, a message, a brand. A greenscreen shot, four references, and the billboard plays the sequence in storyboard order.

Source
SwitchX 3.0
Billboard takeover: drag across the frame. A greenscreen shot placed in the plaza, with the billboard playing the cards in storyboard order.
Four references: a plaza with a billboard, a 'new world.' title card, the beeble logo, and a three-panel storyboard
Four references: the location, two billboard cards, and a storyboard of the sequence.

One connected route. A floor plan and one image for each space turn a walk down a greenscreen corridor into a single continuous shot.

One Connected Location
Source
SwitchX 3.0
Four references: a floor plan of kitchen, corridor and rooftop, then a photo of each space
Four references: a floor plan and one image for each space on the route.

02 · Dynamic backgrounds

Backgrounds move far more than they did in 2.0. Traffic passes behind you, crowds walk, things explode, fire moves, snow falls. The world reacts to your shot instead of sitting behind it.

Source
SwitchX 3.0
Day to night: drag across the frame. Streetlights and houses roll past the window while her performance stays as shot.
Crowds Walk
Source
SwitchX 3.0
An empty plaza fills with commuters walking around her.
Fireworks in the Sky
Source
SwitchX 3.0
The flag keeps flying while the sky behind it turns to night and bursts into fireworks.
Smoke That Moves
Source
SwitchX 3.0
Launch smoke billows up behind the rocket.
Falling Snow
Source
SwitchX 3.0
A green hillside becomes a snowfield, with snow falling on the hikers.
A Living Underwater World
Source
SwitchX 3.0
A mountain road becomes the sea floor, with a shark swimming past the rider.

03 · Camera tracking

Camera tracking was good in 2.0, but 3.0 makes it perfect. The background stays locked to the world, like it was there when you actually shot it. No markers, no match move.

Source
SwitchX 3.0
Running shot: drag across the frame. A handheld run along a harbor, moved to a beach at sunset, with the background locked to every step.
Handheld
Source
SwitchX 3.0
A handheld follow through a wheat field, switched to a crowded night market.
Locked to the Action
Source
SwitchX 3.0
Kickboxers in an empty hall, moved into a ring that keeps up with every step.

04 · Prompt control

3.0 has a fundamentally better understanding of your prompt than 2.0. You can now describe what happens in the scene, how it moves, and even when. You're not setting a backdrop anymore, you're directing your scene.

Pigeons Take Flight
Source
SwitchX 3.0
Prompt: “Make the pigeons take flight as he runs past.”
Lights On, One by One
Source
SwitchX 3.0
Prompt: “Turn the ceiling lights on one by one as he approaches.”

Built for real VFX work

4K output and 10-bit color. Frame count matches your source exactly, and aspect ratio never changes. The details that make a model usable in real VFX work.

What you can do with it

SwitchX 3.0 is built with professionals in mind. More shots from the launch film:

Cliffside
Source
SwitchX 3.0
Rooftop
Source
SwitchX 3.0
Dessert Slope
Source
SwitchX 3.0
Fire FX
Source
SwitchX 3.0
Desert Chase
Source
SwitchX 3.0
Over the Threshold
Source
SwitchX 3.0

Put SwitchX 3.0 to work

SwitchX 3.0 is available in the Beeble cloud app: as a node in the canvas, or on the standalone SwitchX page.