METAL for iPhone

Read AI news in the METAL app.

Download METAL and discover fresh AI stories every day.

Download on the App Store

For iPhone · Free download

Search for METAL AI Magazine in the App Store on your iPhone.

METAL

AI GlossaryㄱWords you meet while using AI

Genjutsu

A Higgsfield video editing tool that swaps out the people or background in an already-shot clip while keeping the original acting and camera work intact

In plain words

Genjutsu is a Higgsfield video editing tool that keeps the movement and camera flow of an already-filmed clip untouched, while swapping out only the people or background inside it.

Think of it like puppetry. The puppeteer's hand movements — the pace an actor walked at, the timing of a head turn, the rhythm of a camera shake — stay exactly the same, only the puppet on stage gets swapped. Until now, if you didn't like one part of a generated video, you had to rewrite the prompt and regenerate the whole thing, losing the good acting and camera movement along with it. Genjutsu was built so you can swap out just the part you want without touching the rest.

There are two methods. Motion Transfer extracts only the movement and camera work from the original video and applies it to a new character or scene. Object Swap does the opposite — it changes only a specific part of the frame, like clothing or props, while leaving everything else as is. You don't even need to write a prompt; you can just pick from more than 30 presets to convert the clip.

How it shows up in the news

In articles, it appears as something like "Genjutsu, which keeps the acting and camera but changes the background." It's easy to mistake it for a tool that generates a brand-new video from scratch, but it's actually closer to an editing tool that reuses the movement from an already-filmed clip while replacing only certain elements like the people or background.

Try it yourself

  1. Prepare the original video clip you want to use (under 30 seconds).
  2. Gather up to 30 reference images of the person, product, or costume you want to swap in.
  3. Choose Motion Transfer if you want to apply the entire movement and camera work to a new subject, or Object Swap if you only want to change part of the frame.
  4. Write your own prompt, or pick a style from the available presets.
  5. Check how many credits the generation will use before running it.

See also

Stories using this term

Browse every entry