Module 4: Digital Humans
4.1 Deepfake vs. Expression
Mastering the ‘Expression Transfer’ to prevent the dreaded AI-Dead-Eye look.
The Performance Gap
There is a massive difference between a Deepfake (identity replacement) and Expression Transfer (performance preservation).
A basic face swap often “flattens” the face. It replaces the pixels of the original video with your source image, but it frequently loses the micro-movements: the twitch of a lip, the furrow of a brow, or the squint of an eye. To the audience, this looks “uncanny”—it feels like a mask rather than a human. To fix this, we must master Expression Weights.
Identity: Does the face have the right nose, eyes, and bone structure? (Handled by the Source Image).
Performance: Does the face move with the correct emotion? (Handled by the Video Base).
The Three Levels of Transfer
When using professional tools like Akool or Sync Labs, you will often find settings that control how much the AI prioritizes the “new face” versus the “original movement.”
1. Full Identity (The Mask)
Prioritizes making the face look 100% like your source image. Often results in rigid, stiff expressions.
AVOID for emotional scenes.
2. Balanced (The Sweet Spot)
Keeps the core features of your source but allows the mouth and eyes to move as they did in the base video.
BEST for standard dialogue.
3. Full Expression
Prioritizes every single wrinkle and twitch of the original video. May slightly drift from the source identity.
BEST for high-drama screaming/crying.
Directing the “Performance Base”
The secret to a great face swap isn’t the swap itself—it’s the base video you generate in Module 3. If your base video has a blank, staring face, your face swap will too.
Director’s Prompting Secret (Runway/Kling):
Instead of prompting “A man stands there,” you must prompt the EXPRESSION:
“Close up of a man wincing in pain, his eyes narrowing and brow furrowing deeply. He let out a sharp breath, with visible emotion on his lips. 35mm cinematic lighting.”
One of the biggest giveaways of an AI face swap is “sliding eyes.” If the eyes don’t seem to lock onto an object, the immersion is broken.
The Workflow: Use the Inpainting Brush (Lesson 3.3) on your base video to mask ONLY the eyes before you do the face swap. Re-generate that area with the prompt “Sharp focus, eyes locked forward, intense stare.” Once the base eyes are stable, the face swap will be 10x more convincing.
Lesson Assignment
We are moving from identity to performance. You must prove you can transfer an emotion, not just a face.
- Generate a 5-second Base Video where your character shows a specific, extreme emotion (Anger, Terror, or Joy).
- Use Akool or Magic Hour to swap your “Genesis” identity onto that emotional base.
- The Test: Does the final character still look like your original Character Sheet while clearly expressing the emotion?
- Submit the final video and the text prompt you used for the base video’s expression.