AI face replacement is the substitution or modification of faces using artificial intelligence (AI), and it’s been getting lots of attention in the last few years.
Through VFX and rendering technology, you can rejuvenate an actor through digital de-aging, create digital doubles to perform stunt scenes, or even create AI-generated actors trained from thousands of anonymous facial gestures.
This has changed the way live-action shots are produced, from major Hollywood films to social media content and video games. With these advances, you can achieve effects that were once impossible, all the while shortening timelines and reducing costs.
Below is what you should know about AI face replacement.
What is AI face replacement?
AI face replacement is a technique that uses deep neural networks to swap one face for another (face swap) or modify facial features within a video sequence.
Although early viral demos were often associated with ethically questionable content, major studios quickly realized that the same technology could assist with the following:
Digital de-aging
It could make an actor appear younger without hours of makeup.
For example, AI face replacement can smooth wrinkles, restore skin elasticity, alter muscle posture, and adjust light reflection so it bounces off the face like it would on younger skin.
Stunt doubles
It could map the main actor’s face onto a stunt performer’s body.
AI-generated actors
It could create characters using original gestures and voice.
Scheduling conflicts
It could allow filming with a body double and later inserting an actor’s face digitally, despite them being unavailable for the shoot.
What are some recent examples of AI face replacement in Hollywood movies?
In recent years, major Hollywood studios have used AI face replacement to achieve great results in films like The Irishman (2019) by Martin Scorsese, where Robert De Niro appears 40 years younger, and Indiana Jones and the Dial of Destiny (2023), featuring a de-aged Harrison Ford in flashback scenes.
What are some popular AI face replacement desktop tools?
Choosing the best AI face replacement tool for your videos depends on a few factors, including technical knowledge and budget. Here are some popular desktop tools that don’t require programming experience:
DeepFaceLab
An open-source tool launched in GitHub and created by a developer community to make deep fakes or deep fake VFX, including advanced face-swapping capabilities and customization options.
DeepFaceLab might be a good option if you are a filmmaker but don’t have a big budget. However, it’s important to know that this tool has a steep learning curve and requires powerful hardware.
To use DeepFaceLab effectively, you need skills in Python, deep learning (like TensorFlow or PyTorch), video editing, and GPU computing. You may also need to be familiar with neural networks and preparing training datasets.
FaceSwap
FaceSwap is an open-source GitHub tool that’s available geared more toward beginners.
It provides a user-friendly graphical interface and supports multiple face-swapping models. This means that you can choose from different algorithms and techniques to find the best fit for the type of video project you’re working on.
For optimal performance, it requires a powerful GPU and you need to have Python knowledge and some understanding of TensorFlow.
Roop
Roop is an open-source GitHub tool that allows users to easily swap faces in videos with less advanced customization. Though installation can be tricky, it’s user-friendly and simplifies deepfake creation for beginners.
Roop installation requires setting up Python, Git, FFMPEG, and Microsoft Visual C++ and.
You can choose between a basic setup for slower computers or a GPU-accelerated version for better performance.
Are there mobile apps available for AI face replacement?
While they may not offer the full capabilities of tools like DeepFaceLab or FaceSwap, mobile apps can work great to create small, fun, and viral video content.
They are not designed to be used on movie productions or high-detail work but rather more casual use.
Some popular mobile apps for AI face replacement or AI face swapping are:
- Reface
- FaceApp
- FaceMagic
Keep in mind that these tools don’t allow frame-by-frame video editing and they may have watermarks and subscription fees.
Is AI face swapping legal for filmmaking?
AI face replacement or face swapping is legal if image rights are respected and consent is obtained. In practice, actors’ or subjects’ contracts can typically include:
- Transfer of image rights for digital reuse
- Prior approval of the final appearance
- Additional compensation when AI-generated material is created.
However, legislation may vary depending on the country.
Using Massed Compute for your VFX AI workloads
AI face replacement models can be computationally intensive needing tremendous processing power to perform best.
Training a model means processing millions upon millions of small details (like wrinkles, mouth movements, lighting changes) repeatedly until the AI can realistically reproduce a face. This workload is so heavy that, on a normal computer, it could take days or even weeks. Massed Compute’s cloud GPUs can reduce training time from days to just a few hours and significantly improve the quality of your output.
Use the coupon code MassedComputeResearch for 15% off any GPU rental. Sign up and check out our marketplace today!
