[BY]
Dmytro Kremeznyi
[Category]
AI
[DATE]
Mar 12, 2024
Reallusion has unveiled two groundbreaking plugins, iClone and Audio2Face. They give creators the ability to experience all the power of NVIDIA's AI-based facial animation system.
Reallusion has unveiled two groundbreaking plugins, forging a seamless connection between iClone and Audio2Face. These innovative tools empower creators to effortlessly harness the power of NVIDIA's AI-based facial animation system, revolutionizing the process of lip-sync animation creation.
The newly launched Audio2Face plugins for iClone redefine the animation workflow, simplifying the journey from character creation to lifelike animation. Now, exporting 3D characters from Character Creator or iClone to Audio2Face, and subsequently integrating the animation back into iClone, is a one-step process. This streamlined approach eliminates the complexities of manual steps, enabling artists to focus on unleashing their creative vision.
Audio2Face, initially introduced in 2021 as part of NVIDIA's Omniverse platform, has evolved into a powerhouse for multilingual expression. Unlike conventional lip-sync systems constrained by language barriers, Audio2Face boasts remarkable versatility. With the latest update introducing an AI model based on a female Chinese character, the software exhibits unparalleled proficiency in generating lip-sync animations for diverse languages, including songs and even gibberish.
The first plugin, CC Character Auto Setup, condenses the arduous 18-step process of exporting CC3+ characters into Audio2Face into a single effortless step. Meanwhile, the second plugin, Audio2Face (A2F) for iClone, seamlessly integrates facial animations generated by Audio2Face back into iClone. With intuitive controls for fine-tuning and smoothing animations, creators gain unparalleled flexibility in refining their character performances. This alternative workflow complements iClone's existing AccuLips system, offering creators a spectrum of options tailored to their needs.
Emphasizing accessibility, the Audio2Face plugins for iClone are compatible with iClone 8.4+, Audio2Face 2023.2+, and Character Creator 4.4+, and are available as a free download. To leverage these cutting-edge tools, users require the free Character Creator and iClone Omniverse Connectors, enabling a seamless integration of technologies. With Character Creator and iClone accessible for Windows 7 and above, Reallusion continues to democratize animation tools, empowering creators of all backgrounds to realize their artistic visions.
As a long-time iClone and CC user, I am very impressed with this integration. It opens up endless possibilities for creativity. - @0929enrico
Content
