Recently, the field of AI technology has ushered in a milestone breakthrough. Captions officially released its new AI model Mirage, a technology that completely subverts the traditional way of lip-syncing and video generation. Mirage can generate user-generated content (UGC)-style videos played by virtual characters in real time by analyzing scripts or audio clips. The authenticity of facial expressions and body language is far beyond any previous technology, marking the entry of AI video creation into a new era.
Mirage’s core strength lies in its ability to “generate from zero”. Unlike traditional video production methods, Mirage does not need to rely on pre-recorded materials or complex lip-on tools. It can directly generate original characters, backgrounds, voice and even complete scripts based on the audio or text entered by the user. This innovative technology not only greatly simplifies the video production process, but also provides creators with unprecedented flexibility.
According to the Captions team, Mirage uses advanced generative AI technology, and its training data covers a large number of real human performance samples. This makes the facial micro-expressions and natural movements generated by Mirage so realistic that it is difficult to tell the truth. Compared with traditional lip synchronization and dubbing technology, the characters generated by Mirage are not only accurate in their lip shape, but also have high-quality details such as eyes and nods with the context, further enhancing the realism of the video.
Industry insiders generally believe that the launch of Mirage will have a profound impact on the fields of advertising marketing and content creation. From entering scripts to generating a full video, the entire process takes only a few minutes, without actors, studios or complex post editing, greatly reducing costs and time. In addition, Mirage currently supports video generation in more than 29 languages, providing great convenience for the promotion of the global market.
User test results show that the "no-existent characters" generated by Mirage are extremely natural in UGC videos, and it is difficult for viewers to even detect that they are AI products. Captions promises to further optimize the model in the future and add more customization options to meet the needs of different users. This leap in AI's lip-on technology not only significantly improves creative efficiency, but also takes the realism of virtual characters to a new level, which deserves the industry's in-depth attention to its subsequent development.
If you are interested in this technology, you can try it out via the following link: https://www.captions.ai/mirage