On February 18, Kunlun Wanwei announced the open source of China's first video generation model for AI short drama creation SkyReels-V1 and the first SOTA-level expression action controllable algorithm SkyReels-A1. This major move marks an important step in China's AI video generation field, aiming to solve the technical barriers and commercialization problems existing in the current AI video generation model and inject new vitality into the AI short drama industry.
As China's first open source video generation model for AI short drama creation, SkyReels-V1 has a technical architecture that integrates multiple modules such as lip generation, expression generation and body generation, achieving accurate control of the details of characters' performances. This model is trained and fine-tuned by tens of millions of high-quality Hollywood data, which significantly improves the controllability of expression generation and body generation, and provides strong technical support for AI short drama creation.
SkyReels-V1 supports a diverse combination of 33 delicate character expressions and 400+ natural movements, which can highly restore real-life emotional expressions. The videos it generates not only have the film-level light and shadow aesthetics and picture texture, but also can achieve the generation of film-level micro-expression performances of characters. It is particularly worth mentioning that SkyReels-V1 not only supports Wensheng Video, but also supports Tiesheng Video. It is the Tiesheng Video model with the largest parameters in the current open source video generation model.
At the technical implementation level, SkyReels-V1 relies on the high-quality data cleaning and manual labeling pipeline developed by Kunlun Wanwei to build tens of millions of high-quality movies, TV series and documentary data. The team also developed the "Human-Centric" video understanding multimodal model, which significantly improved the understanding of characters in the video and provided a solid technical foundation for the precise control of the model.
SkyReels-A1 is the first SOTA-level video base model-based expression action controllable algorithm, which supports video-driven movie-level expression capture and realizes high-fidelity micro-expression restoration. This algorithm can generate highly realistic character dynamic videos based on any human body proportion. Its realism comes from the deep restoration of multi-dimensional details such as character expression changes, emotions, skin texture and body movements, providing new possibilities for AI short drama creation.
SkyReels-A1 has significant advantages in technical implementation, supporting the generation of expression control of side faces, which can achieve more realistic eyebrow and eye micro-expression generation and larger head and natural body movements. Compared with Runway's Act-One, SkyReels-A1 has no distortion in the generated videos, and the performance details are more realistic, which can achieve a natural and perfect fusion of expressions and body movements, providing higher technical standards for AI short drama creation.
Kunlun Wanwei has always adhered to the concept of open source and is committed to promoting technological equality. Since August 2023, the company has successively opened up multiple models such as the "Tiangong" Skywork-13B series, the full-process R&D toolkit of digital intelligent body AgentStudio, and the "Tiangong Big Model 3.0" 400 billion parameter MoE super model. This open source SkyReels-V1 and SkyReels-A1 are the first cases in the AI short drama industry, aiming to bring low-cost, more controllable AIGC capabilities to users and promote the continuous construction and prosperity of the AI short drama ecosystem.
Fang Han, chairman and CEO of Kunlun Wanwei, said that the emergence of AIGC capabilities will significantly reduce the cost of film production and promote equal rights in culture. In the future, Kunlun Wanwei will continue to open source more video generation models and algorithms, provide more possibilities for the development of the AI short drama industry, and promote the widespread application of AI technology in the field of film and television creation.
Open source address:
SkyReels-V1
https://github.com/SkyworkAI/SkyReels-V1
SkyReels-A1
https://github.com/SkyworkAI/SkyReels-A1
Technical report: https://skyworkai.github.io/skyreels-a1.github.io/report.pdf
SkyReels official address: skyreels.ai