Snapchat has recently made a major breakthrough in the field of AR, launching a new augmented reality feature based on AI. This feature allows users to change their surroundings in real time through text prompts, such as changing the background to a 1950s science fiction movie scene and modifying the user's clothing in real time. This innovation not only improves the immersion of user experience, but also provides content creators with powerful tools, heralding the further development of AR technology and the expansion of application scenarios.
Snapchat has given a first look at its upcoming on-device AI model, which is capable of using augmented reality (AR) to change the environment around users based on text prompts.
According to the demonstration video, the AI model can change the user's clothing and background scenes in real time based on cues such as "50s science fiction movies." In the coming months, users will be able to see the effects of AR lenses made using this new model. By the end of this year, creators will also be able to use this model to design custom effects for their shots.
Source:Snapchat
In addition to this groundbreaking AI model, Snapchat is also launching a new set of AI tools to make it easier for Lens creators to create custom AR effects. The latest update to Lens Studio includes new facial effects tools that allow creators to make personalized changes to users' faces through text prompts or uploaded images.
Among them, the "immersive ML" function can perform realistic transformations of the face, body and environment in real time. Creators can also use AI to generate 3D assets based on text or images, create masks and textures, and create 3D character heads that imitate users' facial expressions.
This series of AI innovations gives Snapchat creators unlimited flexibility, so that the creation of AR lens effects is no longer limited by the existing preset options, but can be arbitrarily imagined based on text or images, bringing users more creativity. and immersive virtual experiences.
In the past year, Snapchat has successively launched a number of new AI features, such as AI-generated snapshots, ChatGPT-driven chatbots, etc. This update once again demonstrates the company’s innovative strength in the field of consumer AI and AR.
This update of Snapchat not only demonstrates its leading technology in the fields of AI and AR, but also indicates that future AR experiences will be more personalized and immersive. This will bring users a richer interactive and entertainment experience and further promote the popularization and development of AR technology.