Hedra Labs recently released a research preview version of Character-1, an amazing AI video generation tool. It can generate realistic dynamic videos based on photos and voice content provided by users, making the characters in the photos come to life, speaking or singing, and their lip shapes, expressions and gestures are perfectly synchronized with the voice. This technology breaks through traditional video production methods and brings infinite possibilities to content creation. Its convenient operation and high-quality output provide users with an unprecedented experience.
Recently, Hedra Labs launched a research preview version of Character-1, a technology that allows users to generate dynamic videos of individuals speaking and singing based on photos and voice content of any person.
Imagine that you upload a photo of a person and add any voice content, and a dynamic video can be generated in an instant, making the person in the photo seem to come to life, start talking or singing, and the lip shape, expression, and posture are all consistent with the The voice content matches perfectly! Are you a little excited?
Hedra Labs official demo video
Key Features and Functional Highlights:
Multi-Platform Compatibility: Users can easily use Character-1 on both desktop and mobile devices.
Unlimited duration generation: The current open preview version supports 30-second video generation. If H100 is in sufficient supply, 90 seconds of content can be generated every 60 seconds.
Supports multiple expression forms: Character-1 not only supports dialogue, but can also handle expression forms such as singing and rapping.
Hedra provides a user-friendly interface so even non-experts can get started quickly. Users can visit Hedra's official website, use the text-to-speech function or directly upload audio files, enter a character description, and then generate a dynamic video.
Hedra's AI technology ensures the high quality and fidelity of the video content, whether it is the character's expression, posture or voice synchronization, it can achieve satisfactory results.
Judging from the official cases, Character-1 can perfectly perform singing, acting and expressing roles with different emotions. The technology is not limited to human characters, but can even generate expressive inanimate objects, as long as they have distinct facial features.
The method of use is also very simple, the specific steps are as follows:
Open hedra experience address: https://top.aibase.com/tool/hedra
After entering the page, you can see this operation interface
The interface is very simple. In the first box, enter your character's lines and select a voice. Of course, if you don't want to use the generated audio, you can also import your own audio.
Here I simply type "Hello, this is a talking video created by AIbase. Today I will show you Hedra, which makes video generation as easy as breathing."
Then upload the picture I want to talk about in the second box, and here upload a photo of a beautiful woman I made before.
If you don’t have a ready-made picture, you can directly enter your character in the text box below and click Create to generate it.
After the image is uploaded, click Generate Video under the third box.
Here is the resulting video effect:
It can be seen that in the talking video generated by Hedra, the characters are relatively agile. Not only the mouth moves, but other parts of the body also move, and there are also expressions. However, since the platform has very few voices to choose from, the foreigner’s accent does not match the character in my picture very well. Another drawback is that the generated video is much blurrier than my original picture. I hope the platform will improve the picture in the future. quality.
Here I uploaded an audio myself. I generated the audio directly using clipping, selected a girl’s voice, directly entered the text and then read it aloud.
Try it again:
Select import audio
The generated effect is as follows:
Then the blur problem can be solved using krea ai's video enhancement function. However, please note that for free trial, the video length cannot exceed 10 seconds. If it exceeds, you can only crop it yourself. And don’t choose too high a frame rate. I chose 60 frames per second. Halfway through, I had to pay to upgrade, and I fainted in the toilet from crying~
All in all, Character-1 shows the great potential of AI technology in the field of video generation. Although there are still some shortcomings, its future development prospects are worth looking forward to. I believe that as the technology continues to improve, Character-1 will bring us more surprises.