Meta has announced a new and powerful AI-powered video generator and editor, Movie Gen, which produces HD footage with complete sound.
While the AI image generators created a controversial wave around the world regarding true ownership and rightful usage of human data, Meta has brought an upgraded version, adding fuel to the fire. Meta announced a new AI-powered video generator and editor last Friday, which may revolutionize the world of video creation.
The new AI video maker is named Movie Gen, which made its first appearance eight months after OpenAI announced Sora, but it has still not launched publicly. OpenAI’s new AI products have been facing unprecedented hiccups, with either the project leads leaving the company for other opportunities or new regulations restricting innovations. Last week, a co-lead working on the AI-powered video generator left the company to join Google.
Even Meta is not ready to launch the new video generator yet. Meta’s Chief Product Officer, Chris Cox, mentioned on Threads that the product will not be released anytime soon as it is still expensive and the generation time takes too long. Meta has clarified that Movie Gen is being trained on a compliant combination of publicly available and licensed datasets but did not specify the details.
Movie Gen can be used to generate lifelike videos from text prompts. It can also take an existing image and create a hyper-realistic AI video out of it based on the textual prompt. Users can also edit existing footage to add transitions, change backgrounds, remove elements, and place new things that didn’t previously exist.
The capability demonstration videos have been impressive, with accurately matching audio, including ambient noise, background music, and voiceover. According to the demo videos, Movie Gen is currently the most sophisticated AI text-to-video tool under development. Movie Gen can render videos in any aspect ratio without damaging the footage or manual intervention.
The video generation aspect of Movie Gen currently holds 30 billion parameters, while the audio consists of 13 billion. For now, Movie Gen can only produce videos that are 16 seconds long at a quality that outperforms any competitor.
