"Why do you need Sora if you have Meta Movie Gen?"

Meta has introduced its new tool, Movie Gen, a third-generation multimodal video artificial intelligence that has the ability to “create personalized videos and sounds, edit existing videos, and transform personal images into a unique video.” This new model promises to outperform other similar technologies, such as Runway’s Gen-3 and OpenAI’s Sora.

Movie Gen builds on the company's previous work, which includes the multimodal models Make-A-Scene and the image models Llama. The new tool combines video generation technologies, precise video editing, and audio generation, giving creators greater control over the details of their content. According to the company, these models will facilitate the development of new products that will enhance creativity.

The video generation system of Movie Gen relies on a model with 30 million parameters, capable of producing clips of up to 16 seconds at a speed of 16 frames per second. According to Meta, these models are advanced in their category, as they can reason about the movement of objects and interactions. Additionally, Movie Gen allows for the creation of personalized videos from static images, using text and video inputs to precisely edit the content.

For audio generation, Movie Gen uses a separate model with 13 million parameters, which can generate up to 45 seconds of sound, including background noises, special effects, and instrumental scores, automatically synchronizing this content with the video. According to a technical document from Meta, Movie Gen has achieved superior results in comparative tests with other advanced artificial intelligences in the video generation category.

The company has succeeded not only in video generation but also in creating personalized videos and audio generation, outpacing other competitors in these areas. While it has been recognized for its capabilities, Meta is committed to working alongside filmmakers and creators, emphasizing that its goal is not to replace humans, but to help people express their creativity in new ways.

Meta expresses hope that, in the future, everyone will be able to bring their artistic visions to reality using Movie Gen to create high-definition videos and audio.