OpenAI's latest model turns text prompts into “complex, realistic scenes with multiple characters, specific types of movement, and precise object and background details”—up to a minute long.
The company also notes that Sora can understand how objects “exist in the physical world,” as well as “accurately interpret props and generate compelling characters that express powerful emotions.” The model can also generate video from a still image and fill missing frames in an existing video or expand it.
Sora-generated demo videos published on X include, in particular, a camera flying along a snowy Tokyo street – although, if you look closely, you can find signs of artificial intelligence (for example, tree crowns disconnected from trunks).
Introducing Sora, our text-to-video model.
Sora can create videos of up to 60 seconds featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions. https://t.co/7j2JN27M3W
Prompt: “Beautiful, snowy… pic.twitter.com/ruTEWn87vf
— OpenAI (@OpenAI) February 15, 2024
A few years ago, it was text-to-image generators like Midjourney that brought a lot of attention to the AI industry, but now companies like Runway and Pika have stepped up to improve the technology for video. Google's Lumiere can now be considered OpenAI's main competitor in this area (although the length of the video for this model is limited to 5 seconds).
QA Manual Course. successful career in the IT field without the need for in-depth programming knowledge. Receive a salary of $600 upon completion of your job. Find out about the course
Prompt: “A stylish woman walks down a Tokyo street filled with warm glowing neon and animated city signage. she wears a black leather jacket, a long red dress, and black boots, and carries a black purse. she wears sunglasses and red lipstick. she walks confidently and casually.… pic.twitter.com/cjIdgYFaWq
— OpenAI (@OpenAI) February 15, 2024
Sora is currently only available to “red teams” who evaluate the model for potential harm and risks. OpenAI also offers access to select artists, designers and filmmakers to receive feedback.
Earlier this month, OpenAI announced that it was adding watermarks to its text-to-image tool DALL-E 3, but noted that they can be “easily removed.”
Join the ITS Authors Contest! Win cool prizes from our partners Logitech – professional gaming steering wheel and low-profile gaming keyboards.