1.3.7 Generating videos
Sora is a new AI model from OpenAI that can generate text-to-video scenes. It can create realistic and creative scenes based on users’ textual descriptions (prompts). These prompts can determine anything from artistic styles to imaginary imagery or realworld situations. Sora creates short video clips, while maintaining visual quality and following the user’s instructions.
In addition to Sora, some other models can generate videos. One example is Runway’s Gen-2, which has the same abilities as Sora. Pika is another AI-powered video generator that produces videos and 3D animation from prompts. Hotshot is an opensource option for Sora. Finally, there is Stable Video Diffusion from StabilityAI. Sora seems to be more advanced compared to others and can create clips up to a minute long with coherent characters and movements.