But Sora can also be prompted with other inputs, such as pre-existing images or video. This capability enables Sora to perform a wide range of image and video editing taskscreating perfectly looping video, animating static images, extending videos forwards or backwards in time, etc. Animating DALLE images Sora is capable of generating videos provided an image and prompt as input. Below we show example videos generated based on DALLE 231 and DALLE 330 images. A Shiba Inu dog wearing a beret and black turtleneck. Monster Illustration in at design style of a diverse family of monsters. The group includes a furry brown monster, a sleek black monster with antennas, a spotted green monster, and a tiny polka-dotted monster, all interacting in a playful environment. An image of a realistic cloud that spells SORA.

In an ornate, historical hall, a massive tidal wave peaks and begins to crash. Two surfers, seizing the moment, skillfully navigate the face of the wave. Extending generated videos Sora is also capable of extending videos, either forward or backward in time. Below are four videos that were all extended backward in time starting from a segment of a generated video. As a result, each of the four videos starts different from the others, yet all four videos lead to the same ending. 00:00 00:20 We can use this method to extend a video both forward and backward to produce a seamless innite loop. Video-to-video editing Diffusion models have enabled a plethora of methods for editing images and videos from text prompts. Below we apply one of these methods, SDEdit,32 to Sora. This technique enables Sora to transform the styles and environments of input videos zero-shot. Input video

make sure to keep the red colormake it go underwaterchange the video setting to be different than a mountain? perhaps joshua tree? put the video in space with a rainbow roadkeep the video the same but make it be wintermake it in claymation animation stylerecreate in the style of a charcoal drawing, making sure to be black and whitechange the setting to be cyberpunkchange the video to a medieval thememake it have dinosaursrewrite the video in a pixel art style Connecting videos We can also use Sora to gradually interpolate between two input videos, creating seamless transitions between videos with entirely different subjects and scene compositions. In the examples below, the videos in the center interpolate between the corresponding videos on the left and right.

Image generation capabilities Sora is also capable of generating images. We do this by arranging patches of Gaussian noise in a spatial grid with a temporal extent of one frame. The model can generate images of variable sizesup to 2048x2048 resolution. Close-up portrait shot of a woman in autumn, extreme detail, shallow depth of eld Vibrant coral reef teeming with colorful sh and sea creatures Digital art of a young tiger under an apple tree in a matte painting style with gorgeous details A snowy mountain village with cozy cabins and a northern lights display, high detail and photorealistic dslr, 50mm f/1.2 Emerging simulation capabilities