Neural networks now do more than generate images from text queries or tweak existing clips. They can also craft videos autonomously, a shift that began with Sora, a neural system still in testing but already stirring a lot of chatter. Examples of her work appear in this article and the broader discussion around AI video creation.
Readers can sign up for a beta to explore the technology, though the odds of selection are slim and the waiting list long.
Entered text: A stylish woman walks down a Tokyo street full of warm glowing neon and animated city signs. She wears a black leather jacket, a long red dress and black boots, and carries a black bag. She is wearing sunglasses and red lipstick. She walks confidently and nonchalantly. The street is damp and reflective, creating a mirror effect from the colorful lights. There are a lot of pedestrians walking around.
Translation: A stylish woman walks through a Tokyo street glowing with neon and lively signs. She wears a black leather jacket, a long red dress and black boots, carrying a black handbag. Sunglasses and red lipstick complete her look. She strides with quiet confidence as reflections bloom on the rain slick pavement and crowds move along the avenue.
Entered text: The camera follows a white vintage SUV with a black roof rack as it drives up a steep dirt road surrounded by pine trees on a steep mountainside.
Translation: The camera tracks a white vintage SUV with a black roof rack as it climbs a rugged dirt road framed by pine trees on a steep mountainside.
Articles about neural networks
Entered text: A cat that wakes its sleeping owner and demands breakfast. The owner tries to ignore the cat, but the cat tries new tactics and eventually the owner removes a secret stash of treats from under the pillow to keep the cat at bay a little longer.
Translation: A cat wakes its sleeping owner and demands to be fed. The person tries to ignore the cat, but the animal tests new moves and finally the owner lifts treats from under the pillow to placate the cat for a while.
Entered text: Photorealistic close-up video of two pirate ships fighting each other while sailing in a cup of coffee.
Translation: A photoreal close-up shows two pirate ships clashing inside a cup of coffee.
Are you tired of hearing the news about neural networks yet
Entered text: A young man in his twenties is sitting on a cloud in the sky reading a book.
Translation: A man in his early twenties sits atop a cloud in the sky, reading a book.
Here you can see a comparison of real Minecraft gameplay and a video created by a neural network. There is of course a difference. But someone who hasn’t played this game for a long time might not notice the catch.
Other examples
A butterfly diving into a pond
It is true that the neural network does not always produce realistic video. In some frames you may notice some unnaturalness.
And sometimes the result looks completely strange.
Are you impressed with Sora’s abilities Or were you lucky enough to test it yourself Share your stories in the comments
Do you plan to experiment with Sora’s neural network once it becomes available to everyone