What Is Generative AI?

6 min read

Generative AI creates brand-new images, video, and music instead of just labeling what already exists. Here is what it is — and how it learned to create.

Ten years ago, if you wanted a picture of "an astronaut riding a horse on Mars," you needed a Photoshop wizard and a free weekend. Today you type that sentence, wait about ten seconds, and a model like Imagen 3 paints it from scratch. Video? Sora 2 and Veo 3.1 turn plain text into moving scenes with synchronized sound. A full song? Suno writes, performs, and mixes it. Welcome to generative AI — the technology that does not just *understand* content, it *creates* it.

From recognizing to creating

Classic AI is a sorting machine: your spam filter decides *spam or not spam*, face unlock decides *you or not you*. It puts labels on things that already exist. Generative AI flips the direction — instead of labeling existing content, it produces brand-new content: pixels, words, sound waves that never existed before. Under the hood, both are neural networks — layers of simple math units, loosely inspired by brain neurons, that learn patterns from examples through machine learning. The difference is what they are trained to *do* with those patterns.

One idea, four kinds of magic

So how does a model "know" what an astronaut looks like? During training it studied an enormous amount of training data — billions of examples — and learned statistical patterns: which edges, textures, words, and sounds tend to go together. Crucially, it does not store or search a library of files. When you write a prompt, it generates fresh output from those learned patterns — which is why the same prompt produces a different image every time you run it.

QuestionClassic AIGenerative AI
What is its job?Label what already existsCreate something new
Input → outputPhoto → "this is a cat""a cat" → a brand-new photo
Everyday exampleSpam filter, face unlockImagen 3, Sora 2, Suno

Your first prompt — try it right now

A tiny silver robot carefully watering a sunflower on a sunny balcony, golden hour light, shallow depth of field, photorealistic

Model: nano-banana

Notice the recipe: subject (tiny robot), action (watering a sunflower), setting (sunny balcony), light (golden hour), style (photorealistic). You will master this structure in Anatomy of a Great Prompt.

Next up we crack open the engine: How Image Models Work shows how a picture emerges from pure noise, and How LLMs Work reveals the prediction trick behind chat-style models.

Related glossary terms: Generative AI, Machine Learning, Neural Network, Training Data, Prompt

The fastest way to understand generative AI is to generate something. Create your first image