The Bit Explainers · Foundations · Part 3

How computers learned to create

Not copy-paste. Not a collage of stolen pieces. Something closer to a sculptor starting with a block of noise.

Good Omens Studio3 min readAI Systems

We’ve covered AI that guesses the next word. Now for the version that raised more eyebrows: AI that paints, composes, and writes fiction from a two-line prompt. It feels like the biggest leap of all — but the idea underneath is more grounded than the results make it look.

Generative = it makes something new

Everything before now was AI that reads — sorting, predicting, classifying. Generative AI flips the job around: instead of judging existing things, it produces brand new ones. A sentence that didn’t exist a second ago. An image no camera ever took. A melody nobody hummed first.

It’s not stitching together clips of real photos, either — that’s a common misconception. It’s more like it studied millions of examples of “what a cat generally looks like” and then draws a completely new one, freehand, based on everything it absorbed.

Sculpting a picture out of pure static

Most image generators work through a process called diffusion — and the analogy that makes it click is a sculptor starting with a rough block of marble. Except here, the “marble” is a canvas of complete random noise, like static on an old TV.

step 1 step 2 step 3 done!

Guided by your prompt, the model nudges that static, step by step, very slightly closer to “a picture that matches these words” each time — clearing away a bit more noise with every pass. Repeat that a few dozen times, and a coherent image gradually emerges from what started as pure static.

it's not just pictures

Same idea, different canvas

Text generation

Same next-word guessing from the last article — just aimed at longer, more creative writing.

A poem, a story, a whole screenplay draft.

Music & audio

Sound gets treated a lot like an image — a pattern to be shaped from noise into something coherent.

A backing track, a voice clone, a jingle.

the honest caveats

Where it still trips up

Ask for text on a signpost or a hand with the right number of fingers and things can get weird fast — small, precise details are exactly where “learned the general vibe of things” breaks down. And because these models learned from human-made work, the fair-use and attribution questions around that training data are genuinely unresolved — worth knowing about, not just a footnote.

where you've met it already

  • Image generators — Midjourney, DALL·E, Stable Diffusion
  • Writing assistants — Drafting emails, stories, ad copy from a prompt
  • AI music — Suno, background scores, voice cloning
  • Video generation — Short clips generated straight from a text prompt