How It Actually Generates

When you send a message to ChatGPT, it isn't looking up a stored answer.

It's predicting, one token at a time, what should come next, based on patterns it absorbed during training.

A token is roughly a word fragment. The model picks the most useful next one. Then the next. Then the next. Until a complete response takes shape.