How Does Generative AI Work?

The model receives a text prompt (e.g., “Write a summary of this article”).

The text is broken down into smaller units called tokens. These tokens could be words, parts of words, or even characters.
(about ¾ of a word)

The model analyzes the context of the tokens by looking at the relationships between them. This helps the LLM understand the meaning of the input and anticipate what should come next.

Based on the input and context, the model predicts the next word or phrase. It does this by selecting from a range of possible outputs, weighted by probabilities.

The LLM then generates a coherent response or continuation based on the input prompt.