A GPT-style system is trained to predict the next piece of text. The text is broken into tokens, which may be words, parts of words, punctuation, or other small units. During train