An autoregressive language model is a language model that iteratively generates words based on prior words (either given or generated). GPT (the language model behind ChatGPT), is an example of an autoregressive language model.