 What concepts should you understand to learn about chat GPT? So chat GPT is based on the concepts of generative pre-trained transformers as well as Reinforcement learning now GPT models themselves are language models as they have some understanding and semblance of language at least mathematically and they are also a stack of transformer neural network decoders sexually. Chat GPT uses reinforcement learning to ensure that the responses that it produces are non-toxic and factual