What Is Inference?

Inference is what happens when a trained AI model actually processes your input and generates an output — the “running” step, as opposed to training, which is when the model learns from data in the first place. When you send a prompt to ChatGPT or Claude and get a response back, that response is the result of an inference pass.