Inference

Inference is the process of using a trained AI model to make predictions or outputs like: a chatbot generating a response, or a model labeling an image. It is the opposite of training, which is when the model is learning. Inference still needs GPUs because they can process data in parallel, making responses much faster.