Concept / Term · Established

Inference

Running a trained model

What does Inference mean?

Using a trained machine-learning model to make a prediction or, for an LLM, generate a response to new input.

Keep exploring

AI / MLAI is software that performs tasks normally needing human intelligence; ML is the main technique, where systems learn patterns from data.
LLMThe kind of AI, trained on huge amounts of text, that powers chatbots and coding assistants such as ChatGPT and Claude.
PromptThe text you send to an AI model. 'Prompt engineering' is the craft of wording and structuring that instruction to get reliable results.
TokenThe small chunks of text an AI model reads and writes, roughly three-quarters of a word each. Usage and API pricing are counted in tokens.
Context WindowThe maximum amount of text a model can consider at once, covering your input and its reply. Exceed it and the earliest material drops out.
HallucinationWhen an AI model produces something plausible-sounding but factually incorrect. The main reason AI output needs checking before it is relied on.
RAGA technique that feeds an AI model your own up-to-date documents at the moment of a question, so its answers stay accurate and grounded.
Fine-tuningFurther training an existing AI model on your own data so it better suits a specific task, tone or domain.