Techniken

Context Window

Definition

The maximum amount of text (measured in tokens) an LLM can process in a single request, encompassing both the prompt and the generated output. Larger context windows—now exceeding 1 million tokens in some models—enable processing of long documents, codebases, and meeting transcripts in one pass.

Verwandte Begriffe

Tokenization

The process of splitting raw text into smaller units called tokens—typically sub-words or word-pieces—that serve as the basic input unit for language models. Token count determines both model context limits and API pricing, making tokenization an important operational consideration.

Large Language Model (LLM)

AI models trained on vast amounts of text data that can understand and generate human-like text. Examples include GPT-4, Claude, and Llama. LLMs power modern chatbots, content generation, and code assistance tools.

Retrieval-Augmented Generation (RAG)

A technique that enhances LLM responses by retrieving relevant information from external knowledge sources before generating a response. RAG improves accuracy, reduces hallucinations, and enables LLMs to access up-to-date information without retraining.

Hilfe beim Verständnis von KI Benötigt?

Buchen Sie eine Beratung, um zu besprechen, wie KI-Konzepte auf Ihre Herausforderungen anwendbar sind.