架构

GPT Architecture

定义

A family of autoregressive, decoder-only transformer architectures pre-trained to predict the next token. GPT models are the basis for ChatGPT and most commercial LLM APIs. Their autoregressive design makes them excellent text generators but less efficient for classification tasks than encoder models.

相关术语

Transformer

The dominant neural network architecture for language, vision, and multimodal AI, introduced in the 2017 "Attention Is All You Need" paper. Transformers use self-attention to process all tokens in parallel, enabling training on internet-scale data and powering every major LLM in use today.

Large Language Model (LLM)

AI models trained on vast amounts of text data that can understand and generate human-like text. Examples include GPT-4, Claude, and Llama. LLMs power modern chatbots, content generation, and code assistance tools.

Foundation Model

A large AI model trained on broad data at scale that can be adapted to a wide range of downstream tasks through fine-tuning or prompting. GPT-4, Claude, and Gemini are examples; under the EU AI Act, providers of GPAI models face specific transparency obligations.

了解术语只是第一步，将其落地应用才是第二步。

预约一次探索通话，探讨这些 AI 概念如何转化到您所在的具体行业与业务挑战中。