AI glossary · Beginner · Language models
Foundation model
A foundation model is a large AI model trained broadly in advance on a huge amount of data, so that with a little extra training or some instructions it can be used for many different tasks. Unlike a model that does only one job, it serves as the 'foundation' for many services.
About this term
- Level
- Beginner · Core ideas for first-time readers
- Category
- Basics
- Fields
- Language models
- Added
- 2026-10-08
How it works
First, the model is pre-trained on a very large and varied body of data such as web text, books, code, images and video. In this process, the model learns general patterns of language or images rather than memorizing answers to specific tasks. Then, depending on the use, it is taught a bit more through fine-tuning, or simply told what to do through a prompt, and used in services such as chatbots, coding assistants and image captioning. LLMs are the best-known example, and there are also foundation models for images, video, audio and robot motion.
Why it matters
In the past, a separate model had to be built and separate data collected for each task, such as translation, summarization or classification. A foundation model, once trained at scale, can be reused for many tasks, which greatly cuts the cost and time of building new services. That is why many companies build their services on top of existing foundation models rather than building huge models themselves. Conversely, the ability to build such models in-house is seen as a source of national and corporate competitiveness, which ties into discussions of sovereign AI.
Good to know
Training requires enormous amounts of data and compute such as GPUs, so few organizations can build one. Bias or misinformation in the training data can spread to every service built on top of it. It does many tasks 'reasonably' well, but in a specific field it may perform worse than a specialist model built only for that field. Problems such as hallucination, where the model gives plausible but wrong answers, also remain in foundation models.
Example
A good example from this site's news is 'Habilis Brain 0', a robot foundation model released by Tomorrow Robotics. Just as language models serve as a foundation for writing in general, a robot foundation model is an attempt to learn a wide range of robot motions in advance and apply them to many tasks. The term foundation model is also used outside text, in video, as with 'Kandinsky 6.0 Video', which generates video and audio together.
Where it came up on this site
- briefing SKT and Upstage launch 'Independent AI Cybersecurity Council' with 6 security firms and 3 universities…security data to be used to train A.X K3 and next Solar model 2026-10-08
- briefing Tomorrow Robotics releases robot foundation model 'Habilis Brain 0' (report) 2026-10-07
- briefing Google Labs releases 'Playground', an experimental platform for creating and playing browser games from text prompts 2026-10-07
- Papers Kandinsky 6.0 Video: a foundation model that generates synchronized video and audio 2026-10-07