pretraining
-
a word derived from
training.
Example Sentences
Examples are provided to illustrate real-world usage of words in context. Any opinions expressed do not reflect the views of Dictionary.com.
He specialized in pretraining, the initial steps of feeding massive amounts of text, images and code to the models before they can be fine-tuned for specific tasks.
From The Wall Street Journal ● Sep. 17, 2026
Jacob Coxon, 27, spent the past three years pretraining AI models, first at OpenAI and then, this year, at its rival Anthropic, which he considered more cautious in its approach.
From Barron's ● Sep. 9, 2026
This initial phase, known as pretraining, was then followed by additional training using more sophisticated models that include potential new physics.
From Science Daily ● Jun. 11, 2026
Karpathy joined Anthropic’s pretraining team, which oversees the data training process for the company’s Claude artificial-intelligence models.
From The Wall Street Journal ● May 19, 2026
Karpathy has joined Nick Joseph’s pretraining team, responsible for the large-scale training runs that gives the Claude large language model its core knowledge and capabilities, according to Anthropic.
From MarketWatch ● May 19, 2026