pretraining
-
a word derived from
training.
Example Sentences
Examples are provided to illustrate real-world usage of words in context. Any opinions expressed do not reflect the views of Dictionary.com.
As the researchers note in the paper, pretraining can speed up inference, "but may also hinder learning new physics."
From Science Daily ● Jun. 11, 2026
Karpathy joined Anthropic’s pretraining team and will lead a new group focused on using Claude to accelerate pretraining research, according to the company.
From The Wall Street Journal ● May 19, 2026
Karpathy will join Anthropic’s pretraining program, focusing on large-scale training runs for its Claude chatbot.
From Barron's ● May 19, 2026
The rampant mistakes and hallucinations that were initially made by LLMs have diminished over time due to pretraining on larger databases and post-training by tens of thousands of humans.
From MarketWatch ● Oct. 24, 2025
“If ‘emergence’ merely unlocks capabilities represented in pretraining data,” said Princeton professor Arvind Narayanan, “the gravy train will run out soon.”
From Slate ● Nov. 14, 2023