Example Sentences

Examples are provided to illustrate real-world usage of words in context. Any opinions expressed do not reflect the views of Dictionary.com.

In a research paper updated in September, DeepSeek said that during a late stage of pretraining its flagship V3 model, it exclusively used plain webpages and ebooks, without incorporating any synthetic data.

From The Wall Street Journal • Feb. 23, 2026

The rampant mistakes and hallucinations that were initially made by LLMs have diminished over time due to pretraining on larger databases and post-training by tens of thousands of humans.

From MarketWatch • Oct. 24, 2025

“If ‘emergence’ merely unlocks capabilities represented in pretraining data,” said Princeton professor Arvind Narayanan, “the gravy train will run out soon.”

From Slate • Nov. 14, 2023

Zhang said Alibaba will "continue to build its own large-scale pretraining model" for AI and also provide the computing power for such models via its cloud computing division.

From Reuters • Feb. 23, 2023

It’s having a new operator come in without any pretraining and be able to make it do what it does.

From New York Times • May 8, 2011