inferencing
Americannoun
-
the process and practice of inferring or making inferences.
-
the process through which a deep learning model generates output in response to input.
noun
"Collins English Dictionary — Complete & Unabridged" 2012 Digital Edition © William Collins Sons & Co. Ltd. 1979, 1986 © HarperCollins Publishers 1998, 2000, 2003, 2005, 2006, 2007, 2009, 2012Example Sentences
Examples are provided to illustrate real-world usage of words in context. Any opinions expressed do not reflect the views of Dictionary.com.
The chips are built for demanding AI workloads, including high-volume AI inferencing, according to Google.
From MarketWatch
Inferencing refers to the process of running AI models.
From MarketWatch
Training is a sunk cost, Singh noted, because although it is important to train models to improve them, inferencing is related to the monetization of the AI models.
From MarketWatch
Su is also hoping to capitalize on an inflection point in AI—many executives in the chips industry, including Nvidia chief Jensen Huang, expect demand to shift from clusters designed to assist in training large language models to what’s known as inferencing, or the billions of computations required to run those models and allow them to respond to user queries.
Inferencing doesn’t require chips with as much computing muscle as training does.
Definitions and idiom definitions from Dictionary.com Unabridged, based on the Random House Unabridged Dictionary, © Random House, Inc. 2023
Idioms from The American Heritage® Idioms Dictionary copyright © 2002, 2001, 1995 by Houghton Mifflin Harcourt Publishing Company. Published by Houghton Mifflin Harcourt Publishing Company.