inferencing
Americannoun
-
the process and practice of inferring or making inferences.
-
the process through which a deep learning model generates output in response to input.
noun
Example Sentences
Examples are provided to illustrate real-world usage of words in context. Any opinions expressed do not reflect the views of Dictionary.com.
AI computing needs are shifting to the types of central processing chips—or CPUs—that are needed to power inferencing, where AI models produce answers to user queries, rather than model training.
And Chief Executive Officer Jensen Huang later made clear that forecast is a floor, as it doesn’t include some of the company’s latest offerings like the new Groq chip for AI inferencing that was announced at the event.
Nvidia spent much of this year’s conference touting its strength in inferencing, which is when AI models produce responses to queries.
Cost-effective inferencing requires a high mix of CPU chips, which are the main brains of any computing system.
Those competitors, plus a host of startups and the in-house chip design teams of major Nvidia customers like Google, Amazon and Microsoft all see an opportunity in the shift to inferencing.
Definitions and idiom definitions from Dictionary.com Unabridged, based on the Random House Unabridged Dictionary, © Random House, Inc. 2023
Idioms from The American Heritage® Idioms Dictionary copyright © 2002, 2001, 1995 by Houghton Mifflin Harcourt Publishing Company. Published by Houghton Mifflin Harcourt Publishing Company.