Advertisement
Advertisement
inferencing
/ ˈɪnfərənsɪŋ /
noun
psycholinguistics the practice of inferring the meaning of an unfamiliar word or expression from the meaning of familiar words occurring with it in a context together with one's knowledge of or beliefs about the world
Example Sentences
That’s because of OpenAI’s robust inferencing needs, which refers to the process of running AI models after training.
“I don’t think most people fully appreciate how complex these inferencing workloads are, when you’re deploying them at data center scale,” he said in an interview Thursday.
Looking two to three years out, however, Gold said that needs in the AI market will change as the industry shifts more toward AI inferencing, or the process of running AI models after training.
“That’s a whole different space, and Nvidia is not as strong in that space,” Gold said, adding that there are some promising startups focused on inferencing chips, too.
Intel also launched a new chip called Greco for inferencing work: taking an AI algorithm and making a prediction or identifying an object.
Advertisement
Advertisement
Advertisement
Advertisement
Browse