In a move that further solidifies its dominance in the artificial intelligence (AI) sector, Nvidia has secured a non-exclusive licensing agreement with AI chip startup Groq, bringing aboard its founder, CEO Jonathan Ross, and key executives to bolster its inference technology capabilities.
The deal, announced by Groq on Wednesday, Dec. 24, allows Nvidia to license Groq's proprietary AI inference technology while hiring Ross, President Sunny Madra, and other senior engineers. Groq will continue operating independently under new CEO Simon Edwards, with its cloud platform, GroqCloud, remaining unaffected.
Groq, founded in 2016 by former Google engineers, specializes in AI inference—the process of running trained AI models to generate predictions or responses, such as those seen in ChatGPT or image recognition systems. The company developed its custom Language Processing Unit (LPU), designed for high-speed, low-cost AI inference.
"AI inference, in the context of artificial intelligence, refers to the process by which AI models draw conclusions or make predictions based on input data. This process is a fundamental aspect of AI, enabling machines to learn, reason and make decisions," said BrightU.AI's Enoch.
AI inference can be categorized into two primary types: inductive and deductive inference. A third one, probabilistic inference, involves making decisions or drawing conclusions based on probabilities and statistical models. This type of inference is commonly used in Bayesian AI networks and Deep Learning models.
Nvidia, already the leader in AI training chips, is now doubling down on inference—a critical next phase as AI shifts from development to real-world deployment. Jensen Huang, Nvidia's CEO, emphasized the strategic importance of the deal in an internal email obtained by CNBC: "We plan to integrate Groq's low-latency processors into the NVIDIA AI factory architecture, extending the platform to serve an even broader range of AI inference and real-time workloads."
The agreement follows a growing Silicon Valley trend where tech giants acquire key talent rather than entire companies—a strategy that avoids regulatory hurdles while securing top-tier expertise. Recent examples include:
Alex Davis, CEO of Disruptive (a major Groq investor), confirmed to CNBC that Nvidia is acquiring Groq's assets—not the entire company—for an estimated $20 billion, marking Nvidia's largest deal ever.
The deal aligns with President Donald Trump's July executive order promoting the export of U.S. AI technology to maintain global dominance. Groq has been a key player in this initiative, powering AI infrastructure for Fortune 500 companies and over 2 million developers worldwide.
"Inference is defining this era of AI, and we're building the American infrastructure that delivers it with high speed and low cost," Ross stated in September.
While Nvidia strengthens its AI ecosystem, Groq will continue innovating under new leadership. The startup had previously raised $750 million in September at a $6.9 billion valuation, with investors including BlackRock, Samsung and Donald Trump Jr.'s 1789 Capital.
As AI transitions from lab development to global deployment, Nvidia's latest move ensures it remains at the forefront—both in training and inference. With competitors like Cerebras Systems and Google's TPUs vying for market share, the AI chip wars are far from over.
For now, Nvidia's strategic talent grab reinforces its position as the undisputed leader in the AI revolution.
Watch the video below about President Donald Trump praising Nvidia CEO Jensen Huang for U.S. AI chip push.
This video is from the NewsClips channel on Brighteon.com.
Sources include: