AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say
Modal Labs, a startup specializing in AI inference infrastructure, is in the process of raising a new round at a…
Tag: Inference
Microsoft announces powerful new chip for AI inference
Microsoft has announced the launch of its latest chip, the Maia 200, which the company describes as a silicon workhorse…
Inference startup Inferact lands $150M to commercialize vLLM
The creators of the open source project vLLM have announced that they transitioned the popular tool into a VC-backed startup,…
Quadric rides the shift from cloud AI to on-device inference — and it’s paying off
Companies and governments are looking for tools to run AI locally in a a bid slash cloud infrastructure costs and…
Sources: project SGLang spins out as RadixArk with $400M valuation as inference market explodes
Some of the team responsible for maintaining SGLang, a popular open-source tool used by companies like xAI and Cursor to…
Telegram makes TON a hub for decentralized AI inference
Telegram will become the first major client for its own Cocoon network. This move pledges the platform’s immense user base…
Tensormesh raises $4.5M to squeeze more inference out of AI server loads
With the AI infrastructure push reaching staggering proportions, there’s more pressure than ever to squeeze as much inference as possible…
IBM, Groq Partner to Offer High-Speed Inference
IBM and Groq have a new strategic partnership to give clients ultra-high-speed, low latency AI capabilities via Groq’s inference technology.…
Nvidia unveils new GPU designed for long-context inference
At the AI Infrastructure Summit on Tuesday, Nvidia announced a new GPU called the Rubin CPX, designed for context windows…
Future of Decentralized Intelligence The Lightchain AI Virtual Machine (AIVM) Inference
This content is provided by a sponsor. Imagine a world where artificial intelligence is not confined to large, centralized corporations…