How AI Inference Sends Decision Making To The Edge

The next phase of AI infrastructure will not be defined by a single destination called “the cloud” or “the edge.” ...
Center for Strategic and International Studies

What to Know About Chinese AI Models

Chinese AI models are rapidly closing the gap with U.S. frontier systems. This analysis examines what their growing ...
VentureBeat

How Snowflake's open-source text-to-SQL and Arctic inference models solve enterprise AI's two biggest deployment headaches

Snowflake has thousands of enterprise customers who use the company's data and AI technologies. Though many issues with generative AI are solved, there is still lots of room for improvement. Two such ...
Datacenter Dynamics

The inference lattice: One option for how the AI factory model will evolve

The centralized mega-cluster narrative is seductive – but physics, community resistance, and enterprise pragmatism are conspiring to scatter AI compute across a distributed lattice of specialized ...

OpenAI unveils first custom AI inference chip, Jalapeño, with Broadcom — and its development was sped-up with OpenAI's own models

The companies attributed this speed to a deep software-hardware co-development process that actively used OpenAI’s own models ...
SiliconANGLE

Report: Nvidia is working on a top-secret AI inference chip that could debut next month

Nvidia Corp. is reportedly working on a dedicated inference processor that will be used by OpenAI Group PBC and other artificial intelligence companies to develop faster and more efficient models, ...