Nature

Speed up integer-arithmetic-only inference via bit-shifting

Quantization is a widely adopted technique in model deployment as it offers a favorable trade-off between computational overhead and performance loss. Integer-arithmetic-only quantization is an ...

Nota AI Has Two MoE Quantization Papers Accepted at ICML 2026 Workshop, Demonstrating Global Competitiveness in Large-Scale AI Optimization

Nota AI, a company specializing in AI model compression and optimization, announced that two of its papers on MoE-specific ...

Cohere cracks lossless quantization and native citations with first full Apache 2.0 licensed open model Command A+

Using special tags embedded in the output, the model directly links every factual claim it makes to the specific source document or database row it pulled the information from.
Semiconductor Engineering

Neural Network Model Quantization On Mobile

The general definition of quantization states that it is the process of mapping continuous infinite values to a smaller set of discrete finite values. In this blog, we will talk about quantization in ...
Nature

Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors

With edge computing, real-time inference of deep neural networks (DNNs) on custom hardware has become increasingly relevant. Smartphone companies are incorporating artificial intelligence (AI) chips ...

The latest Gemma 4 models use a training trick to slash their on-device memory footprint

You can now download Gemma 4 models with quantization-aware training to reduce the amount of mobile memory required to 1GB.