DiffusionGemma: 4x faster text generation

DiffusionGemma: 4x faster text generation

DiffusionGemma: 4x faster text generation

“Today, we’re introducing DiffusionGemma, an experimental open model that explores text diffusion, an exceptionally fast approach to text generation. Released under an Apache 2.0 license, this 26B Mixture of Experts (MoE) model moves beyond the sequential token-by-token processing of typical autoregressive Large Language Models (LLMs). Instead, it generates entire blocks of text simultaneously, delivering up to 4x faster text generation on GPUs…”

Source: blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/