Interactive local editing
Promising test case
Parallel, bidirectional refinement can help inline editing, code infilling, structured blocks, and other tasks where future tokens matter.
Quick answer
Google's experimental 26B-total MoE refines 256-token blocks instead of decoding every token in sequence. Test it for interactive local workflows; keep standard Gemma 4 as the quality baseline.
Experimental open-weights model. Google recommends standard Gemma 4 when maximum output quality matters.
26B-total sparse Mixture of Experts built on Gemma 4 and Gemini Diffusion; Google describes 3.8B active parameters and rounds that to 4B in developer documentation.
Discrete text diffusion that iteratively refines 256-token blocks instead of decoding every output token strictly left to right.
Accepts text, image, and video inputs and produces text. Google's developer overview says audio input is not supported.
Apache 2.0 open weights distributed through Google's Hugging Face and Kaggle collections, with Model Garden access also listed.
Not asserted here. Open weights and Google deployment surfaces do not establish availability in the live Flowith workspace.
Workload map
Interactive local editing
Parallel, bidirectional refinement can help inline editing, code infilling, structured blocks, and other tasks where future tokens matter.
Low-concurrency dedicated GPU
Google says the throughput advantage is strongest at low-to-medium batch sizes on one accelerator, not as a universal cloud-serving advantage.
Maximum production quality
Google explicitly says DiffusionGemma's overall output quality is lower than standard Gemma 4 because it prioritizes speed and parallel layout generation.
High-QPS cloud serving
Autoregressive models can saturate cloud compute through batching; Google says diffusion's advantage can diminish and serving cost can rise.
Google reports more than 1,000 tokens per second on one NVIDIA H100 and more than 700 on an RTX 5090 in its test configuration, with up to 4x faster output. Those measurements depend on dedicated hardware, quantization, implementation, sampling settings, prompt shape, and output length.
Record time to first usable block, completed-task latency, output quality, correction loops, memory use, power, and accepted-result cost. Raw tokens per second alone cannot choose a production model.