Google releases Multi-Token Prediction drafters for its Gemma 4 models, which use a form of speculative decoding to guess future tokens for faster inference (Ryan Whitwam/Ars Technica)

1 hour ago 1
Add to circle

Ryan Whitwam / Ars Technica:
Google releases Multi-Token Prediction drafters for its Gemma 4 models, which use a form of speculative decoding to guess future tokens for faster inference  —  Google launched its Gemma 4 open models this spring, promising a new level of power and performance for local AI.

Read Entire Article