Inception launches Mercury 3, a diffusion-based LLM it claims is "comparable to Luna and Haiku models" but 4x to 8x faster, generating ~1,000 tokens per second (Jason Hiner/The Deep View)

1 hour ago 1
Add to circle

Jason Hiner / The Deep View:
Inception launches Mercury 3, a diffusion-based LLM it claims is “comparable to Luna and Haiku models” but 4x to 8x faster, generating ~1,000 tokens per second  —  W  —  hile the AI industry has bet heavily on LLMs and the massive data centers needed to scale them …

Read Entire Article