GateGPT: 56k tokens per second Transformer (KV cache) on FPGA at 80 MHz

3 weeks ago 8
Add to circle

Article URL: https://twitter.com/fguzmanai/status/2065832668172845209

Comments URL: https://news.ycombinator.com/item?id=48557535

Points: 9

# Comments: 1

Read Entire Article