microGPT

Independent hardware engineer Fabio Guzman introduced GateGPT, an open-source RTL implementation of microGPT synthesized onto a 16-year-old Xilinx Virtex-5 FPGA. Running at 80 MHz, GateGPT generates u…

A developer implemented a full Transformer with KV cache on an FPGA, achieving over 56,000 tokens per second at only 80 MHz, without using a GPU or CPU. The design was created gate by gate as a custom…