End-to-End Training of LLMs Using Single-Spike SNNs

A new reference-based strategy enables the implementation of embedding, LayerNorm, attention, and dropout within a fully Time-to-First-Spike (TTFS) spiking neural network. The architecture achieves performance on BERT and GPT-2 comparable to standard artificial neural networks while leveraging sparse, energy-efficient computation.