Interactive

Neural Kaleidoscope

Transformer attention Realtime canvas Keyboard shortcuts

I understand neural networks best when I can see them move, so I built this to help people visualize the core ideas behind transformer attention. Tokens light up and connect across layers; hover to focus columns or tune tokens, layers, speed, and density.

Based on the paper “Attention Is All You Need” →