I recently saw Karpathy's video on backpropagation, and at some point around the 40-minute mark he shows how to visualize backpropagation flowing through the computational graph of a single neuron, which I felt really made me understand automatic backpropagation intuitively for the first time. But I felt that I had to mess around with it for it to really sink in. So me and a friend quickly made an interactive, online version of the visualization, please tell me what you think!
https://amitalevy.com/justaneuron/
โ
โ