This video was posted on Youtube by Sirajology. He explains the basics of recurrent neural networks. Then you code your own RNN in 80 lines of python (plus white-space) that predicts the sum of two binary numbers after training.

Code for this video: click here.