True dat on RNNs and long dependencies. Was playing around with a simple RNN for text generation, and the results were laughable. Then switched to LSTM, and it was like night and day!