For those who still not clear in how backpropagation works, and how we can build Autograd(like in PyTorch), I've built a simple tutorial https://learnml.today/making-backpropagation-autograd-mnist-classifier-from-scratch-in-Python-5