In episode 2 of Learn Deep Learning from Scratch, I introduce you to the concept of “Perceptrons”, the basic building block of neural networks and deep learning algorithms. Then, I show you what it means to use gradient descent to “optimize” or “train” these perceptrons. On the way, I show you what it means to find the derivative of a function and how we use it in gradient descent.
source
