In the previous post(100_DNN Example using PyTorch), I explored solving the MNIST classification problem with a DNN that added three hidden layers to an ANN. During the training, while the Training loss decreased normally, the Validation loss decreased to a certain level and then began to increase. This was mentioned as a likely occurrence of overfitting. In this post, I will discuss what overfi..
