Browsing index pages (2 articles)
↧
What do you mean by "updating based on a training example/batch" in Gradient...
My understanding is this: When doing Stochastic Gradient Descent over a neural network, in every epoch, we run $n$ iterations (where the dataset has $n$ training examples) and in every iteration, we...
View ArticleAnswer by cinch for What do you mean by "updating based on a training...
In batch gradient descent computing the loss function every time serves several purposes. While the value of the loss itself may not directly affect the backpropagation process, as you said monitoring...
View Article
Browsing index pages (2 articles)
