Iterations
Iterations are the number of steps through batches of the training data needed to complete one epoch.
- The total training set of images = 5000
- Batch Size = 64
From the above values, 64 samples will be taken each time through the neural network forward and backward. This constitutes one iteration.
Therefore, if you are loading 64 images at a time (in one batch), to go through all 5000 images, you will need 5000 / 64 = about 78 iterations.