Which regularization technique prevents overfitting by randomly setting a fraction of input neurons to zero during each training step?
Show answer
Dropout
Dropout forces a neural network to learn redundant representations and reduces the reliance on specific neurons. It effectively acts as a way of training an ensemble of an exponential number of smaller networks.
Also asked as:
- Which method of regularization involves zeroing out a random subset of neurons during training to improve generalization?