Which activation function is defined by the formula f(x) = max(0, x)?

Show answer

ReLU

The Rectified Linear Unit (ReLU) is the most widely used activation function in deep learning. It helps mitigate the vanishing gradient problem and allows for faster training of deep neural networks.

Also asked as:

What activation function returns the input directly if it is positive, and zero otherwise?

Would you remember this in 6 months?

Trivia Forge uses spaced repetition so facts stick. Free, no signup needed.

Turn on Machine Learning practice →

More Machine Learning trivia

Which activation function is most commonly used in the final layer of a multi-class classification neural network to produce a probability distribution?
Which adversarial architecture consists of two networks, a Generator and a Discriminator, competing in a zero-sum game?
Which 1996 clustering algorithm is density-based and can identify outliers as 'noise' points?
Which clustering algorithm iteratively assigns points to the nearest cluster center and then updates the center based on the mean of assigned points?
Which dimensionality reduction technique minimizes the Kullback-Leibler divergence between similarity distributions in high and low-dimensional spaces?
Which ensemble method builds multiple decision trees independently using a random subset of features and merges their results by voting or averaging?

See all 98 →