tf.keras.activations.relu  |  TensorFlow v2.16.1 (original) (raw)

tf.keras.activations.relu

Stay organized with collections Save and categorize content based on your preferences.

Applies the rectified linear unit activation function.

tf.keras.activations.relu(
    x, negative_slope=0.0, max_value=None, threshold=0.0
)

With default values, this returns the standard ReLU activation:max(x, 0), the element-wise maximum of 0 and the input tensor.

Modifying default parameters allows you to use non-zero thresholds, change the max value of the activation, and to use a non-zero multiple of the input for values below the threshold.

Examples:

x = [-10, -5, 0.0, 5, 10] keras.activations.relu(x) [ 0., 0., 0., 5., 10.] keras.activations.relu(x, negative_slope=0.5) [-5. , -2.5, 0. , 5. , 10. ] keras.activations.relu(x, max_value=5.) [0., 0., 0., 5., 5.] keras.activations.relu(x, threshold=5.) [-0., -0., 0., 0., 10.]