tfc.ops.upper_bound  |  TensorFlow v2.16.1 (original) (raw)

tfc.ops.upper_bound

Stay organized with collections Save and categorize content based on your preferences.

Same as tf.minimum, but with helpful gradient for inputs > bound.

View aliases

Main aliases

tfc.upper_bound

tfc.ops.upper_bound(
    inputs,
    bound,
    gradient='identity_if_towards',
    name='upper_bound'
)

This function behaves just like tf.minimum, but the behavior of the gradient with respect to inputs for input values that hit the bound depends ongradient:

If set to 'disconnected', the returned gradient is zero for values that hit the bound. This is identical to the behavior of tf.minimum.

If set to 'identity', the gradient is unconditionally replaced with the identity function (i.e., pretending this function does not exist).

If set to 'identity_if_towards', the gradient is replaced with the identity function, but only if applying gradient descent would push the values ofinputs towards the bound. For gradient values that push away from the bound, the returned gradient is still zero.