tf.raw_ops.CollectiveAllToAllV2 | TensorFlow v2.16.1 (original) (raw)

tf.raw_ops.CollectiveAllToAllV2

Stay organized with collections Save and categorize content based on your preferences.

Mutually exchanges multiple tensors of identical type and shape.

View aliases

Compat aliases for migration

tf.compat.v1.raw_ops.CollectiveAllToAllV2

tf.raw_ops.CollectiveAllToAllV2(
    input,
    group_size,
    group_key,
    instance_key,
    ordering_token,
    communication_hint='auto',
    timeout_seconds=0,
    is_stateless=False,
    name=None
)

is_stateless means each op does not need control dependencies to other collective ops. In this case, keys that are unique at runtime (e.g. instance_key) should be used to distinguish collective groups.

Args
input	A Tensor. Must be one of the following types: bfloat16, float32, half, float64, int32, int64.
group_size	A Tensor of type int32.
group_key	A Tensor of type int32.
instance_key	A Tensor of type int32.
ordering_token	A list of Tensor objects with type resource.
communication_hint	An optional string. Defaults to "auto".
timeout_seconds	An optional float. Defaults to 0.
is_stateless	An optional bool. Defaults to False.
name	A name for the operation (optional).

Returns
A Tensor. Has the same type as input.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.

Last updated 2024-04-26 UTC.