tf.config.set_soft_device_placement | TensorFlow v2.16.1 (original) (raw)
tf.config.set_soft_device_placement
Stay organized with collections Save and categorize content based on your preferences.
Enable or disable soft device placement.
View aliases
Compat aliases for migration
SeeMigration guide for more details.
tf.compat.v1.config.set_soft_device_placement
tf.config.set_soft_device_placement(
enabled
)
Used in the notebooks
| Used in the guide |
|---|
| Use a GPU |
If enabled, ops can be placed on different devices than the device explicitly assigned by the user. This potentially has a large performance cost due to an increase in data communication between devices.
Some cases where soft_device_placement would modify device assignment are:
- no GPU/TPU implementation for the OP
- no GPU devices are known or registered
- need to co-locate with reftype input(s) which are from CPU
- an OP can not be compiled by XLA. Common for TPU which always requires the XLA compiler.
For TPUs, if this option is true, a feature called automatic outside compilation is enabled. Automatic outside compilation will move uncompilable ops within a TPU program to instead run on the host. This can be used when encountering compilation failures due to unsupported ops.
| Args | |
|---|---|
| enabled | A boolean indicating whether to enable soft placement. |
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.
Last updated 2024-04-26 UTC.