- Sort Score
- Result 10 results
- Languages All
Results 1 - 1 of 1 for TPUReshardVariablesOp (0.19 sec)
-
tensorflow/compiler/mlir/g3doc/_includes/tf_passes.md
state, and TPUReshardVariablesOps compares the current state with a desired state (which can be the compilation result). If they mismatch, TPUReshardVariablesOp reformats the variables to the desired state; if they match, TPUReshardVariablesOp is a no-op. A major use of this pass is weight-update sharding in data parallelism, so we require there is a tf_device.replicate in the loop.
Registered: Sun Jun 16 05:45:23 UTC 2024 - Last Modified: Wed Aug 02 02:26:39 UTC 2023 - 96.4K bytes - Viewed (0)