- Sort Score
- Result 10 results
- Languages All
Results 1 - 3 of 3 for TPUReshardVariablesOp (0.64 sec)
-
tensorflow/compiler/mlir/tensorflow/transforms/host_runtime/runtime_passes.td
state, and TPUReshardVariablesOps compares the current state with a desired state (which can be the compilation result). If they mismatch, TPUReshardVariablesOp reformats the variables to the desired state; if they match, TPUReshardVariablesOp is a no-op. A major use of this pass is weight-update sharding in data parallelism, so we require there is a tf_device.replicate in the loop.
Registered: Sun Jun 16 05:45:23 UTC 2024 - Last Modified: Wed Jan 10 18:58:57 UTC 2024 - 10.7K bytes - Viewed (0) -
tensorflow/compiler/mlir/tensorflow/transforms/host_runtime/tpu_variable_runtime_reformatting.cc
reformat_operands.push_back(replicate.GetBody().getArgument( replicate.GetNumReplicatedBlockArguments() - 1)); builder.setInsertionPoint(execute_launch); auto reformat_op = builder.create<TF::TPUReshardVariablesOp>( execute_launch.getLoc(), llvm::ArrayRef<Type>{}, reformat_operands); WrapOpInLaunch(&builder, execute_launch.getLoc(), reformat_op, execute_launch.getDevice());
Registered: Sun Jun 16 05:45:23 UTC 2024 - Last Modified: Thu Apr 25 16:01:03 UTC 2024 - 21.9K bytes - Viewed (0) -
tensorflow/compiler/mlir/g3doc/_includes/tf_passes.md
state, and TPUReshardVariablesOps compares the current state with a desired state (which can be the compilation result). If they mismatch, TPUReshardVariablesOp reformats the variables to the desired state; if they match, TPUReshardVariablesOp is a no-op. A major use of this pass is weight-update sharding in data parallelism, so we require there is a tf_device.replicate in the loop.
Registered: Sun Jun 16 05:45:23 UTC 2024 - Last Modified: Wed Aug 02 02:26:39 UTC 2023 - 96.4K bytes - Viewed (0)