structures of `tensors` as inputs (instead of just a list of tensors).
        Note that Python structures such as tuples and lists now won't be
        treated as tensors, so if you still want them to be treated that way,
        you need to wrap them with `tf.convert_to_tensor`.
    *   No lowering on gradient case op when input is `DeviceIndex` op.