tree 74ced6360d4daf27da7f268c340e7c7b0bc3e77e
parent aed40c077bc79212c095e56059399ab5b0be1886
author Andy Ly <lyandy@google.com> 1576000399 -0800
committer TensorFlower Gardener <gardener@tensorflow.org> 1576000623 -0800

Sort `tf.TPUReplicatedInput` ops by index attribute when forming `tf_device.replicate` in TPU cluster formation pass.

Padding map relies on index set in `tf.TPUReplicatedInput` ops. To make non negative indices ordering be deterministic, the ops can be sorted by index when added to the `tf_device.replicate` op. Ordering of `tf.TPUReplicatedInput` with an index not set (default -1) can be ignored.

PiperOrigin-RevId: 284790304
Change-Id: I830a77c03273cbe7c2cebc21762579c69478f4d6