[tf.data] Optimize SerializeManySparseOp implementation used in unbatching tf.SparseTensor.

This change makes the following optimizations:

1. Split the template specialization (between tstring and Variant) so that it
   applies at the entire op level, rather than a per-element level. This permits
   us to specialize for the (overwhelmingly more common) Variant case:

   * Use `Variant::emplace()` instead of the move assignment operator to avoid
     copying the inline data (viz. the TensorShape) in a Tensor.

2. Only set empty elements when the input is empty. Currently we call
   setConstant() on the entire output to set empty elements. With this change
   we only set those elements if there is no matching group in the input. This
   prevents wasted work (i) in the assignment and (ii) in destroying the
   unnecessarily assigned Tensors.

3. Introduce `sparse::Group::group_at()` to avoid the need for constructing a
   temporary vector on each group access, only to access the 0th element.

4. Optimize `sparse::GroupIterable::GroupMatches()` to return immediately when a
   mismatch is detected.

PiperOrigin-RevId: 289209832
Change-Id: I22df11bf474eab117307931908cef9c601d98226
2 files changed
tree: e9bd2aba727fcebaf3c0c79b3dbc99d4da203958
  1. .github/
  2. tensorflow/
  3. third_party/
  4. tools/
  5. .bazelrc
  6. .bazelversion
  7. .gitignore
  8. ACKNOWLEDGMENTS
  9. ADOPTERS.md
  10. arm_compiler.BUILD
  11. AUTHORS
  12. BUILD
  13. CODE_OF_CONDUCT.md
  14. CODEOWNERS
  15. configure
  16. configure.cmd
  17. configure.py
  18. CONTRIBUTING.md
  19. ISSUE_TEMPLATE.md
  20. ISSUES.md
  21. LICENSE
  22. models.BUILD
  23. README.md
  24. RELEASE.md
  25. SECURITY.md
  26. WORKSPACE
README.md
Documentation
Documentation

TensorFlow is an end-to-end open source platform for machine learning. It has a comprehensive, flexible ecosystem of tools, libraries, and community resources that lets researchers push the state-of-the-art in ML and developers easily build and deploy ML-powered applications.

TensorFlow was originally developed by researchers and engineers working on the Google Brain team within Google's Machine Intelligence Research organization to conduct machine learning and deep neural networks research. The system is general enough to be applicable in a wide variety of other domains, as well.

TensorFlow provides stable Python and C++ APIs, as well as non-guaranteed backward compatible API for other languages.

Keep up-to-date with release announcements and security updates by subscribing to announce@tensorflow.org. See all the mailing lists.

Install

See the TensorFlow install guide for the pip package, to enable GPU support, use a Docker container, and build from source.

To install the current release, which includes support for CUDA-enabled GPU cards (Ubuntu and Windows):

$ pip install tensorflow

A smaller CPU-only package is also available:

$ pip install tensorflow-cpu

To update TensorFlow to the latest version, add --upgrade flag to the above commands.

Nightly binaries are available for testing using the tf-nightly and tf-nightly-cpu packages on PyPi.

Try your first TensorFlow program

$ python
>>> import tensorflow as tf
>>> tf.add(1, 2).numpy()
3
>>> hello = tf.constant('Hello, TensorFlow!')
>>> hello.numpy()
'Hello, TensorFlow!'

For more examples, see the TensorFlow tutorials.

Contribution guidelines

If you want to contribute to TensorFlow, be sure to review the contribution guidelines. This project adheres to TensorFlow's code of conduct. By participating, you are expected to uphold this code.

We use GitHub issues for tracking requests and bugs, please see TensorFlow Discuss for general questions and discussion, and please direct specific questions to Stack Overflow.

The TensorFlow project strives to abide by generally accepted best practices in open-source software development:

CII Best Practices Contributor Covenant

Continuous build status

Official Builds

Build TypeStatusArtifacts
Linux CPUStatusPyPI
Linux GPUStatusPyPI
Linux XLAStatusTBA
macOSStatusPyPI
Windows CPUStatusPyPI
Windows GPUStatusPyPI
AndroidStatusDownload
Raspberry Pi 0 and 1Status StatusPy2 Py3
Raspberry Pi 2 and 3Status StatusPy2 Py3

Community Supported Builds

Build TypeStatusArtifacts
Linux AMD ROCm GPU NightlyBuild StatusNightly
Linux AMD ROCm GPU Stable ReleaseBuild StatusRelease 1.15 / 2.x
Linux s390x NightlyBuild StatusNightly
Linux s390x CPU Stable ReleaseBuild StatusRelease
Linux ppc64le CPU NightlyBuild StatusNightly
Linux ppc64le CPU Stable ReleaseBuild StatusRelease 1.15 / 2.x
Linux ppc64le GPU NightlyBuild StatusNightly
Linux ppc64le GPU Stable ReleaseBuild StatusRelease 1.15 / 2.x
Linux CPU with Intel® MKL-DNN NightlyBuild StatusNightly
Linux CPU with Intel® MKL-DNN Stable ReleaseBuild StatusRelease 1.15 / 2.x
Red Hat® Enterprise Linux® 7.6 CPU & GPU
Python 2.7, 3.6
Build Status1.13.1 PyPI

Resources

Learn more about the TensorFlow community and how to contribute.

License

Apache License 2.0